One of the biggest questions surrounding ‘analytics’ and ‘big data’ is how do you actually use it to add value? Big data is still such a foggy term that it attracts many myths ranging from ‘big data is not useful to anyone’ to ‘big data will help us solve all our problems’ – like with most things, the truth can be found somewhere in the middle.
One of the biggest questions surrounding ‘analytics’ and ‘big data’ is how do you actually use it to add value? Big data is still such a foggy term that it attracts many myths ranging from ‘big data is not useful to anyone’ to ‘big data will help us solve all our problems’ – like with most things, the truth can be found somewhere in the middle.
Any classification of how big data can be effectively used to add real benefits is valuable. It will help to lift some of the fog surrounding big data and allow us to have more structured thoughts and conversations about the topic. I have recently come across IBM’s top five ‘high value’ use cases for big data.
It is worth looking at these to see whether they make a sensible starting point, so here they are with my comments:
1. Big Data Exploration
Find, visualize, understand all big data to improve decision-making. Big data exploration addresses the challenge that every large organization faces: information is stored in many different systems and silos and people need access to that data to do their day-to-day work and make important decisions.
I would like to add: This is a ‘one-size-fits-all’ category that could include anything. The key point is that companies can delve into existing data repositories and transactions using big data techniques. This would also enable them to bring together data from different systems such as financial transactions, operational quality data, HR data, supplier information, etc. that is stored in different places or organizational silos. It enables companies to create a more complete picture and gain new insights from looking at all the available data. One example is corporate email and newsletter provider Constant Contact – they are sending out over 35 billion emails for their clients per year. Applying big data techniques is giving them valuable insights into the performance of these emails e.g. when to send them, how often, what subject lines work best, etc. This helps Constant Contact to optimize performance and to provide feedback to their clients.
2. Enhanced 360º View of the Customer
Extend existing customer views by incorporating additional internal and external information sources. Gain a full understanding of customers—what makes them tick, why they buy, how they prefer to shop, why they switch, what they’ll buy next, and what factors lead them to recommend a company to others.
I would like to add: Here companies use big data analytics to understand and better engage with customers. Examples would include telecom companies that use the data from phone records as well as social media behavior to create better pictures of customers. Some have started to predict churn and loyalty behaviors simply by classifying customers based on their call and social media patterns.
3. Security/Intelligence Extension
Lower risk, detect fraud and monitor cyber security in real time. Augment and enhance cyber security and intelligence analysis platforms with big data technologies to process and analyze new types (e.g. social media, emails, sensors, Telco) and sources of under-leveraged data to significantly improve intelligence, security and law enforcement insight.
I would like to add: Big data analytics allow us to detect fraud by analyzing credit card transactions in real time with the ability to shut down transactions that are suspicious or not feasible e.g. purchasing something in New York City at 2pm and in New Deli at 3pm. Big data analytics are also used to detect terrorist activity and cyber security attracts by constantly monitoring and processing data including phone conversations, social media messages, emails as well as sensor and machine data.
4. Operations Analysis
Analyze a variety of machine and operational data for improved business results. The abundance and growth of machine data, which can include anything from IT machines to sensors and meters and GPS devices requires complex analysis and correlation across different types of data sets. By using big data for operations analysis, organizations can gain real-time visibility into operations, customer experience, transactions and behavior.
I would like to add: The ‘Internet of Things’ is generating new data by the second. Smart Watches, Smart TVs, Smart Phones and even Smart Diapers are contributing to this new data stream. Companies can use this data to improve their own performance and even sell the data and insights to others. One example comes from a pizza delivery company which tracks their drivers using the GPS sensors in their smart phones. This gives the company new insights into how to optimize delivery routes. Another example comes from Energy Smart Meters. Collecting and using this new type of data gives us, for the first time, a real-time understanding the energy usages. This level of understanding allows energy companies to improve grid reliability and performance.
5. Data Warehouse Augmentation
Integrate big data and data warehouse capabilities to increase operational efficiency. Optimize your data warehouse to enable new types of analysis. Use big data technologies to set up a staging area or landing zone for your new data before determining what data should be moved to the data warehouse. Offload infrequently accessed or aged data from warehouse and application databases using information integration software and tools.
I would like to add: I am not really sure that this deserves it’s own ‘high value use case’ category. I would see it more as the technical end of doing big data analytics well. Anyway, you can obviously use big data techniques to optimize your data warehouse. Especially if you want to extend your data warehouse with social media data or break up or off-load part of the processing or analysis to improve overall data warehouse performance.
It is always easy to criticize any of these lists and frameworks but I feel it is a good starting point. You can find out more about these use cases at the IBM Big Data Hub where you can listen to a good potcast on the topic.
In one of my next posts I will outline the high-value use cases as I see them in practice. In the meantime, please let me know your thoughts on the use of big data today.
Please follow me if you would like to receive the future posts of my Big Data Guru column and feel free to also connect via Twitter, LinkedIn, Facebook and The Advanced Performance Institute