We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Does It Take a Scientist to Find Gold in Big Data?
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > Does It Take a Scientist to Find Gold in Big Data?
AnalyticsData MiningText AnalyticsUnstructured Data

Does It Take a Scientist to Find Gold in Big Data?

Brett Stupakevich
Brett Stupakevich
0 Min Read
Does It Take a Scientist to Find Gold in Big Data?
Illustration generated with Qwen Image.
SHARE

In a recent CNET article, Alex Yoder (In a recent CNET article, Alex Yoder (@yodera) compared data to the value of other can’t-live-without assets – oil and gold. However, he says that big data has a major differentiator – “data has no intrinsic value.”

He’s right. The value of data comes from its refinement.

Yoder writes, “Gold requires mining and processing before it fines its way into our jewelry, electronics and even the Fort Knox vault. Oil requires extraction and refinement before it becomes the gasoline that fuels our vehicles. Likewise, data requires collection, mining and, finally, analysis before we can realize its true value for businesses, governments and individuals alike.”

What’s interesting about this comparison is that behind the mining, processing and analysis is big science. It takes a scientific approach and processes to find the value in data and precious commodities. Yoder defines the analysis portion of extracting value from data as the science.

More Read

Analytics and Exponential, Unpredictable Growth
Analytics and Exponential, Unpredictable Growth
Mathematics Invades the Marketing Kingdom
Collaboration Is Vital to Success [VIDEO]
The Growing Importance of Customer Data Mining for SMEs
Analysis of a Bad Indicator

The Science of Finding Gold in Data

As Yoder points out, there’s also science in the mining and processing of the data as well – just go back to our interview with Gregory Piatetsky-Shapiro (@KDNuggets) on the topic of data science and predictive analytics.

Piatetsky-Shapiro says, “What we want to find in data is some understandable knowledge and not just incomprehensible patterns. He adds, “[A] better understanding of predictive models will contribute to increased trust for such models.”

Piatetsky-Shapiro is a living example of how science can extract value from data. He’s developed models to help change the world. In our interview, he told us he has developed models for life-changing predictive analytics such as predicting child support non-payment and attrition to predicting drug effectiveness to developing methods for identifying fraud in online auctions.

Didn’t Gold Mining Start with a Simple Quest for Something More?

While Yoder and Piatetsky-Shapiro both point to the methods, models and software as keys to refining value, they also recognize the human element. Yoder says, “It takes complex algorithms, powerful computing and perhaps most of all, human analysts to build and administer the big science that turns the ‘then and now’ nature of big data into ‘when.’”

He points to a projection from McKinsey Global that the US needs 140,000 to 190,000 additional deep analytical minds working to derive the value of data. Often labeled as data scientists (quite fitting with the topic of big data being backed by big science), Yoder says these experts are thought to be the next class of “digital and corporate geniuses.”

Piatetsky-Shapiro’s take is that the data scientist role is much like an engineer or wizard with a skill set that combines “code tuning, business insight and knowing how to extract business value from data.”

Our Take: Give Your People Gold Fever

We think there’s a place and a definite need for these data wranglers. However, if an organization is going to join the gold rush that big data promises, don’t you think we have to start with the users? And give them the tools they need – the picks, the pans and the drive or “gold fever” to “head for the hills?”

Their tools are analytics systems (maps) and the “quest for knowledge” that allows them to inspect the data landscape and find the gold nugget-filled streams and hills.

Mark Lorion (@mark_lorion) alludes to why the tools and the questions matter most in a recent interview on DM radio. He says, “If you measure it, you’ll change it. What’s hiding in your data that you haven’t measured?”

For example, he says when a business user has questions, the tools often get in the way of the answers. He says it’s hard for a user to find the right answers in a spreadsheet or other tools when the presentation is hiding what he’s trying to see. It’s frustrating because the user knows he can beat the competition if he can get reliable information from the data.

Maybe the gold or “knowledge discovery” (as Piatetsky-Shapiro says) starts with the right tools and the right questions and a little bit of fever.

Next Steps: See how Spotfire version 4.5 empowers users to “find the gold” insights hidden in big data and unstructured information in our webcast, “What’s New with Spotfire 4.5,” taking place today, May 31, at 1 p.m. Eastern.

Amanda Brandon
Spotfire Blogging Team

TAGGED:big data
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

Learn Why Doctors Look To Data To Increase Patient Engagement
Big DataExclusiveModelingPredictive Analytics

Learn Why Doctors Look To Data To Increase Patient Engagement

9 Min Read
A Few Proven Suggestions for Handling Large Data Sets
Big Data

A Few Proven Suggestions for Handling Large Data Sets

8 Min Read
Here’s How Your Small Business Can Thrive in a World of AI and Big Data
Artificial IntelligenceBig DataBusiness IntelligenceExclusive

Here’s How Your Small Business Can Thrive in a World of AI and Big Data

6 Min Read
Preferred Payment Method Data Is Driving Online Payment Convenience
Big Data

Preferred Payment Method Data Is Driving Online Payment Convenience

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence
How To Get An Award Winning Giveaway Bot
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?