We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    Flat editorial illustration: The article is about joining public web signals with internal business metrics so BI teams can inter
    Alternative Data in BI: Bringing Public Web Data Into Your Dashboards
    23 Min Read
    Flat editorial illustration: The article is about automating the collection, preparation, and delivery of marketing data across p
    From Data to Dashboards: 5 Marketing Reporting Automation Software Picks
    12 Min Read
    Flat editorial illustration: The article contrasts passive follower totals with a behavioral path from attention and trust to cli
    Creator Analytics Beyond Follower Count: Seven Metrics That Measure Audience Behavior
    11 Min Read
    Flat editorial illustration: The article connects AI and marketing analytics with managerial judgment grounded in consumer behavi
    How an Online MBA in Marketing Connects AI and Data Analytics
    11 Min Read
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers -- AI-generated illustration
    What Kind of Problem-Solving Distinguishes Data Analysts From Software Engineers
    7 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Mike Olson‘s Keynote at the 2012 Hadoop World/Strata Conference in NYC.
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > IT > Cloud Computing > Mike Olson‘s Keynote at the 2012 Hadoop World/Strata Conference in NYC.
Big DataCloud ComputingHadoop

Mike Olson‘s Keynote at the 2012 Hadoop World/Strata Conference in NYC.

BobGourley
BobGourley
7 Min Read
Mike Olson‘s Keynote at the 2012 Hadoop World/Strata Conference in NYC.
Illustration generated with FLUX.2 [klein 4B] via Cloudflare Workers AI.
SHARE

“Somewhere, something incredible is waiting to be known” said Carl Sagan. This inspiring quote is a tremendous mantra for those in the Big Data movement and it played a central organizing theme to Mike Olson‘s keynote at the 2012 Hadoop World/Strata Conference in NYC.  Mike highlighted this quote in his motivational keynote because of its perpetual truth. No matter what we learn we are always on the edge of new knowledge. There is always something else.

“Somewhere, something incredible is waiting to be known” said Carl Sagan. This inspiring quote is a tremendous mantra for those in the Big Data movement and it played a central organizing theme to Mike Olson‘s keynote at the 2012 Hadoop World/Strata Conference in NYC.  Mike highlighted this quote in his motivational keynote because of its perpetual truth. No matter what we learn we are always on the edge of new knowledge. There is always something else. Which makes this a great time to be in this industry. We are poised on the edge of great discoveries for industry and society.

Mike then hit on some examples of how Big Data analysis is transforming society and industry today:

– The Large Hadron Collider at CERN, which generates 27 terabytes of useful data per day, is giving tremendous insights into how the universe works, including the recent discovery of the Higgs Boson, the particle which gives mass to matter. Researchers globally have access to this data for their own research. For example, the Unviversity of Nebraska Lincoln has captured all this data in a Hadoop Cluster and make this available to researchers globally. Discoveries will continue.

More Read

Data Analytics Helps Property Management Companies Join The 21st Century
Data Analytics Helps Property Management Companies Join The 21st Century
The Market Is Hot, But How Many Quants Are Changing Jobs?
The Internet of Things and Applied Digital Strategy
Cloud-Based Supply Chain Risk Management Is Key To A Company’s Future
Data Systems International Uses Big Data Advances In Supply-Chain Management

– Healthcare is full of incredible Big Data use cases and success stories. Many of those come from activities around the Human Genome. New research has indicated that our genetic makeup is not the only biological determinate that makes us human. Human’s have about 1 trillon cells all including the same genome and this is incredibly important to continue to research but new research shows over 10 trillion other cells (mostly bacteria) ride on the human and have impacts on how our body function and even which genes are triggered. This world of epigenetics forces us to ask continually bigger questions in our search for more knowledge, and it is helping us better understand the onset and progress of disease and new treatments.  This includes breakthrough research by the National Cancer Institute, for example. All the breakthroughs in these fields are connected to Hadoop-based projects.

– New predictive models on social matters and policy issues are also making a difference in the world including analytical models and model enabled analysis.  Much of this is based on the Hadoop family of capabilities.

– What if how we generate and consume electricity could be better measured and action taken to understand and act upon those measurements?

The above are a few of the many use cases in place now using these capabilities.

Far more is being done with the current big data capabilities, and new more powerful capabilities are also coming, fast. Community-focused companies like Cloudera and the open source community itself are moving towards more simplified, unified, efficient Big Data platforms with a vision towards a single repository and comprehensive analytics that can explore it. And capabilities are now being announced to enhance the ability to work with speed over big data.

The Hadoop framework includes many tools centered around Hadoop, but at its core is an ability to run mapreduce jobs. Although info from those mapreduce jobs can be put in HDFS and queried in real time, it actually takes time to produce the results.  Current mapreduce jobs are not real time by any means. It is hard to ask and rapidly iterate new questions over Big Data. In the opinion of many, it is just too slow and in need of a serious, significant improvement.

Which leads to Mike Olson and Cloudera’s big announcement in this video, a capability known as Impala. Cloudera Impala is designed from the ground up with a powerful goal in mind: enabling you to work over big data at the speed of thought.  Cloudera has been working on this for 2 years.  It is a 100% open source real time query engine that lets you work in real time query engine fully integrated with Hadoop.  It allows you to take advantage of map reduce and ask speed of thought queries of your data. This is a new way to get at your data. And the data doesn’t move. It runs on your data in your Hadoop cluster.

Implala has been in a private beta with several customers. One, for example, is a Fortune 500 company specializing in agriculture and genomics which needed this capability to better automate their data-driven R&D decisions to reduce time to market from years to months. Result: better ways to feed humanity, now and in the future. This is seriously good. Cloudera, Hadoop and Impala have knocked down silos in these crucial area.

Mike ends his note by understanding that we need to keep asking big (and bigger) questions.

The rest of the conference included many detailed presentations on ways the community is asking and answering these big questions. We will report on more of them here.

[Watch this at if embed does not show: YouTube]

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Flat editorial illustration: The article connects downstream report failures, data-quality gaps, and conflicting metric definitio
Signs Your Data Architecture Needs an Outside Review
Big Data Exclusive
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Data-Driven Pultrusion: Best GFRP Rebar Machines & ROI
Big Data Exclusive
Flat editorial illustration: The article contrasts tools for gathering fresh interviews with tools for analyzing existing qualita
10 AI Market Research Tools That Turn Qualitative Data into Insights
Artificial Intelligence Big Data Exclusive
Flat editorial illustration: The article compares proxy MCP servers by what an AI agent can do through them: manage proxy account
Proxy MCP Servers: 7 Options and What Each Lets an AI Agent Do
Artificial Intelligence Big Data Data Collection

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

How To Maintain Accurate Data Through Conversational Analysis?
Analytics

How To Maintain Accurate Data Through Conversational Analysis?

8 Min Read
Will Bollywood take the shine off Communications revenue? Competing in Media & Communications with data-driven analytics
Business IntelligenceData MiningNew Products

Will Bollywood take the shine off Communications revenue? Competing in Media & Communications with data-driven analytics

9 Min Read
Socializing
Data VisualizationPredictive Analytics

Socializing

14 Min Read
Managing Big Data Integration and Security with Hadoop
Big DataData MiningData WarehousingHadoopMapReduceOpen SourceRisk ManagementWorkforce Data

Managing Big Data Integration and Security with Hadoop

19 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
How AI Website Chatbots Improve Customer Support and Lead Generation
Chatbots Exclusive
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?