Kaggle, a data-prediction company, is inviting numerati the world over to mine a small set of data and predict patterns in HIV. Offering $500, the competition has already drawn in 71 individuals and teams, and some of them have submitted dozens of predictions.
As we saw in the famous Netflix datamining contest, these competitions can generate a lot of activity and research. And while Netflix offered a million dollars, Kaggle demonstrates that big money is not necessary. Researchers are drawn by the challenge, the data, and the chance to mingle with (and show-off before) their global peers. What's more, these competitions are wonderful for networking. As competitors scan the other studies, they see new approaches, meet new colleagues, and often they team up. The winning Netflix team was a coalition of people who met on the competition site.
Kaggle founder, Anthony Goldbloom, argues that competitions can move scientific research far faster than the traditional process involving peer-reviewed papers. In a blog post, he writes:
Whereas scientific literature tends to evolve slowly (somebody writes a paper, somebody else tweaks that paper and so on), a competition inspires rapid innovation by introducing the problem to a wide audience. There are an infinite number of approaches that can be applied to any modeling task and it is impossible to know at the outset which technique will be most effective. By exposing a problem to a wide audience, competitions expose the problem to a range of different techniques. This maximises the chances of finding a solution, and gets the most out of any particular dataset- given its inherent noise and richness.
Data mining competition: HIV progression
Other Posts by Stephen Baker
Healthcare's Only Hope: Surveillance - September 20, 2011
Getting Ready for the Post-Season: Numerati Baseball - September 17, 2011
The Statistics of Counter-Terrorism - September 12, 2011
You Will Be Monitored, Step by Step - September 9, 2011
Post Steve Jobs: 'Hard to Imagine' Game-Changing Technology - August 29, 2011
The moderated business community for business intelligence, predictive analyics, and data professionals.
The Predictive Analytics in the Cloud Study is complete!
Register here to access the full results of this exclsuive study on Predictive Analytics and Cloud Technology including a whitepaper, 2 webinars, multiple podcasts and more!
Stephen Baker is the author of The Numerati & a journalist with 20 years of experience at BusinessWeek. More »
Paul Barsch directs professional services marketing programs for Teradata and has more than fifteen years of information... More »
Gary Cokins is an internationally recognized expert, speaker, and author. More »
Jill Dyché is an internationally recognized author, speaker, and business consultant. More »
Themos Kalafatis has worked as a consultant for Data Mining, Text Mining, Information Extraction and Data Quality for over a decade. More »
James Taylor is CEO and Principal Consultant at Decision Management Solutions and a leading expert in decision management. More »
SmartData Collective
- YOU
- Dean Abbott
- Teradata AusNZ
- Paul Barsch
- Meta S. Brown
- Jason Burke
- Gary Cokins
- Ted Cuzzillo
- Barry Devlin
- Chris Dixon
- Jill Dyché
- Timo Elliott
- Teradata EMEA
- Teradata Experts
- Michael Fauscette
- Bill Franks
- Bob Gourley
- Julie Hunt
- Doug Lautzenheiser
- Jack Mason
- Darryl McDonald
- Alex Olesker
- David Smith
- James Taylor
- Daniel Tunkelang
HR & Workforce Analytics Innovation Summit
When: Thu, 2012-05-24 08:00
Business Analytics Innovation Summit
When: Thu, 2012-05-24 08:00
Salford Analytics and Data Mining Conference
When: Thu, 2012-05-24 12:09
Information management and governance for the public services
When: Fri, 2012-05-25 08:00
Disruptive Technologies & Innovation Minds 2012
When: Mon, 2012-06-18 09:00
Advanced Analytics for Retail
When: Thu, 2012-06-21 08:00
Advanced Analytics for Consumer Goods
When: Thu, 2012-06-21 08:00
CIMI.Con Evolution 2012
When: Mon, 2012-06-25 08:00
Predictive Analytics World, June 25-26, 2012 in Chicago
When: Mon, 2012-06-25 09:00
Big Data for Enterprise USA 2012
When: Wed, 2012-06-27 08:00

About Social Media Today


