Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    sales and data analytics
    How Data Analytics Improves Lead Management and Sales Results
    9 Min Read
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Graphing real-time foreclosure data: Data Mashups in R
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Big Data > Data Mining > Graphing real-time foreclosure data: Data Mashups in R
Data MiningData Visualization

Graphing real-time foreclosure data: Data Mashups in R

DavidMSmith
DavidMSmith
5 Min Read
SHARE

The latest in the O’Reilly “Short Cuts” series, and the first devoted to R, is Data Mashups in R. Written by Jeremy Leipzig and Ziao-Yi Lu, this 30-page article is an excellent and very practical example of integrating messy data from varied sources, using R or REvolution R.

It’s not designed as a manual-style introduction to R. But while working through the fully-detailed example it presents, even programmers unfamiliar to R will get a good sense of the practical capabilities of R when working with real-life data sources. “Learning by doing” is a great way to bootstrap your knowledge of any language, and a concrete, practical example like this really helps with that process.

The example used is a particularly timely one: how to automate the process of downloading foreclosure data from a public website, and presenting it in graphical form, like this:

Philly-foreclosures

More Read

Image
How MapR’s M7 Platform Improves NoSQL and Hadoop
Software Dependence & Model Accuracy
Tableau Public launches visual analysis for the masses
Optimizing the Use of Line Charts
Is Your Company Ready to Deploy Business Intelligence Intelligently?
In practical terms, creating this graphic necessitates the integration of data from various sources:
  • Downloading an HTML file of foreclosed addresses from a public web-site (with download.file) and extracting addresses in messy formats (with grep);
  • Downloading geolocation data from a Yahoo web-service and parsing the …

The latest in the O’Reilly “Short Cuts” series, and the first devoted to R, is Data Mashups in R. Written by Jeremy Leipzig and Ziao-Yi Lu, this 30-page article is an excellent and very practical example of integrating messy data from varied sources, using R or REvolution R.

It’s not designed as a manual-style introduction to R. But while working through the fully-detailed example it presents, even programmers unfamiliar to R will get a good sense of the practical capabilities of R when working with real-life data sources. “Learning by doing” is a great way to bootstrap your knowledge of any language, and a concrete, practical example like this really helps with that process.

The example used is a particularly timely one: how to automate the process of downloading foreclosure data from a public website, and presenting it in graphical form, like this:

Philly-foreclosures

In practical terms, creating this graphic necessitates the integration of data from various sources:
  • Downloading an HTML file of foreclosed addresses from a public web-site (with download.file) and extracting addresses in messy formats (with grep);
  • Downloading geolocation data from a Yahoo web-service and parsing the XML result (with xmlTreeParse);
  • Downloading an ESRI shape file of Philadelphia and its census tracts, and plotting a map (with the maptools package);
  • Matching the individual addresses to census tracts and counting the number of foreclosures in each (with plotPolys).
One of the great things about the article is that it’s not presented as a theoretical exercise where everything just works the first time. It takes pains to cover not just how to accomplish the task itself, but also how to deal with problems you’re likely to encounter along the way (especially if you adapt the methods to your own needs). Practical advice is given on how to deal with connection problems caused by firewalls and proxies, how to deal gracefully with the failure of servers to respond (using tryCatch), and how to detect error messages from the Yahoo web service when it fails to recognize addresses. The authors also let you know where they found the information of how to deal with such problems, so it also serves as a guide for finding help resources in R.

My only criticisms are minor ones. The article leads the user through downloading Census data, matching it to the tracts, and performing some simply summary statistics and exploratory graphics, but stops short of any actual statistical analysis. And cutting-and-pasting R code from a PDF document is a pain: there’s no associated script file (as far as I know).

But for experienced R users looking for tips on integrating messy data sources from the Web, or for programmers new to R looking for a practical example to work through as an introduction to R, Data Mashups in R is well worth $4.99 to download.

O’Reilly Short Cuts: Data Mashups in R

Link to original post

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

sales and data analytics
How Data Analytics Improves Lead Management and Sales Results
Analytics Big Data Exclusive
ai in marketing
How AI and Smart Platforms Improve Email Marketing
Artificial Intelligence Exclusive Marketing
AI Document Verification for Legal Firms: Importance & Top Tools
AI Document Verification for Legal Firms: Importance & Top Tools
Artificial Intelligence Exclusive
AI supply chain
AI Tools Are Strengthening Global Supply Chains
Artificial Intelligence Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

Taking a Dimension-Free View of Data

4 Min Read

Finding, Locating, Discovering

6 Min Read

Big Data Showcase: Advanced Analytics

3 Min Read

Why OLAP?

6 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots
AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?