There’s new video at the Video Rchive[*] of a JD Long presentation: Amazon Elastic Map-Reduce (So Easy an Economist Can Do It). I’m on a plane right now and the in-flight wi-fi isn’t quite up to playing the 30-minute video, but judging from the slides it looks like a nice, practical demonstration of getting a map-reduce computation programmed in R running on the Amazon cloud system. The code also appears quite complete: in a clever innovation, the commands to launch the Amazon instances run directly from the R code, which should eliminate a lot of the tedious command-line monkeying that…
There’s new video at the Video Rchive[*] of a JD Long presentation: Amazon Elastic Map-Reduce (So Easy an Economist Can Do It). I’m on a plane right now and the in-flight wi-fi isn’t quite up to playing the 30-minute video, but judging from the slides it looks like a nice, practical demonstration of getting a map-reduce computation programmed in R running on the Amazon cloud system. The code also appears quite complete: in a clever innovation, the commands to launch the Amazon instances run directly from the R code, which should eliminate a lot of the tedious command-line monkeying that typically accompanies an Amazon EC2 session. I look forward to trying it out when I’m landside.
[* Revolution Analytics sponsors the Video Rchive, which is provided as a service for the community by Drew Conway. Thanks, Drew! You can donate to the Video Rchive too, see the link in the right column of Drew’s blog.]
VCASMO/JD Long: Map-reduce in R with Amazon EMR