IT Management and Cloud Blog

« | Home | »

Amazon’s New Elastic Map Reduce

By John | April 5, 2009

Amazon has offered a new web service that provides Hadoop services called Elastic Map Reduce. Hadoop is a Java based framework that implements Map Reduce. Map Reduce is a method of programming that gives a program the capability of breaking a job up into hundreds or even thousands of separate parallel processes. The idea is that you can take a simple process (like counting the words in a book) and break it up into multiple running parts (i.e., The Map), then collect them all back into summary counts (i.e., The Reduce). This allows a programmer to process extremely large data sets in a timely manner. Hadoop is used by companies like Google, Yahoo, AOL, IBM, Facebook, and to name a few.

read more…

Topics: amazon, aws, elastic map reduce | No Comments »