IT Management and Cloud Blog

« | Home | »

Don’t tell me that cloud computing is not changing the game.

By John | January 30, 2008

When they wanted to find out which part of the the world their customers logged in from, a quick MapReduce job was created and they had the answer within a few hours. Not really possible in your typical ETL system. This switch has changed how they run their business. Stu Hood nicely sums up the impact: “Now whenever we think of complex question about our customers’ usage patterns, we can pull the answer from our logs within hours via MapReduce. This is powerful stuff.”

How Rackspace Now Uses MapReduce and Hadoop to Query Terabytes of Data

Topics: cloud computing, google, hadoop | 6 Comments »

6 Responses to “Don’t tell me that cloud computing is not changing the game.”

  1. Damon Edwards Says:
    January 30th, 2008 at 7:46 pm

    I too find it interesting how many people want to deny the handwriting on the wall… but then I realized that is exactly the problem. Many people just don’t get things (or have financial motivation not to get it) until it hits them on the head.

    I think a lot of hesitation around how to harness a cloud model comes from the fact that most of the examples of how to do it focus on these over the top webscale type of examples. Things like “I have xxx TB of data to crunch and look how the could could handle it”. Most people’s computing problems are on a dramatically smaller scale. In many cases scale is never even the top concern. Aside from stories about creative Amazon AWS usage there just isn’t much out there yet that relates to the more common problems. (And I’ve even heard AWS, specifically EC2, downplayed as just a slicker way to do managed hosting)

  2. John Says:
    January 31st, 2008 at 11:05 am

    I know you know this already … :)

    In today’s environment you are either big or you don’t exists. Small becomes very big fast and and not becoming big is a local mom-n-pop (long tail kind of stuff). Therefore if you want to be in the game you have to start from a mindset of big.

    “Playing Field V1″ was the internet.
    “Playing Field V2″ is the cloud.

    Remember the “Deer in the Headlights” look Barnes and Noble had when Amazon hit the field. With clouds almost any business model is a potential startup target. The beauty of a cloud is that you can put out a business model on a single core 2 gig and with the right viral momentum you can grow to 200 quads with a credit card.

    Game on!

    Thanks for commenting on my blog.

  3. Jengates Blog » Blog Archive » links for 2008-02-01 Says:
    February 1st, 2008 at 6:19 pm

    [...] Don’t tell me that cloud computing is not changing the game. | John M Willis ESM Blog [...]

  4. Cloud Computing and the Enterprise | John M Willis ESM Blog Says:
    February 13th, 2008 at 9:55 am

    [...] How to get startedIt’s easy to get started. For no more than around $100 a month you can get a basic cloud that could be used for R&D projects, QA and testing, web portals, collaboration and/or best practices. Amazon AWS, Mosso, and Flexiscale are good places to get started. Also, Hadoop is a software technology that can be used as a tool to enable cloud programming. A good example is here. [...]

  5. Enterprise Beware! | John M Willis ESM Blog Says:
    March 12th, 2008 at 10:50 am

    [...] open source enterprise search tool, to analyze IT problems. I recently wrote a blog article on how MailTrust a Rackspace subsidiary is using Hadoop (Enterprise Search) to analyze massive amounts of mail server logs. Using Enterprise Search tools, [...]

  6. CloudDoplets #2 - It’s All Good in Da Cloud | IT Management and Cloud Blog Says:
    November 7th, 2008 at 9:50 am

    [...] On Demand IT management and the Cloud.  See Mailtrust example. [...]