Monday, January 21, 2008

MapReduce Again

MapReduce is a parallel programming environment. It is successfully used at Google, and perhaps elsewhere. This has generated some inspiration, some frustration and alas, some angst.
  • First some inspiration. The XLDB meeting at Stanford got scientists with *really* large scale data analyses problems to meet with academic researchers, corporate customers and vendors. A somewhat optimistic view there was that these applications needed MapReduce. In principle, a parallel shared-nothing programming system will be useful, but it seems to me that high energy physics and astronomy need sophisticated analyses, different from the kind of analyses at Google for which the design of MapReduce is optimized.
  • Next the frustration. When an Engineer asks me how to find the shortest edit distance between two strings on a single processor machine, I can immediately point them to Dynamic Programming and a classic Algorithms textbook. As a theory+algorithms researcher, I am frustrated when an engineer asks me how to solve a graph problem on MapReduce and I cannot immediately point to a upper/lower bound or a usable theory. See initial theory here.
  • Finally the angst. The database research community tends to be focused more on concepts and abstract solutions, and less on systems. A recent blog article describes some of their angst in not seeing the basic elements of a relational database in MapReduce. This angst is misplaced as comments and articles point out.
MapReduce is a working system that hands-on programmers find effective. More ideas from parallel computing, algorithms, relational databases or whatever that can make it more powerful, useful and more amenable to being analyzed and understood, will be good.

4 Comments:

Anonymous cheap viagra said...

This is the most perfect parallel programming environment, actually I consider these are good applications will be useful, but it seems to me that high energy physics and astronomy need sophisticated analyses.m10m

1:33 PM  
Anonymous viagra online said...

This is good my brother was talking me about this application and that's perfect because finally I found it with excellent information, thanks so much.

12:46 PM  
Blogger Shijun Lin said...

shijun 6.5
michael kors outlet
louis vuitton
louis vuitton
jordan 4 retro
ralph lauren uk
kate spade
coach factorty outlet
michael kors uk
louis vuitton handbags
louis vuitton outlet
adidas shoes
christian louboutin outlet
louis vuitton
ray ban wayfarer
coach outlet
jordan 13s
louis vuitton outlet
pandara jewelry
christian louboutin sale
coach outlet
running warehouse
michael kors
michael kors outlet
ray ban sunglasses
coach outlet
adidas running shoes
louis vuitton
mulberry bags
tods sale
gucci outlet
coach outlet
christian louboutin shoes
louis vuitton outlet
concord 11
cheap jerseys wholesale
copy watches
cheap oakleys
kate spade totes
fitflop outlet
hollister outlet

7:20 PM  
Blogger 750unique said...

2015-07-24song
oakley sunglasses outlet
coach outlet store online
pandora charms
louboutin
abercrombie kids
oakley outlet store
nike pas cher
oakley sunglasses sale
ralph lauren polo shirts
oakley sunglasses cheap
coach outlet
tory burch handbags
chanel handbags
cheap ray bans
coach factory outlet
true religion
pandora jewelry outlet
air force pas cher
ray ban glasses
louis vuitton borse
coach outlet
longchamp
michael kors outlet
mont blanc pens
tory burch outlet online
cheap oakleys
cheap air max
michael kors
soccer outlet
hollister outlet
ed hardy uk
michael kors uk outlet
michael kors outlet online
gucci borse
mcm outlet online

2:56 AM  

Post a Comment

<< Home