nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@nutch.org>
Subject Re: [Nutch-dev] Some questions in webdb
Date Thu, 03 Mar 2005 18:43:38 GMT
Anoop wrote:
> 1)      I see talk of Map&Reduce. What is it and how does it improve 
> performance?
> 
> 2)      Has it affected NDFS / Distributed DB in any way?

Our MapReduce implementation is now nearly complete.  Soon we can begin 
re-implementing many of Nutch's core algorithms using MapReduce.  The 
web db will be one of the first, since it is currently a scalability 
bottleneck.

Doug

Mime
View raw message