lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <>
Subject Re: Spliting the Lucene
Date Fri, 08 Dec 2006 20:21:45 GMT
howard chen wrote:
> Can you suggest if using Hadoop + Lucene, how to make a simple
> distributed indexing & searching program, i.e. what are the mapping /
> reducing processes involved in both indexing abd searching?

There is not yet a universal, best practice for this.

Nutch provides an example of how to use Lucene for distributed indexing. 
  Nutch's current distributed search implementation builds on Hadoop's 
RPC mechanism, but is not based on Hadoop's MapReduce.

There has been some discussion of MapReduce-based distributed search on 
the Nutch lists, e.g.:

I think Andrzej Bialecki has explored this approach some.

Another approach is to build a non-MapReduce-based system specifically 
for supporting distributed search and indexing.  I started a discussion 
about this a few months ago and hope to start work on this project 
before long.


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message