lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evert Wagenaar <>
Subject Re: Lucene cluster with NFS or synchronization tool such as rsync
Date Mon, 04 Jul 2016 01:41:32 GMT

I know that Nutch does it this way, already for years (Since version 1.0).
If you want to know exactly how it's done you should look into Nutch's
Source Code. The latest version of Nutch actually uses SolrCloud, therefore
I would look into earlier versions of Nutch, say 1.xx. Don't let Map reduce
scare you off. It's just the way how Nutch works with the Nutch Distributed
File System.

Good luck,

Evert Wagenaar.

Op zondag 3 juli 2016 heeft Desteny Child <> het
volgende geschreven:

> I need to organize a cluster for my stateless application based on Lucene
> 5.2.1. Right now I'm looking for a solution in order to share Lucene index
> via NFS or rsync between different Lucene nodes.
> Is it a good idea to use NFS for this purpose and if so will it be possible
> to read/write from different nodes to the same shared index ?
> Also I read that rsync tool can be used for this purpose(in order to
> synchronize index files across all nodes) but I can't find any success
> story for using rsync + Lucene. Right now I have a lot of question, one of
> them - is it safe to use rsync at anytime especially when IndexWriter is in
> progress(not closed) and actively indexes documents.

Sent from Gmail IPad

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message