lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peter Wolanin <peter.wola...@acquia.com>
Subject Re: SOLR: Replication
Date Sun, 03 Jan 2010 19:55:40 GMT
Related to the difference between rsync and native Solr replication -
we are seeing issues with Solr 1.4 where search queries that come in
during a replication request hang for excessive amount of time (up to
100's of seconds for a result normally that takes ~50 ms).

We are replicating pretty often (every 90 sec for multiple cores to
one slave server), but still did not think that replication would make
the master server unable to handle search requests.  Is there some
configuration option we are missing which would handle this situation
better?

Thanks,

Peter

On Sun, Jan 3, 2010 at 11:27 AM, Fuad Efendi <fuad@efendi.ca> wrote:
> Thank you Yonik, excellent WIKI! I'll try without APR, I believe it's
> environmental issue; 100Mbps switched should do 10 times faster (current
> replica speed is 1Mbytes/sec)
>
>
>> -----Original Message-----
>> From: yseeley@gmail.com [mailto:yseeley@gmail.com] On Behalf Of Yonik
>> Seeley
>> Sent: January-03-10 10:03 AM
>> To: solr-user@lucene.apache.org
>> Subject: Re: SOLR: Replication
>>
>> On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi <fuad@efendi.ca> wrote:
>> > I tried... I set APR to improve performance... server is slow while
>> replica;
>> > but "top" shows only 1% of I/O wait... it is probably environment
>> specific;
>>
>> So you're saying that stock tomcat (non-native APR) was also 10 times
>> slower?
>>
>> > but the same happened in my home-based network, rsync was 10 times
>> faster...
>> > I don't know details of HTTP-replica, it could be base64 or something
>> like
>> > that; RAM-buffer, flush to disk, etc.
>>
>> The HTTP replication is using binary.
>> If you look here, it was benchmarked to be nearly as fast as rsync:
>> http://wiki.apache.org/solr/SolrReplication
>>
>> It does do a fsync to make sure that the files are on disk after
>> downloading, but that shouldn't make too much difference.
>>
>> -Yonik
>> http://www.lucidimagination.com
>
>
>



-- 
Peter M. Wolanin, Ph.D.
Momentum Specialist,  Acquia. Inc.
peter.wolanin@acquia.com

Mime
View raw message