lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Grant Ingersoll <gsing...@apache.org>
Subject Re: Performance Tuning: segment_merge:index_update=5:1 (timing)
Date Tue, 11 Aug 2009 21:01:09 GMT
Have you tried profiling?  How often are you committing?  Have you  
looked at Garbage Collection or any of the usual suspects like that?


On Aug 11, 2009, at 4:49 PM, Fuad Efendi wrote:

> In a heavily loaded Write-only Master SOLR, I have 5 minutes of RAM  
> Buffer
> Flash / Segment Merge per 1 minute of (heavy) batch document updates.

Define heavy.  How many docs per second?


>
> I am using mergeFactor=100 etc (I already posted message...)
>
> So that... I can't see hardware is a problem: with more CPU and faster
> RAID-0 I'll get the same numbers, 5:1. Why?..
>
> I'll try with better hardware anyway... during segment merge  
> everything
> stops in SOLR although I am (in theory) using  
> ConcurrentMergeScheduler with
> Java 6.
>
>
>
> Having mergeFactor=100000 and doing "commit" only once a year (and  
> waiting a
> week(s) till it merge/commit/optimize)???
>
>
>



Mime
View raw message