lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fuad Efendi" <f...@efendi.ca>
Subject RE: Performance Tuning: segment_merge:index_update=5:1 (timing)
Date Tue, 11 Aug 2009 21:23:27 GMT
Never tried profiling;
3000-5000 docs per second if SOLR is not busy with segment merge;

During segment merge 99% CPU, no disk swap; I can't suspect I/O...

During document updates (small batches 100-1000 docs) only 5-15% CPU

-server 2048Gb option of JVM (which is JRockit) + 256M for RAM Buffer

I can't suspect garbage collection... I'll try to do the same with much
better hardware tomorrow (2 quad-core instead of single double-core, SCSI
RAID0 instead of single SAS, 16Gb for Tomcat instead of current 2Gb) but
constant rate 5:1 is very suspicious...



-----Original Message-----
From: Grant Ingersoll 
Sent: August-11-09 5:01 PM

Have you tried profiling?  How often are you committing?  Have you  
looked at Garbage Collection or any of the usual suspects like that?


On Aug 11, 2009, at 4:49 PM, Fuad Efendi wrote:

> In a heavily loaded Write-only Master SOLR, I have 5 minutes of RAM  
> Buffer
> Flash / Segment Merge per 1 minute of (heavy) batch document updates.

Define heavy.  How many docs per second?





Mime
View raw message