lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jan Høydahl <jan....@cominvent.com>
Subject Re: Solr 3.5 takes very long to commit gradually
Date Thu, 12 Apr 2012 07:19:33 GMT
What operating system?
Are you using spellchecker with buildOnCommit?
Anything special in your Update Chain?

--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com

On 12. apr. 2012, at 06:45, Rohit wrote:

> We recently migrated from solr3.1 to solr3.5, we have one master and one
> slave configured. The master has two cores,
> 
> 1) Core1 - 44555972 documents
> 
> 2) Core2 - 29419244 documents
> 
> We commit every 5000 documents, but lately the commit time gradually
> increase and solr is taking as very long 15 minutes plus in some cases. What
> could have caused this, I have checked the logs and the only warning i can
> see is,
> 
> "WARNING: Use of deprecated update request parameter update.processor
> detected. Please use the new parameter update.chain instead, as support for
> update.processor will be removed in a later version."
> 
> Memory details:
> 
> export JAVA_OPTS="$JAVA_OPTS -Xms6g -Xmx36g -XX:MaxPermSize=5g"
> 
> Solr Config:
> 
> <useCompoundFile>false</useCompoundFile>
> 
> <mergeFactor>10</mergeFactor>
> 
> <ramBufferSizeMB>32</ramBufferSizeMB>
> 
> <!-- <maxBufferedDocs>1000</maxBufferedDocs> -->
> 
> <maxFieldLength>10000</maxFieldLength>
> 
> <writeLockTimeout>1000</writeLockTimeout>
> 
> <commitLockTimeout>10000</commitLockTimeout>
> 
> Also noticed, that top command show almost 350GB of Virtual memory usage.
> 
> What could be causing this, as everything was running fine a few days back?
> 
> 
> 
> 
> 
> Regards,
> 
> Rohit
> 
> Mobile: +91-9901768202
> 
> About Me:  <http://about.me/rohitg> http://about.me/rohitg
> 
> 
> 


Mime
View raw message