lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Krüger <krue...@lesspain.de>
Subject Re: Is Overlapping onDeckSearchers=2 really a problem?
Date Thu, 27 Jun 2013 21:03:06 GMT
Shawn,

On Thu, Jun 27, 2013 at 5:03 PM, Shawn Heisey <solr@elyograg.org> wrote:
> On 6/27/2013 5:59 AM, Robert Krüger wrote:
>> sometime forcing oneself to describe a problem is the first step to a
>> solution. I just realized that I also had an autocommit statement in
>> my config with the exact same amount of time the seemed to be between
>> the warnings.
>>
>> I removed that, because I don't think I really need it, and now the
>> warnings are gone. So it seems it happened whenever my manual commits
>> overlapped with an autocommit, which, of course, was more likely when
>> many commits were issued in sequence.
>
> If all you are doing is soft commits, your transaction logs are going to
> grow out of control.

you are absolutely right. I was shooting myself in the foot with that change.

> http://wiki.apache.org/solr/SolrPerformanceProblems#Slow_startup
>
> My recommendation:
>
> 1) Remove all commits from your indexing application.
> 2) Configure autoCommit with values similar to that wiki page.
> 3) Configure autoSoftCommit to happen often.
>
> The autoCommit must have openSearcher set to false.  For autoSoftCommit,
> include a maxTime between 1000 and 5000 (milliseconds) and leave maxDocs
> out.

I did that but without autoSoftCommit because I need control over when
the commits happen and soft-commit in my application.

Thank you so much,

Robert

Mime
View raw message