lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toke Eskildsen>
Subject Re: severe problems with soft and hard commits in a large index
Date Wed, 06 May 2015 08:45:37 GMT
On Wed, 2015-05-06 at 00:58 -0700, adfel70 wrote:
> each shard has around 200 million docs. size of each shard is 250GB.
> this runs on 12 machines. each machine has 4 SSD disks and 4 solr processes.
> each process has 28GB heap.  each machine has 196GB RAM.


> 1. heavy GCs when soft commit is performed (methods 1,2) or when hardcommit
> opensearcher=true is performed. these GCs cause heavy latency (average
> latency is 3 secs. latency during the problem is 80secs)

Sanity check: Are you sure the pauses are due to garbage collection?

You have a fairly large heap and judging from your previous post
"problem with facets  - out of memory exception", you are doing
non-trivial faceting. Are you using DocValues, as Marc suggested?

- Toke Eskildsen, State and University Library, Denmark

View raw message