lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vinay Pothnis <poth...@gmail.com>
Subject Re: Optimal configuration for high throughput indexing
Date Mon, 04 May 2015 23:53:24 GMT
Hi Shawn,

Thanks for your inputs. The 12GB is for solr.
I did read through your wiki and your G1 related recommended settings are
already included. Tried a lower memory config (7G) as well and it did not
result in any better results.

Right now, in the process of changing the updates to use Solrj
CloudSolrServer and testing it.

Thanks
Vinay

On 4 May 2015 at 16:09, Shawn Heisey <apache@elyograg.org> wrote:

> On 5/4/2015 2:36 PM, Vinay Pothnis wrote:
> > But nonetheless, we will give the latest solrJ client + cloudSolrServer a
> > try.
> >
> > * Yes, the documents are pretty small.
> > * We are using G1 collector and there are no major GCs, but however,
> there
> > are a lot of minor GCs sometimes going upto 2s per minute overall.
> > * We are allocating 12G of memory.
> > * Query rate: 3750 TPS (transactions per second)
> > * I need to get the exact rate for insert/updates.
> >
> > I will make the solrJ client change first and give it a test.
>
> Whether that 12GB heap size is for Solr itself or for your client code,
> with a heap that large, you should be doing more tuning than simply
> turning on G1GC.  I have spent quite a lot of time working on GC tuning
> for Solr, and the results of that work can be found here:
>
> http://wiki.apache.org/solr/ShawnHeisey
>
> I cannot claim that these are the best options you can find for Solr,
> but they've worked well for me, and for others.
>
> Thanks,
> Shawn
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message