lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: How to improve facet search?
Date Thu, 08 Dec 2011 20:17:37 GMT
These are really horrible numbers:
hitratio : 0.18
inserts : 5488
evictions : 5011

Your cache isn't doing you much good, part of the problem
is you're faceting on so many values and it's chewing through
your cache. If your full data set has significantly more terms,
you're going to have trouble scaling this solution.

Faceting works best on fields with fewer unique values,
so you're pushing it in a direction that it wasn't really designed
for.

What are you trying to accomplish by faceting on so many values?
Perhaps there's another way to accomplish that end, this might
be an "XY" problem.

Best
Erick

On Thu, Dec 8, 2011 at 8:08 AM, Kashif Khan <uplink2010@gmail.com> wrote:
> I have increased the filtercache values as to as <filterCache
> class="solr.FastLRUCache"  size="16384"     initialSize="4096"
> autowarmCount="4096"/> and  <documentCache  class="solr.LRUCache"
>  size="16384"     initialSize="16384"/> and <queryResultCache
> class="solr.LRUCache"   size="16384"     initialSize="4096"
>  autowarmCount="1024"/> but still it performs as in seconds. I have got
> shards along with an average of 6 gb of data is indexed including the
> shards. But in production servers the data including shards has average of
> 80Gb data. it has 4,273 unique terms after doing facet search for a
> particular query. Are you asking unique terms for *:* query or for some
> particular query? 1 gb of ram is allocated for each shard.
> --
> Kashif Khan. B.E.,
> +91 99805 57379
> http://www.kashifkhan.in
>
>
>
> On Thu, Dec 8, 2011 at 4:53 PM, pravesh [via Lucene] <
> ml-node+s472066n3570048h41@n3.nabble.com> wrote:
>
>> How many unique terms do you have in the faceting field????
>> Since there are lot of evictions, consider increasing the size of the
>> filtercache. Try to keep evictions to min.
>>
>> BTW how much is your index size (GB/MB??) How much RAM is allocated?
>>
>> Above All:  Have you benchmarked your search? Is searching done in
>> milis/secs/mins?? I am trying to understand if your search could already be
>> performing quite good/OK.
>>
>> Regards
>> Pravesh
>>
>> ------------------------------
>>  If you reply to this email, your message will be added to the discussion
>> below:
>>
>> http://lucene.472066.n3.nabble.com/How-to-improve-facet-search-tp3569910p3570048.html
>>  To unsubscribe from How to improve facet search?, click here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3569910&code=dXBsaW5rMjAxMEBnbWFpbC5jb218MzU2OTkxMHwtMTgzODU3NDI3OQ==>
>> .
>> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.InstantMailNamespace&breadcrumbs=instant+emails%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/How-to-improve-facet-search-tp3569910p3570246.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Mime
View raw message