lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matteo Grolla <matteo.gro...@gmail.com>
Subject enable disable filter query caching based on statistics
Date Tue, 05 Jan 2016 13:58:33 GMT
Hi,
    after looking at the presentation of cloudsearch from lucene revolution
2014
https://www.youtube.com/watch?v=RI1x0d-yO8A&list=PLU6n9Voqu_1FM8nmVwiWWDRtsEjlPqhgP&index=49
min 17:08

I recognized I'd love to be able to remove the burden of disabling filter
query caching from developers

the problem:
Solr by default caches filter queries
a) When there are filter queries that are not reused and few that are the
good ones get evicted unnecessarily
b) if the same query has multiple filter queries that are very selective I
noticed a big performance disabling cache
c) I'd like to spare developers from deciding what has to be cached or not

the question:
-Is there anything already working to solve those problems?

what do you think about this?
-I was thinking to write a plugin to recognize query types with regular
exception and let solr admins associate a caching behaviour with each query
type
-another idea was to
   -by default set fq caching off
   -keep statistics about fq
   -enable caching only for the N fq with highest hit ratio

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message