lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shalin Shekhar Mangar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SOLR-7129) CloudSolrClient can put excessive load on ZooKeeper for collections with stateFormat=2
Date Thu, 19 Feb 2015 19:35:13 GMT
Shalin Shekhar Mangar created SOLR-7129:
-------------------------------------------

             Summary: CloudSolrClient can put excessive load on ZooKeeper for collections
with stateFormat=2
                 Key: SOLR-7129
                 URL: https://issues.apache.org/jira/browse/SOLR-7129
             Project: Solr
          Issue Type: Bug
          Components: SolrCloud, SolrJ
    Affects Versions: 5.0
            Reporter: Shalin Shekhar Mangar
             Fix For: Trunk, 5.1


Each stale state response from the server causes CloudSolrClient to evict the requested collection
from the local cache. At this point, the request is retried and the latest collection state
is fetched live from ZooKeeper. There is nothing preventing multiple request threads to simultaneously
hit ZooKeeper and cause a thundering herd effect.

We must not only synchronise such refreshes but also use the past and current znode version
of the cluster state to make sure that redundant fetches from ZooKeeper are never possible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message