lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shalin Shekhar Mangar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-6554) Speed up overseer operations for collections with stateFormat > 1
Date Sun, 30 Nov 2014 11:36:12 GMT

     [ https://issues.apache.org/jira/browse/SOLR-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shalin Shekhar Mangar updated SOLR-6554:
----------------------------------------
    Attachment: SOLR-6554-batching-refactor.patch

There was a bug in my last refactoring. We must have two different batching checks; one which
is checked before the current message is processed and the second which is checked after.
Otherwise there is no way to keep messages from different state formats from being batched
together.

> Speed up overseer operations for collections with stateFormat > 1
> -----------------------------------------------------------------
>
>                 Key: SOLR-6554
>                 URL: https://issues.apache.org/jira/browse/SOLR-6554
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>    Affects Versions: 5.0, Trunk
>            Reporter: Shalin Shekhar Mangar
>         Attachments: SOLR-6554-batching-refactor.patch, SOLR-6554-batching-refactor.patch,
SOLR-6554.patch, SOLR-6554.patch, SOLR-6554.patch, SOLR-6554.patch, SOLR-6554.patch, SOLR-6554.patch,
SOLR-6554.patch, SOLR-6554.patch
>
>
> Right now (after SOLR-5473 was committed), a node watches a collection only if stateFormat=1
or if that node hosts at least one core belonging to that collection.
> This means that a node which is the overseer operates on all collections but watches
only a few. So any read goes directly to zookeeper which slows down overseer operations.
> Let's have the overseer node watch all collections always and never remove those watches
(except when the collection itself is deleted).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message