lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Miller <markrmil...@gmail.com>
Subject Re: Solr 4.2 - Slave Index version is higher than Master
Date Fri, 22 Mar 2013 20:31:26 GMT
That was to you Phil.

So it seems this is a problem with the configuration replication case I would guess - I didn't
really look at that path in the 4.2 fixes I worked on.

I did add it to the new testing I'm doing since I've suspected it (it will prompt a core reload
that doesn't happen when configs don't replicate). I'll see what I can do to try and get a
test to catch it.

- mark

On Mar 22, 2013, at 1:49 PM, Mark Miller <markrmiller@gmail.com> wrote:

> And your also on 4.2?
> 
> - Mark
> 
> On Mar 22, 2013, at 12:41 PM, Uomesh <Uomesh@gmail.com> wrote:
> 
>> Also, I am replicating only on commit and startup.
>> 
>> Thanks,
>> Umesh
>> 
>> On Fri, Mar 22, 2013 at 11:23 AM, Umesh Sharma <uomesh@gmail.com> wrote:
>> 
>>> Hi Mrk,
>>> 
>>> I am replicating below config files but not replicating solrconfig.xml.
>>> 
>>> confFiles: schema.xml, elevate.xml, stopwords.txt,
>>> mapping-FoldToASCII.txt, mapping-ISOLatin1Accent.txt, protwords.txt,
>>> spellings.txt, synonyms.txt
>>> 
>>> 
>>> also strange I am seeing big Gen difference between Master and slave. My
>>> master slave is 2 while Slave is 56. If i do the full import then the Gen
>>> is getting higher then slave one and its replicating. i have more than 30
>>> cores on my solr instance and all are scheduled to replicate on same time.
>>> 
>>> Index Version Gen Size Master:
>>> 1363903243590
>>> 2
>>> 94 bytes
>>> Slave:
>>> 1363967579193
>>> 56
>>> 94 bytes
>>> 
>>> Thanks,
>>> Umesh
>>> 
>>> 
>>> On Fri, Mar 22, 2013 at 10:42 AM, Mark Miller-3 [via Lucene] <
>>> ml-node+s472066n4050075h49@n3.nabble.com> wrote:
>>> 
>>>> Are you replicating configuration files as well?
>>>> 
>>>> - Mark
>>>> 
>>>> On Mar 22, 2013, at 6:38 AM, "John, Phil (CSS)" <[hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=0>>
>>>> wrote:
>>>> 
>>>>> To add to the discussion.
>>>>> 
>>>>> We're running classic master/slave replication (not solrcloud) with 1
>>>> master and 2 slaves and I noticed the slave having a higher version number
>>>> than the master the other day as well.
>>>>> 
>>>>> In our case, knock on wood, it hasn't stopped replication.
>>>>> 
>>>>> If you'd like a copy of our config I can provide off-list.
>>>>> 
>>>>> Regards,
>>>>> 
>>>>> Phil.
>>>>> 
>>>>> ________________________________
>>>>> 
>>>>> From: Mark Miller [mailto:[hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=1>]
>>>> 
>>>>> Sent: Fri 22/03/2013 06:32
>>>>> To: [hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=2>
>>>>> Subject: Re: Solr 4.2 - Slave Index version is higher than Master
>>>>> 
>>>>> 
>>>>> 
>>>>> The other odd thing here is that this should not stop replication at
>>>> all. When the slave is ahead, it will still have it's index replaced.
>>>>> 
>>>>> - Mark
>>>>> 
>>>>> On Mar 22, 2013, at 1:26 AM, Mark Miller <[hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=3>>
>>>> wrote:
>>>>> 
>>>>>> I'm working on testing to try and catch what you are seeing here:
>>>> https://issues.apache.org/jira/browse/SOLR-4629
>>>>>> 
>>>>>> - Mark
>>>>>> 
>>>>>> On Mar 22, 2013, at 12:23 AM, Mark Miller <[hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=4>>
>>>> wrote:
>>>>>> 
>>>>>>> Let me know if there is anything else you can add.
>>>>>>> 
>>>>>>> A test with your setup that index n docs randomly, commits, randomly
>>>> updates a conf file or not, and then replicates and repeats x times does
>>>> not seem to fail, even with very high values for n and x. On every
>>>> replication, the versions are compared.
>>>>>>> 
>>>>>>> Is there anything else you are putting into this mix?
>>>>>>> 
>>>>>>> - Mark
>>>>>>> 
>>>>>>> On Mar 21, 2013, at 11:28 PM, Uomesh <[hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=5>>
>>>> wrote:
>>>>>>> 
>>>>>>>> Thank you!!,
>>>>>>>> 
>>>>>>>> Attached is my master solrconfig.xml. I have few custom handlers
>>>> which you
>>>>>>>> might need to remove. In custom handler i have not much code
just
>>>> adding
>>>>>>>> some custom data for UI.
>>>>>>>> 
>>>>>>>> Thanks,
>>>>>>>> Umesh
>>>>>>>> 
>>>>>>>> On Thu, Mar 21, 2013 at 9:59 PM, Mark Miller-3 [via Lucene]
>>>>>>>> <[hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=6>
>>>>>>>> mible.com <[hidden email]<http://user/SendEmail.jtp?type=node&node=4050075&i=7>>>
>>>> wrote:
>>>>>>>> 
>>>>>>>>> Could you attach the master as well?
>>>>>>>>> 
>>>>>>>>> - Mark
>>>>>>>>> 
>>>>>>>>> On Mar 21, 2013, at 4:36 PM, Uomesh <[hidden email]<
>>>> http://user/SendEmail.jtp?type=node&node=4049933&i=0>>
>>>>>>>>> wrote:
>>>>>>>>> 
>>>>>>>>>> Hi Mark,
>>>>>>>>>> 
>>>>>>>>>> Attached is my solrconfig_slave.xml. My replication
interval is 1
>>>>>>>>>> minute(default).
>>>>>>>>>> 
>>>>>>>>>> Please let me know if you need any more config details
>>>>>>>>>> 
>>>>>>>>>> Thanks,
>>>>>>>>>> umesh
>>>>>>>>>> 
>>>>>>>>>> On Thu, Mar 21, 2013 at 3:19 PM, Mark Miller-3 [via
Lucene] <
>>>>>>>>>> [hidden email] <
>>>> http://user/SendEmail.jtp?type=node&node=4049933&i=1>>
>>>>>>>>> wrote:
>>>>>>>>>> 
>>>>>>>>>>> Can you give more details about your configuration
and setup?
>>>>>>>>>>> 
>>>>>>>>>>> Our best bet is to try and recreate this with
a unit test.
>>>>>>>>>>> 
>>>>>>>>>>> - Mark
>>>>>>>>>>> 
>>>>>>>>>>> On Mar 21, 2013, at 4:08 PM, Uomesh <[hidden
email]<
>>>>>>>>> http://user/SendEmail.jtp?type=node&node=4049832&i=0>>
>>>>>>>>>>> wrote:
>>>>>>>>>>> 
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> 
>>>>>>>>>>>> I am seeing an issue after upgrading from
solr 3.6.2 to Solr
>>>> 4.2. My
>>>>>>>>>>> Slave
>>>>>>>>>>>> stop replicating after sometime. And it seems
issue is because
>>>> of my
>>>>>>>>>>> Slave
>>>>>>>>>>>> Index version is higher than master. How
could it be possible to
>>>> Slave
>>>>>>>>>>> Index
>>>>>>>>>>>> version is higher than master? Please help
me. IS there anything
>>>> i
>>>>>>>>> need
>>>>>>>>>>> to
>>>>>>>>>>>> remove from my slave solrconfig.xml.
>>>>>>>>>>>> 
>>>>>>>>>>>> Index Version Gen Size
>>>>>>>>>>>> Master: 1363893820575 93 8.75 MB
>>>>>>>>>>>> Slave: 1363896006624 94 8.75 MB
>>>>>>>>>>>> 
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Umesh
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> 
>>>>>>>>>>>> --
>>>>>>>>>>>> View this message in context:
>>>>>>>>>>> 
>>>>>>>>> 
>>>> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827.html
>>>>>>>>>>>> Sent from the Solr - User mailing list archive
at Nabble.com.
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>>> ------------------------------
>>>>>>>>>>> If you reply to this email, your message will
be added to the
>>>>>>>>> discussion
>>>>>>>>>>> below:
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>> 
>>>> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049832.html
>>>>>>>>>>> To unsubscribe from Solr 4.2 - Slave Index version
is higher than
>>>>>>>>> Master, click
>>>>>>>>>>> here<
>>>>>>>>>>> .
>>>>>>>>>>> NAML<
>>>>>>>>> 
>>>> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>>> 
>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> solrconfig_slave.xml (67K) <
>>>>>>>>> 
>>>> http://lucene.472066.n3.nabble.com/attachment/4049840/0/solrconfig_slave.xml>
>>>> 
>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> --
>>>>>>>>>> View this message in context:
>>>>>>>>> 
>>>> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049840.html
>>>>>>>>> 
>>>>>>>>>> Sent from the Solr - User mailing list archive at
Nabble.com.
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> ------------------------------
>>>>>>>>> If you reply to this email, your message will be added
to the
>>>> discussion
>>>>>>>>> below:
>>>>>>>>> 
>>>>>>>>> 
>>>> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049933.html
>>>>>>>>> To unsubscribe from Solr 4.2 - Slave Index version is
higher than
>>>> Master, click
>>>>>>>>> here<
>>>>>>>>> .
>>>>>>>>> NAML<
>>>> http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> solrconfig.xml (74K) <
>>>> http://lucene.472066.n3.nabble.com/attachment/4049934/0/solrconfig.xml>
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> --
>>>>>>>> View this message in context:
>>>> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4049934.html
>>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>>> 
>>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> 
>>>> ------------------------------
>>>> If you reply to this email, your message will be added to the
>>>> discussion below:
>>>> 
>>>> http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4050075.html
>>>> To unsubscribe from Solr 4.2 - Slave Index version is higher than
>>>> Master, click here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4049827&code=VW9tZXNoQGdtYWlsLmNvbXw0MDQ5ODI3fDIyODkyODYxMg==>
>>>> .
>>>> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>>> 
>>> 
>>> 
>> 
>> 
>> 
>> 
>> --
>> View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-2-Slave-Index-version-is-higher-than-Master-tp4049827p4050463.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
> 


Mime
View raw message