lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (SOLR-9236) AutoAddReplicas feature with one replica loses some documents not committed during failover
Date Thu, 07 Jul 2016 13:39:11 GMT


ASF subversion and git services commented on SOLR-9236:

Commit 546093812c34610075ee130f7466eca1979cfbeb in lucene-solr's branch refs/heads/master
from markrmiller
[;h=5460938 ]

SOLR-9236: AutoAddReplicas will append an extra /tlog to the update log location on replica

> AutoAddReplicas feature with one replica loses some documents not committed during failover
> -------------------------------------------------------------------------------------------
>                 Key: SOLR-9236
>                 URL:
>             Project: Solr
>          Issue Type: Bug
>          Components: hdfs, SolrCloud
>            Reporter: Eungsop Yoo
>            Assignee: Mark Miller
>            Priority: Minor
>         Attachments: SOLR-9236.patch, SOLR-9236.patch
> I need to index huge amount of logs, so I decide to use AutoAddReplica feature with only
one replica.
> When using AutoAddReplicas with one replica, some benefits are expected.
> - no redundant data files for replicas
> -- saving disk usage
> - best indexing performance 
> I expected that Solr fails over just like HBase.
> The feature worked almost as it was expected, except for some missing documents during
> I found two regions for the missing.
> 1. The leader replica does not replay any transaction logs. But when there is only one
replica, it should be the leader.
> So I made the leader replica replay the transaction logs when using AutoAddReplicas with
on replica.
> But the above fix did not resolve the problem.
> 2. As failover occurred, the transaction log directory had a deeper directory depth.
Just like this, tlog/tlog/tlog/...
> The transaction log could not be replayed, because the transaction log directory was
changed during failover. 
> So I made the transaction log directory not changed during failover.
> After these fixes, AutoAddReplicas with one replica fails over well without losing any

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message