hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Busbey <bus...@apache.org>
Subject Re: Query for OldWals and use of WAl for Hbase indexer
Date Thu, 12 Jul 2018 15:19:28 GMT
On Wed, Jul 11, 2018 at 7:19 PM, Manjeet Singh
<manjeet.chandhok@gmail.com> wrote:
> I have one more question
> If solr is having its own data mean its maintaining data in their shards
> and hbase is maintaining in data folder... Why still oldWals need?

Once the HBase replication system is active and there's a peer (even a
disabled peer) it starts retaining WALs until they have been
successfully acknowledged by all peer clusters. Since the Lily Indexer
for HBase makes use of the replication system to get an stream of
edits, the WALs will stick around until the indexer has said it saw
the edits in them.

View raw message