hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vladrodio...@gmail.com>
Subject Re: Should Taking A Snapshot Work Even If Balancer Is Moving A Few Regions Around?
Date Wed, 21 Mar 2018 18:33:40 GMT
>>So my question is whether taking a snapshot is supposed to work even with
>>regions being moved around. In our case it is usually only a couple here
>>and there.

No, if region was moved, split or merged during snapshot operation -
snapshot will fail.
This is why taking snapshots on a large table is a 50/50 game.

Disabling balancer,region merging and split before snapshot should help.
This works in 2.0

Not sure if merge/split switch is available in 1.4

-Vlad

On Tue, Mar 20, 2018 at 8:00 PM, Saad Mufti <saad.mufti@gmail.com> wrote:

> Hi,
>
> We are using HBase 1.4.0 on AWS EMR based Hbase. Since snapshots are in S3,
> they take much longer than when using local disk. We have a cron script to
> take regular snapshots as backup, and they fail quite often on our largest
> table which takes close to an hour to complete the snapshot.
>
> The only thing I have noticed in the errors usually is a message about the
> region moving or closing.
>
> So my question is whether taking a snapshot is supposed to work even with
> regions being moved around. In our case it is usually only a couple here
> and there.
>
> Thanks.
>
> ----
> Saad
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message