hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lars Francke <lars.fran...@gmail.com>
Subject Re: SimpleRegionNormalizer - Empty regions
Date Mon, 05 Aug 2019 07:34:22 GMT
Sure

<
https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/master/normalizer/SimpleRegionNormalizer.java
>
Added here: <
https://github.com/apache/hbase/commit/ca7a82fb5704af27459557168afc96e1193ac7cb#diff-a12e10a526f1891fd635295123a51ec5
>

"Region sizes are coarse and approximate on the order of megabytes.
Additionally, "empty" regions (less than 1MB, with the previous note) are
not merged away. This is by design to prevent normalization from undoing
the pre-splitting of a table."

Cheers,
Lars

On Mon, Aug 5, 2019 at 9:43 AM OpenInx <openinx@gmail.com> wrote:

> > the docs for the SimpleRegionNormalizer say that empty regions are not
> merged.
>
> Which docs you mean ? Please provide it if you have the link, I've checked
> the code it would merge two
> empty regions if the merging condition fit.
>
> Thanks.
>
>
> On Mon, Aug 5, 2019 at 2:10 PM Lars Francke <lars.francke@gmail.com>
> wrote:
>
> > Hi,
> >
> > the docs for the SimpleRegionNormalizer say that empty regions are not
> > merged.
> > Looking at the code I don't see anything that actually filters out empty
> > regions though.
> >
> > And I have logs here:
> > 2019-05-04 01:17:03,892 INFO
> > org.apache.hadoop.hbase.master.normalizer.SimpleRegionNormalizer: Table
> > XXX, small region size: 0 plus its neighbor size: 0, less than the avg
> size
> > 5068.338632750398, merging them
> >
> > This is CDH 5.11 so it's a bit older but it already includes the
> > documentation and I don't see anything in current master branch either.
> >
> > Am I missing something obvious?
> >
> > Cheers,
> > Lars
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message