hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wellington Chevreuil <wellington.chevre...@gmail.com>
Subject Re: Throttle major compaction for version 1.1.2
Date Thu, 24 Jan 2019 04:17:03 GMT
I can see in branch 1.1 that CompactSplitThread does load a
CompactionThroughputController here [1], and it's possible to set
PressureAwareCompactionThroughputController [2] on
"hbase.regionserver.throughput.controller" property.
PressureAwareCompactionThroughputController defines additional
configurations to control, eventually slowing down, compaction throughput.

HStore also considers offpeak hours when creating the compaction request
[3]. Offpeak configurations then available would be
"hbase.offpeak.end.hour" and "hbase.offpeak.start.hour".

[1]
https://github.com/apache/hbase/blob/branch-1.1/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplitThread.java#L162
[2]
https://github.com/apache/hbase/blob/branch-1.1/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/PressureAwareCompactionThroughputController.java
[3]
https://github.com/apache/hbase/blob/branch-1.1/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L1577

Em ter, 22 de jan de 2019 às 04:28, Abhishek Gupta <abhilater@gmail.com>
escreveu:

> We are seeing frequent long GC pause whenever major compaction gets
> triggered on region servers.
> I wanted to know how to throttle major compaction on HBase 1.1.2.
>
> I see a number of throttling parameters added on versions 1.2+ including
> offpeak hours params, what are the options for HBase 1.1.2
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message