hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chang Chen <baibaic...@gmail.com>
Subject Compaction queue size constantly increase.
Date Mon, 03 Aug 2015 12:18:02 GMT
Hi All

We use HBase, and find a very strange issue which looks
like CompactSplitThread is waiting for something!  The following logs are
from problematic RegionServer:

2015-07-29 10:15:39,702 INFO
org.apache.hadoop.hbase.regionserver.CompactSplitThread: Completed
compaction: Request =
storeName=usr, fileCount=3, fileSize=2.4 M, priority=12,
time=21663559757818028; duration=0sec

2015-07-29 19:37:38,566 INFO
org.apache.hadoop.hbase.regionserver.CompactSplitThread: Aborted
compaction: Request =
storeName=cat, fileCount=3, fileSize=55.2 M (31.6 M, 11.5 M, 12.1 M),
priority=12, time=21697278778022407; duration=0sec

Between 10:15 and 19:37, I didn't find any logs generated by
CompactSplitThread, and we restarted HBase cluster at time of 19:37. The
waiting of compaction thread made compaction queue size constantly
increase, and eventually slow down HTable.get

Our major and minor compaction thread are set to 1, and I guess
CompactSplitThread may be blocked in selectCompaction, since the aborted
compaction only spent 0 seconds!

Is there any clue which can help me to find more information?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message