hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tianying Chang <tych...@gmail.com>
Subject WALPlayer kills many RS when play large number of WALs
Date Tue, 22 Jul 2014 15:15:52 GMT

I was running WALPlayer that output HFile for future bulkload. There are
6200 hlogs, and the total size is about 400G.

The mapreduce job finished. But I saw two bad things:
1. More than half of RS died. I checked the syslog, it seems they are
killed by OOM. They also have very high CPU spike for the whole time during

cpu user usage of 84.4% matches resource limit [cpu user usage>70.0%]

2. Mapreduce job also has failure of Java heap Space error. My job set the
heap usage as 2G,
Does this mean WALPlayer cannot support this load on this kind of setting?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message