hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Where to place logs
Date Wed, 26 Dec 2012 21:13:46 GMT
On Mon, Dec 24, 2012 at 9:27 AM, Varun Sharma <varun@pinterest.com> wrote:

> Hi,
> I am wondering where people usually place hbase + hadoop logs. I have 4
> disks and 1 very tiny disk with barely 500 megs (thats the typical setup on
> amazon ec2). The 4 disks shall be used for hbase data. Since 500M is too
> small, should I place logs on one of the 4 disks. Could it potentially
> steal IOP(s) from hbase ? Does anyone have an idea how much of an overhead
> logging really is ?

Looks like you have no choice but to put your logging on a data disk.
 Logging can be expensive, yes.  It should be easy enough to measure in
your setup.  You can disable all logging for a short period while the
cluster is under load; do it on a single node even (you can do this from
the UI).  See how your io changes when logging is off.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message