hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: multiple region servers at one machine
Date Thu, 17 Jul 2014 22:05:00 GMT
Have you considered using BucketCache ?

Please read 9.6.4.1 under
http://hbase.apache.org/book.html#regionserver.arch

Note: remember to verify the config values against the hbase release you're
using.

Cheers


On Thu, Jul 17, 2014 at 2:53 PM, Jane Tao <jiao.tao@oracle.com> wrote:

> Hi Ted,
>
> In my case, there is a 6 Node HBase cluster setup (running on Oracle BDA).
> Each node has plenty of RAM (64GB) and CPU cores. Several articles seem to
> suggest
> that it is not a good idea to allocate too much RAM to region server's
> heap setting.
>
> If each region server has 10GB heap and there is only one region server
> per node, then
> I have 10x6=60GB for the whole HBase. This setting is good for ~100M rows
> but starts
> to incur lots of GC activities on region servers when loading billions of
> rows.
>
> Basically, I need a configuration that can fully utilize the free RAM on
> each node for HBase.
>
> Thanks,
> Jane
> On 7/16/2014 4:17 PM, Ted Yu wrote:
>
>> Jane:
>> Can you briefly describe the use case where multiple region servers are
>> needed on the same host ?
>>
>> Cheers
>>
>>
>>
>> On Wed, Jul 16, 2014 at 3:14 PM, Dhaval Shah <prince_mithibai@yahoo.co.in
>> >
>> wrote:
>>
>>  Its certainly possible (atleast with command line) but probably very
>>> messy. You will need to have different ports, different log files,
>>> different pid files, possibly even different configs on the same machine.
>>>
>>>
>>> Regards,
>>> Dhaval
>>>
>>>
>>> ________________________________
>>>   From: Jane Tao <jiao.tao@oracle.com>
>>> To: user@hbase.apache.org
>>> Sent: Wednesday, 16 July 2014 6:06 PM
>>> Subject: multiple region servers at one machine
>>>
>>>
>>> Hi there,
>>>
>>> Is it possible to run multiple region servers at one machine/node? If
>>> this is possible, how to start multiple region servers with command
>>> lines or cloudera manager?
>>>
>>> Thanks,
>>> Jane
>>>
>>>
>>> --
>>>
>>
> --
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message