hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vladrodio...@gmail.com>
Subject Re: dfs.block.size recommendations for HBase
Date Wed, 01 Jun 2016 18:21:58 GMT
>>  Does
>> the datanode need to read that entire block when HBase tries to fetch
data
>> from it?

No.

-Vlad


On Wed, Jun 1, 2016 at 8:51 AM, Bryan Beaudreault <bbeaudreault@hubspot.com>
wrote:

> Hello,
>
> There is very little information that I can find online with regards to
> recommended dfs.block.size setting for HBase. Often it conflates with the
> HBase blocksize, which we know should be smaller.  Any chance we can get
> some recommendations for dfs.block.size?
>
> The default shipped with HDFS in later versions of CDH is 128mb. In highly
> random-read online database scenarios, should we be tuning that lower? Does
> the datanode need to read that entire block when HBase tries to fetch data
> from it? It seems hard to believe that the default block size would be good
> for HBase, considering how different it is from other hadoop workloads.
>
> Thanks!
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message