hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangyongqiang0617@163.com" <wangyongqiang0...@163.com>
Subject Re: Re: question on hfile size upper limit
Date Thu, 20 Jun 2019 06:08:27 GMT
this conf: 
  <property>
    <name>hbase.hregion.max.filesize</name>
    <value>10737418240</value>
    <description>
    Maximum HStoreFile size. If any one of a column families' HStoreFiles has
    grown to exceed this value, the hosting HRegion is split in two.</description>
  </property>





wangyongqiang0617@163.com
 
From: Jean-Marc Spaggiari
Date: 2019-06-19 06:52
To: user
Subject: Re: question on hfile size upper limit
Hi,
 
Can you please confirm which parameter you are talking about? The default
HBase setting is to limit the size per region (10GB by default), and not by
HFiles. This can be configured at the HBase lever, or at the table level.
 
HTH,
 
JMS
 
Le mar. 18 juin 2019 à 11:32, wangyongqiang0617@163.com <
wangyongqiang0617@163.com> a écrit :
 
> we set size upper limit for hfile, but not region
> so region has different actural size, leading to some analysis task has
> different input size
>
> can we set size limit on region
>
>
>
>
> wangyongqiang0617@163.com
>
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message