hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Hood <tom.w.h...@gmail.com>
Subject HFileOutputFormat2.configureIncrementalLoad and HREGION_MAX_FILESIZE
Date Fri, 23 Jan 2015 18:15:36 GMT

I'm bulkloading into an empty hbase table and have called
HTableDescriptor.setMaxFileSize to override the global setting of
HConstants.HREGION_MAX_FILESIZE (i.e. hbase.hregion.max.filesize).

This newly configured table is then passed to
HFileOutputFormat2.configureIncrementalLoad to setup the MR job to generate
the hfiles.  This already configures other properties based on the settings
of the table it's given (e.g. compression, bloom, data encoding, splits,
etc).  Is there a reason it does not also configure the
HREGION_MAX_FILESIZE based on its setting from

-- Tom

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message