hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: MapReduce: Reducers partitions.
Date Thu, 11 Apr 2013 00:33:03 GMT
On Wed, Apr 10, 2013 at 12:01 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Hi Greame,
> No. The reducer will simply write on the table the same way you are doing a
> regular Put. If a split is required because of the size, then the region
> will be split, but at the end, there will not necessary be any region
> split.
> In the usecase described below, all the 600 lines will "simply" go into the
> only region in the table and no split will occur.
> The goal is to partition the data for the reducer only. Not in the table.

Then just use the default partitioner?

The suggestion that you use HTablePartitioner seems inappropriate to your
task.  See the sink doc here:


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message