crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <>
Subject [jira] [Commented] (CRUNCH-212) Need target wrapper for HFileOuptutFormat
Date Fri, 02 Aug 2013 06:45:48 GMT


Josh Wills commented on CRUNCH-212:

Chao-- this patch looks pretty sweet. I'm +1 to push it to master, with a minor nit-- there's
a Copyright line in the header of the HFileOutputFormatForCrunch class that should probably
be removed. Don't feel obliged to re-post the patch for it, just delete the line before you
do the commit.

Very, very cool-- thanks again, I'm looking forward to using this one on some of my upcoming
> Need target wrapper for HFileOuptutFormat
> -----------------------------------------
>                 Key: CRUNCH-212
>                 URL:
>             Project: Crunch
>          Issue Type: Improvement
>          Components: IO
>            Reporter: Chao Shi
>         Attachments: crunch-212-draft2.patch, crunch-212-draft.patch, crunch-212-v0.patch,
> I need to import data to hbase from MR. I found HFileOutputFormat is ~5x more efficient
than HTableOutputFormat. So maybe we need a target wrapper for it.
> Future more, is it possible to call HBase to load it automatically after HFiles are generated?

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message