hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsuyoshi OZAWA (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-9187) FileUtil.CopyMerge should handle compressed input and output
Date Mon, 01 Sep 2014 02:48:20 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Tsuyoshi OZAWA updated HADOOP-9187:
    Attachment: HADOOP-9187.2.patch

Updated a patch to add javadocs and handle exceptions correctly.

> FileUtil.CopyMerge should handle compressed input and output
> ------------------------------------------------------------
>                 Key: HADOOP-9187
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9187
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 2.3.0
>            Reporter: Ranadip
>            Assignee: Tsuyoshi OZAWA
>         Attachments: HADOOP-9187.1.patch, HADOOP-9187.2.patch
> This method, if run on compressed input, results in corrupt output since it just does
a byte-by-byte concatenation disregarding compression codecs. It should automatically detect
compression codecs from input files and handle them intelligently. 
> Additionally, there should be an option to create a compressed output file so that the
output can be efficiently stored and sent out to customers (over the network outside the cluster).

This message was sent by Atlassian JIRA

View raw message