sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-428) AvroOutputFormat doesn't support compression even though documentation claims it does
Date Sat, 04 Feb 2012 22:03:54 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200569#comment-13200569
] 

Hudson commented on SQOOP-428:
------------------------------

Integrated in Sqoop-ant-jdk-1.6 #84 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6/84/])
    SQOOP-428. AvroOutputFormat doesn't support compression even though documentation claims
it does

(Lars Francke via Jarek Jarcec Cecho)

jarcec : http://svn.apache.org/viewvc/?view=rev&rev=1240613
Files : 
* /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/io/CodecMap.java
* /incubator/sqoop/trunk/src/java/org/apache/sqoop/io/CodecMap.java
* /incubator/sqoop/trunk/src/java/org/apache/sqoop/mapreduce/AvroJob.java
* /incubator/sqoop/trunk/src/java/org/apache/sqoop/mapreduce/AvroOutputFormat.java
* /incubator/sqoop/trunk/src/java/org/apache/sqoop/mapreduce/ImportJobBase.java
* /incubator/sqoop/trunk/src/test/com/cloudera/sqoop/TestAvroImport.java
* /incubator/sqoop/trunk/src/test/com/cloudera/sqoop/io/TestCodecMap.java

                
> AvroOutputFormat doesn't support compression even though documentation claims it does
> -------------------------------------------------------------------------------------
>
>                 Key: SQOOP-428
>                 URL: https://issues.apache.org/jira/browse/SQOOP-428
>             Project: Sqoop
>          Issue Type: Bug
>          Components: docs
>    Affects Versions: 1.4.0-incubating
>            Reporter: Lars Francke
>            Assignee: Lars Francke
>            Priority: Minor
>              Labels: avro, document
>             Fix For: 1.4.1-incubating
>
>         Attachments: SQOOP-428.1.patch, SQOOP-428.2.patch, SQOOP-428.3.patch, SQOOP-428.4.patch,
TEST-com.cloudera.sqoop.TestAvroImport.txt
>
>
> The documentation claims that Avro files can be compressed as well:
> {quote}
> By default, data is not compressed. You can compress your data by using the deflate (gzip)
algorithm with the -z or --compress argument, or specify any Hadoop compression codec using
the --compression-codec argument. This applies to SequenceFile, text, and Avro files.
> {quote}
> This is not true as the AvroOutputFormat currently doesn't support compression.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message