sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-318) Add support for splittable lzo files with Hive
Date Tue, 23 Aug 2011 18:12:29 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089630#comment-13089630
] 

Hudson commented on SQOOP-318:
------------------------------

Integrated in Sqoop-jdk-1.6 #16 (See [https://builds.apache.org/job/Sqoop-jdk-1.6/16/])
    SQOOP-318. Support splittable LZO files with Hive.

(Joey Echeverria via Arvind Prabhakar)

arvind : http://svn.apache.org/viewvc/?view=rev&rev=1160815
Files : 
* /incubator/sqoop/trunk/src/docs/user/hive.txt
* /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/io/CodecMap.java
* /incubator/sqoop/trunk/src/test/com/cloudera/sqoop/hive/TestTableDefWriter.java
* /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/hive/TableDefWriter.java
* /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/hive/HiveImport.java


> Add support for splittable lzo files with Hive
> ----------------------------------------------
>
>                 Key: SQOOP-318
>                 URL: https://issues.apache.org/jira/browse/SQOOP-318
>             Project: Sqoop
>          Issue Type: Improvement
>          Components: hive-integration
>    Affects Versions: 1.3.0
>            Reporter: Joey Echeverria
>            Assignee: Joey Echeverria
>            Priority: Minor
>             Fix For: 1.4.0
>
>         Attachments: SQOOP-318-1.patch, SQOOP-318-2.patch
>
>
> When importing LZO compressed files into Hive, it would be useful to create the hive
table with the com.hadoop.mapred.DeprecatedLzoTextInputFormat. It would also be nice to automatically
run the DistributedIndexer so that the LZO files can be split.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message