sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joey Echeverria (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-318) Add support for splittable lzo files with Hive
Date Fri, 19 Aug 2011 01:26:27 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Joey Echeverria updated SQOOP-318:
----------------------------------

    Attachment: SQOOP-318-1.patch

Here's my first cut at a patch. It includes a test for the create table syntax. I manually
tested calling the indexer. I'm not sure how to automate that without making LZO required
to build.

> Add support for splittable lzo files with Hive
> ----------------------------------------------
>
>                 Key: SQOOP-318
>                 URL: https://issues.apache.org/jira/browse/SQOOP-318
>             Project: Sqoop
>          Issue Type: Improvement
>          Components: hive-integration
>            Reporter: Joey Echeverria
>            Priority: Minor
>         Attachments: SQOOP-318-1.patch
>
>
> When importing LZO compressed files into Hive, it would be useful to create the hive
table with the com.hadoop.mapred.DeprecatedLzoTextInputFormat. It would also be nice to automatically
run the DistributedIndexer so that the LZO files can be split.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message