[ https://issues.apache.org/jira/browse/SQOOP-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598569#comment-16598569
]
Fero Szabo commented on SQOOP-2331:
-----------------------------------
Hi [~standon],
Sorry, I didn't have time to have a closer look at this and I'm not too familiar with HCat.
Anyway, if I understand you correctly, it's not clear how to verify whether the right compression
was used in hcat, right?
This forum topic might help us out here:
[https://community.hortonworks.com/questions/46381/how-to-validate-which-compression-technique-has-be.html]
One of the replies mentions that the compression of a hive table can be checked with the describe
command... I'm not sure if it works, but worth a try. (You could then execute this hive command
from Java.)
> Snappy Compression Support in Sqoop-HCatalog
> --------------------------------------------
>
> Key: SQOOP-2331
> URL: https://issues.apache.org/jira/browse/SQOOP-2331
> Project: Sqoop
> Issue Type: New Feature
> Affects Versions: 1.4.7
> Reporter: Atul Gupta
> Assignee: Shashank
> Priority: Major
> Fix For: 1.5.0
>
> Attachments: SQOOP-2331_0.patch, SQOOP-2331_1.patch, SQOOP-2331_2.patch, SQOOP-2331_2.patch,
SQOOP-2331_3.patch
>
>
> Current Apache Sqoop 1.4.7 does not compress in gzip format with
> --compress option while using with --hcatalog-table option. It also does not support
option --compression-codec snappy with --hcatalog-table option. it would be nice if we add
both the options in the Sqoop future releases.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
|