sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fero Szabo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2331) Snappy Compression Support in Sqoop-HCatalog
Date Fri, 31 Aug 2018 10:47:00 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598569#comment-16598569
] 

Fero Szabo commented on SQOOP-2331:
-----------------------------------

Hi [~standon],

Sorry, I didn't have time to have a closer look at this and I'm not too familiar with HCat.
Anyway, if I understand you correctly, it's not clear how to verify whether the right compression
was used in hcat, right?

This forum topic might help us out here:

[https://community.hortonworks.com/questions/46381/how-to-validate-which-compression-technique-has-be.html]

One of the replies mentions that the compression of a hive table can be checked with the describe
command... I'm not sure if it works, but worth a try. (You could then execute this hive command
from Java.)

> Snappy Compression Support in Sqoop-HCatalog
> --------------------------------------------
>
>                 Key: SQOOP-2331
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2331
>             Project: Sqoop
>          Issue Type: New Feature
>    Affects Versions: 1.4.7
>            Reporter: Atul Gupta
>            Assignee: Shashank
>            Priority: Major
>             Fix For: 1.5.0
>
>         Attachments: SQOOP-2331_0.patch, SQOOP-2331_1.patch, SQOOP-2331_2.patch, SQOOP-2331_2.patch,
SQOOP-2331_3.patch
>
>
> Current Apache Sqoop 1.4.7 does not compress in gzip format with 
>  --compress option while using with --hcatalog-table option. It also does not support
option --compression-codec snappy with --hcatalog-table option. it would be nice if we add
both the options in the Sqoop future releases.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message