sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szabolcs Vasas (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SQOOP-2943) Make sqoop able to import to Parquet file format in case of HDFS encryption zones are turned on
Date Wed, 07 Nov 2018 09:23:00 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Szabolcs Vasas resolved SQOOP-2943.
-----------------------------------
    Resolution: Duplicate

Resolving this as this issue is solved by https://issues.apache.org/jira/browse/SQOOP-3313

> Make sqoop able to import to Parquet file format in case of HDFS encryption zones are
turned on
> -----------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-2943
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2943
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.7
>            Reporter: Attila Szabo
>            Priority: Major
>             Fix For: 1.5.0
>
>
> If HDFS encryption zones are turned on, and the user tries to import into Parquet format,
where the target location is in a very different encryption zone, than the zone of the /tmp/
location (typical use case for that encrypted hive warehouse directory), even the mapper jobs
are executed successfully, and the partial results stored on the temp storage correctly, the
MergeOutputMapper class of Kite SDK dies with an HDFS related exception ("can't be moved into
an encryption zone").
> The problem does not appear in case of clear text output formats.
> Please make Sqoop able to solve this scenario as well!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message