sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Attila Szabo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2880) Provide argument for overriding temporary directory
Date Tue, 08 Mar 2016 22:55:40 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186022#comment-15186022

Attila Szabo commented on SQOOP-2880:

Hi Jarcec,

May I take over this JIRA, and implement it?


> Provide argument for overriding temporary directory
> ---------------------------------------------------
>                 Key: SQOOP-2880
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2880
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.6
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
> Several types of imports (incremental, hive, ...) might require import into temporary
directory first. We're currently putting the temporary directory into [{{_sqoop}}|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/util/AppendUtils.java#L42]
and we're allowing user to override it with {{sqoop.test.import.rootDir}}. However this property
is not documented anywhere and I found people confused about it as it contains the string
{{test}} which is really confusing. The most concerning thing is that as the properties are
not persisted in metastore, this option won't work for stored jobs at all. Hence I would like
to propose a first class argument to handle the temporary directory (e.g. something like {{--temporary-directory}}).

This message was sent by Atlassian JIRA

View raw message