sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2880) Provide argument for overriding temporary directory
Date Mon, 14 Mar 2016 16:23:33 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15193563#comment-15193563
] 

ASF subversion and git services commented on SQOOP-2880:
--------------------------------------------------------

Commit a0b730c77e297a62909063289ef37a2b993ff5e1 in sqoop's branch refs/heads/trunk from [~jarcec]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=a0b730c ]

SQOOP-2880: Provide argument for overriding temporary directory

(Attila Szabo via Jarek Jarcec Cecho)


> Provide argument for overriding temporary directory
> ---------------------------------------------------
>
>                 Key: SQOOP-2880
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2880
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.6
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Attila Szabo
>             Fix For: 1.4.7
>
>         Attachments: SQOOP-2880.patch, SQOOP-2880_review_1.patch
>
>
> Several types of imports (incremental, hive, ...) might require import into temporary
directory first. We're currently putting the temporary directory into [{{_sqoop}}|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/util/AppendUtils.java#L42]
and we're allowing user to override it with {{sqoop.test.import.rootDir}}. However this property
is not documented anywhere and I found people confused about it as it contains the string
{{test}} which is really confusing. The most concerning thing is that as the properties are
not persisted in metastore, this option won't work for stored jobs at all. Hence I would like
to propose a first class argument to handle the temporary directory (e.g. something like {{--temporary-directory}}).




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message