sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Attila Szabo (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-2880) Provide argument for overriding temporary directory
Date Fri, 11 Mar 2016 18:05:39 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Attila Szabo updated SQOOP-2880:
--------------------------------
    Attachment: SQOOP-2880.patch

The implemented changes. Please review it.

> Provide argument for overriding temporary directory
> ---------------------------------------------------
>
>                 Key: SQOOP-2880
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2880
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.6
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Attila Szabo
>         Attachments: SQOOP-2880.patch
>
>
> Several types of imports (incremental, hive, ...) might require import into temporary
directory first. We're currently putting the temporary directory into [{{_sqoop}}|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/util/AppendUtils.java#L42]
and we're allowing user to override it with {{sqoop.test.import.rootDir}}. However this property
is not documented anywhere and I found people confused about it as it contains the string
{{test}} which is really confusing. The most concerning thing is that as the properties are
not persisted in metastore, this option won't work for stored jobs at all. Hence I would like
to propose a first class argument to handle the temporary directory (e.g. something like {{--temporary-directory}}).




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message