sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jarek Jarcec Cecho (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-2880) Provide argument for overriding temporary directory
Date Tue, 08 Mar 2016 22:54:40 GMT
Jarek Jarcec Cecho created SQOOP-2880:

             Summary: Provide argument for overriding temporary directory
                 Key: SQOOP-2880
                 URL: https://issues.apache.org/jira/browse/SQOOP-2880
             Project: Sqoop
          Issue Type: Bug
    Affects Versions: 1.4.6
            Reporter: Jarek Jarcec Cecho
            Assignee: Jarek Jarcec Cecho

Several types of imports (incremental, hive, ...) might require import into temporary directory
first. We're currently putting the temporary directory into [{{_sqoop}}|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/util/AppendUtils.java#L42]
and we're allowing user to override it with {{sqoop.test.import.rootDir}}. However this property
is not documented anywhere and I found people confused about it as it contains the string
{{test}} which is really confusing. The most concerning thing is that as the properties are
not persisted in metastore, this option won't work for stored jobs at all. Hence I would like
to propose a first class argument to handle the temporary directory (e.g. something like {{--temporary-directory}}).

This message was sent by Atlassian JIRA

View raw message