sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3368) Add fail-fast scenarios to S3 incremental import use cases without --temporary-rootdir option
Date Fri, 31 Aug 2018 08:35:00 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598421#comment-16598421
] 

Hudson commented on SQOOP-3368:
-------------------------------

SUCCESS: Integrated in Jenkins build Sqoop-hadoop200 #1204 (See [https://builds.apache.org/job/Sqoop-hadoop200/1204/])
SQOOP-3368: Add fail-fast scenarios to S3 incremental import use cases (bogi: [https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=6fa45a95a41f80778338cd2a2bb13418b2c37376])
* (add) src/test/org/apache/sqoop/tool/TestS3IncrementalImportOptionValidations.java
* (edit) src/java/org/apache/sqoop/tool/ImportTool.java


> Add fail-fast scenarios to S3 incremental import use cases without --temporary-rootdir
option
> ---------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-3368
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3368
>             Project: Sqoop
>          Issue Type: Sub-task
>    Affects Versions: 1.4.7
>            Reporter: Boglarka Egyed
>            Assignee: Boglarka Egyed
>            Priority: Major
>         Attachments: SQOOP-3368.patch, SQOOP-3368.patch, SQOOP-3368.patch
>
>
> The current implementation of Sqoop handles HDFS as a default filesystem, i.e. it creates
temporary directories on HDFS in case of incremental append or merge imports. To make these
incremental import use cases work with S3 the user needs to set the {{--temporary-rootdir}}
to an S3 location properly.
> There should be fail-fast scenarios without the {{--temporary-rootdir}} option.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message