sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3368) Add fail-fast scenarios to S3 incremental import use cases without --temporary-rootdir option
Date Fri, 31 Aug 2018 07:35:00 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598369#comment-16598369
] 

ASF subversion and git services commented on SQOOP-3368:
--------------------------------------------------------

Commit 6fa45a95a41f80778338cd2a2bb13418b2c37376 in sqoop's branch refs/heads/trunk from [~BoglarkaEgyed]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=6fa45a9 ]

SQOOP-3368: Add fail-fast scenarios to S3 incremental import use cases without --temporary-rootdir
option

(Boglarka Egyed)


> Add fail-fast scenarios to S3 incremental import use cases without --temporary-rootdir
option
> ---------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-3368
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3368
>             Project: Sqoop
>          Issue Type: Sub-task
>    Affects Versions: 1.4.7
>            Reporter: Boglarka Egyed
>            Assignee: Boglarka Egyed
>            Priority: Major
>         Attachments: SQOOP-3368.patch, SQOOP-3368.patch, SQOOP-3368.patch
>
>
> The current implementation of Sqoop handles HDFS as a default filesystem, i.e. it creates
temporary directories on HDFS in case of incremental append or merge imports. To make these
incremental import use cases work with S3 the user needs to set the {{--temporary-rootdir}}
to an S3 location properly.
> There should be fail-fast scenarios without the {{--temporary-rootdir}} option.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message