sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2525) Sqoop2: Add support for incremental From in HDFS Connector
Date Fri, 18 Sep 2015 19:53:04 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876244#comment-14876244
] 

ASF subversion and git services commented on SQOOP-2525:
--------------------------------------------------------

Commit bd7252480f32c36002fba187e62f7c0dbe284c38 in sqoop's branch refs/heads/sqoop2 from [~hshreedharan]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=bd72524 ]

SQOOP-2525. Sqoop2: Add support for incremental From in HDFS Connector

(Jarcec via Hari)


> Sqoop2: Add support for incremental From in HDFS Connector
> ----------------------------------------------------------
>
>                 Key: SQOOP-2525
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2525
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.99.6
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>             Fix For: 1.99.7
>
>         Attachments: SQOOP-2525.patch, SQOOP-2525.patch, SQOOP-2525.patch
>
>
> I would like to add support for incremental transfer in the "From" direction to HDFS
connector. The use case is this one - we have a directory where users are dumping files every
now and then. We would like to transfer only the newly added files. We can assume that files
are immutable when uploaded to this directory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message