sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1799) Connector API : Ability for connector to indicate if its FROM and TO support incremental reading/ writing
Date Thu, 15 Jan 2015 17:24:34 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278971#comment-14278971
] 

Veena Basavaraj commented on SQOOP-1799:
----------------------------------------

We can close this as No work once other 1168 is complete

> Connector API : Ability for connector to indicate if its FROM and TO support incremental
reading/ writing
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-1799
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1799
>             Project: Sqoop
>          Issue Type: Sub-task
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>
>
> No longer a necessity,  If the connectors have delta read/ write configs we will display
it and they will use those config values to do the appropriate form or reading from and writing
to the data source. At this point having this in the initializer API does not seem necessary,
we can revisit if we need this information upfront for any form of validation when the job
is created.
> By default it is assumed the connectors will do a full fetch and full write from clean
slate.
> For instance if the TO does not support delta records to be written is some fashion,
but the FROM side only gave subset of records, we cannot expect delta append or merge ( overwriting
existing records with no dupes) to happen. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message