sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1853) Sqoop2: Kafka connector supporting FROM direction
Date Fri, 31 Jul 2015 20:34:04 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649793#comment-14649793

Gwen Shapira commented on SQOOP-1853:

My point is, if we KNOW that we will add incremental in a follow up patch, we need to take
it into account in the design. If adding incremental will require a complete rewrite (and
I suspect it will), then you are setting yourself up to doing the same work twice and did
not make the patches any smaller.

I like the idea of a complete design that we know will support incremental but then implementing
it in multiple patches.

Another important point: Kafka project almost finalized the new consumer API: It will make
the implementation much easier, so I suggest taking a look and perhaps using it, even though
it is not released yet. (https://github.com/apache/kafka/tree/trunk/clients/src/main/java/org/apache/kafka/clients/consumer)

> Sqoop2: Kafka connector supporting FROM direction
> -------------------------------------------------
>                 Key: SQOOP-1853
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1853
>             Project: Sqoop
>          Issue Type: Sub-task
>    Affects Versions: 1.99.6
>            Reporter: Gwen Shapira
>            Assignee: Richard
>             Fix For: 1.99.7
>         Attachments: SQOOP-1853.0.patch, SQOOP-1853.1.patch, SQOOP-1853.2.patch

This message was sent by Atlassian JIRA

View raw message