sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Richard (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1853) Sqoop2: Kafka connector supporting FROM direction
Date Mon, 27 Jul 2015 07:43:05 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642402#comment-14642402
] 

Richard commented on SQOOP-1853:
--------------------------------

[~gwenshap], thanks for your comment.
I agree "incremental" feature is significant for the Kafka connector, also the same as "partition",
but I want to make it in a separated JIRA, because I want to keep each patch simple. The current
patch is only cover the simplest case, use auto-commit to import CSV data from Kafka server
without partition.
Sorry for leading mis-understanding, I will create following JIRA, partition support, incremental/offset
support, multi-topic support and other data format (Avro/Parquet) support.
For project "Camus", I have taken a look at it. It is a very good reference. Thank you for
sharing.

> Sqoop2: Kafka connector supporting FROM direction
> -------------------------------------------------
>
>                 Key: SQOOP-1853
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1853
>             Project: Sqoop
>          Issue Type: Sub-task
>    Affects Versions: 1.99.6
>            Reporter: Gwen Shapira
>            Assignee: Richard
>             Fix For: 1.99.7
>
>         Attachments: SQOOP-1853.0.patch, SQOOP-1853.1.patch, SQOOP-1853.2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message