flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1753) Add more tests for Kafka Connectors
Date Wed, 15 Apr 2015 20:22:59 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14496862#comment-14496862

ASF GitHub Bot commented on FLINK-1753:

GitHub user rmetzger opened a pull request:


    [FLINK-1753] Extend KafkaITCase, reworked PersistentKafkaSource (initially)

    Added large messages test and reworked PersistentKafkaSource.
    A Flink user I'm talking with offline is affected by this issue, that's why I would like
to merge this rather soon. (I am aware that one test case is failing, so I'll spend more time
on this tomorrow morning)

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/rmetzger/flink kafka_big_records-rebased

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #603
commit e8bb15a686f17710c709662b4eaf475b8e3de528
Author: Robert Metzger <rmetzger@apache.org>
Date:   2015-04-13T14:23:58Z

    [FLINK-1753] Extend KafkaITCase with large messages test + rework PersistentKafkaSource.

commit c3be60f1db82ecee7b0a9cca0f1f637bfd722739
Author: Robert Metzger <rmetzger@apache.org>
Date:   2015-04-15T20:20:03Z



> Add more tests for Kafka Connectors
> -----------------------------------
>                 Key: FLINK-1753
>                 URL: https://issues.apache.org/jira/browse/FLINK-1753
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 0.9
>            Reporter: Robert Metzger
>            Assignee: Gábor Hermann
> The current {{KafkaITCase}} is only doing a single test.
> We need to refactor that test so that it brings up a Kafka/Zookeeper server and than
performs various tests:
> Tests to include:
> - A topology with non-string types MERGED IN 359b39c3
> - A topology with a custom Kafka Partitioning class MERGED IN 359b39c3
> - A topology testing the regular {{KafkaSource}}. MERGED IN 359b39c3
> - Kafka broker failure MERGED IN cb34e976
> - Flink TaskManager failure
> - Test with large records (up to 30 MB).

This message was sent by Atlassian JIRA

View raw message