flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()
Date Mon, 10 Oct 2016 12:46:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562211#comment-15562211

Robert Metzger commented on FLINK-4023:

This has been resolved in FLINK-4379.

> Move Kafka consumer partition discovery from constructor to open()
> ------------------------------------------------------------------
>                 Key: FLINK-4023
>                 URL: https://issues.apache.org/jira/browse/FLINK-4023
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>            Reporter: Michal Harish
>            Assignee: Tzu-Li (Gordon) Tai
>            Priority: Minor
>              Labels: kafka, kafka-0.8
>             Fix For: 1.2.0
> Currently, Flink queries Kafka for partition information when creating the Kafka consumer.
This is done on the client when submitting the Flink job, which requires the client to be
able to fetch the partition data from Kafka which may only be accessible from the cluster
environment where the tasks will be running. Moving the partition discovery to the open()
method should solve this problem.

This message was sent by Atlassian JIRA

View raw message