flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()
Date Mon, 10 Oct 2016 12:48:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562211#comment-15562211

Robert Metzger edited comment on FLINK-4023 at 10/10/16 12:48 PM:

This has been resolved in FLINK-4379. 
I'm sorry that the communication didn't properly happen here. (@[~srichter], [~tzulitai] was
assigned to that task, but I think its okay for Gordon that this is resolved. For the future,
it would be nice if you could check if there's already a JIRA for a change)

was (Author: rmetzger):
This has been resolved in FLINK-4379.

> Move Kafka consumer partition discovery from constructor to open()
> ------------------------------------------------------------------
>                 Key: FLINK-4023
>                 URL: https://issues.apache.org/jira/browse/FLINK-4023
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>            Reporter: Michal Harish
>            Assignee: Stefan Richter
>            Priority: Minor
>              Labels: kafka, kafka-0.8
>             Fix For: 1.2.0
> Currently, Flink queries Kafka for partition information when creating the Kafka consumer.
This is done on the client when submitting the Flink job, which requires the client to be
able to fetch the partition data from Kafka which may only be accessible from the cluster
environment where the tasks will be running. Moving the partition discovery to the open()
method should solve this problem.

This message was sent by Atlassian JIRA

View raw message