flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3061) Kafka Consumer is not failing if broker is not available
Date Tue, 24 Nov 2015 10:15:11 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024189#comment-15024189

ASF GitHub Bot commented on FLINK-3061:

Github user aljoscha commented on the pull request:

    Could it happen that a broker is currently not available but will be in the future. With
the behaviour before this PR could Flink then idle and start consuming once the broker becomes

> Kafka Consumer is not failing if broker is not available
> --------------------------------------------------------
>                 Key: FLINK-3061
>                 URL: https://issues.apache.org/jira/browse/FLINK-3061
>             Project: Flink
>          Issue Type: Bug
>          Components: Kafka Connector
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>             Fix For: 1.0.0
> It seems that the FlinkKafkaConsumer is just logging the errors when trying to get the
initial list of partitions for the topic, but its not failing.
> The following code ALWAYS runs, even if there is no broker or zookeeper running.
> {code}
>  def main(args: Array[String]) {
>     val env = StreamExecutionEnvironment.getExecutionEnvironment
>     val properties = new Properties()
>     properties.setProperty("bootstrap.servers", "localhost:9092")
>     properties.setProperty("zookeeper.connect", "localhost:2181")
>     properties.setProperty("group.id", "test")
>     val stream = env
>       .addSource(new FlinkKafkaConsumer082[String]("topic", new SimpleStringSchema(),
>       .print
>     env.execute("Flink Kafka Example")
>   }
> {code}
> The runtime consumers are designed to idle when they have no partitions assigned, but
there is no check that there are no partitions at all.

This message was sent by Atlassian JIRA

View raw message