flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christophe Jolif <cjo...@gmail.com>
Subject Kafka and parallelism
Date Sat, 03 Feb 2018 17:53:42 GMT

If I'm sourcing from a KafkaConsumer do I have to explicitly set the Flink
job parallelism to the number of partions or will it adjust automatically
accordingly? In other word if I don't call setParallelism will get 1 or the
number of partitions?

The reason I'm asking is that I'm listening to a topic pattern not a single
topic and the number of actual topic (and so partitions) behind the pattern
can change so it is not possible to know ahead ot time how many partitions
I will get.


View raw message