kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax" <matth...@confluent.io>
Subject Re: Kafka Streams not allowed to change the number of input topic partitions
Date Thu, 14 Nov 2019 07:39:07 GMT
That is correct. And there is no WIP to address this atm. It's a pretty
complicated problem to allow for dynamic scaling.


-Matthias


On 11/13/19 9:41 AM, ChienHsing Wu wrote:
> Hi,
> 
> I came across the links below that indicates it's not simple to increase partitions in
an input topic afterwards. Is this still true in the current kafka version 2.3.1 and soon
to be available 2.4?
> 
> https://stackoverflow.com/questions/42329387/failed-to-rebalance-error-in-kafka-streams-with-more-than-one-topic-partition/42334849#42334849?newreg=b7e04be652f74b87a8a28721c865a62d
> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowtoscaleaStreamsapp,i.e.,increasenumberofinputpartitions?
> 
> 
> Thanks, CH
> 


Mime
View raw message