kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Increasing the no. of partitions during runtime(programmatically)
Date Tue, 01 Apr 2014 04:18:37 GMT
What's your use case? How frequent do you expect to increase # partitions?



On Mon, Mar 31, 2014 at 3:27 PM, Kiran Nagasubramanian

> Hello,
>         I'm new to Kafka. I was wondering if it's possible to increase the
> no. of partitions of a topic during runtime(programmatically). I could see
> that there're command line tools to achieve this. If I do not have any
> other option, I was thinking of solving this by starting with excess no. of
> partitions and adding the logic to Partitioner class to utilize only a few
> partitions, initially. Later when the load goes up, by changing some hot
> property, producer can be re-configured to push to additional partitions.
> Is this a right way to do this? Please share if you've any ideas.
> Thanks,
> Kiran

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message