kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis.gospodne...@gmail.com>
Subject Re: Topic Reassignment Tool Improvements
Date Sat, 31 May 2014 20:20:58 GMT
+1 for sticking this on the Wiki or in JIRA without your internal stuff and
letting those who need it (like us) clean up for inclusion.  We've got a
need for this, too. :)

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/

On Wed, Apr 23, 2014 at 10:44 PM, Todd Palino <tpalino@linkedin.com> wrote:

> We¹ve got a script that rebalances the partitions in a cluster based on
> their size (to try and keep the data size across the brokers even), which
> works very well for moving partitions onto new cluster members. The only
> problem with it is that it¹s got a couple hooks into our internal
> configuration system. We want to release it into the wild, but we need to
> fix that first so that the config it takes in is generic.
> I¹ll bug the SRE that wrote it to see if we can get that done sooner than
> later. Especially since we just talked about it at ApacheCon and said we
> would :)
> -Todd
> On 4/23/14, 7:37 PM, "Drew Goya" <drew@gradientx.com> wrote:
> >Hey all, do you guys have any plans to enhance the topic reassignment
> >tool?
> > I've had to grow my cluster a couple times and getting an existing topics
> >partition replicas balanced out to the new brokers really sucks.  I have
> >to
> >describe the topic, awk the output to get it in the json format, then
> >manually edit that file.
> >
> >If no one takes a crack at it by the time I've got to expand my cluster
> >gain I'll probably give it a shot but hopefully it is already in the
> >works!

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message