kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Otto <o...@wikimedia.org>
Subject Re: Ganglia Metrics Reporter
Date Thu, 22 Aug 2013 16:12:56 GMT

At WMF, we use jmxtrans to do this:

And, if you use puppet, here's a nice little module to help generate jmxtrans json files,
and an example of metrics we were sending to Ganglia from Kafka 0.7.2.


On Aug 22, 2013, at 11:42 AM, Maxime Brugidou <maxime.brugidou@gmail.com> wrote:

> Hi all,
> Since I couldn't find any other way to publish kafka metrics to ganglia
> from kafka 0.8 (beta), I just published on github a super-simple ganglia
> metrics reporter for Kafka. It is configurable through the kafka config
> file and you can use it on the broker side and on your consumers/producers.
> There is also a feature to exclude some metrics with a regex (useful if you
> have many topics/partions).
> Here it is on github: https://github.com/criteo/kafka-ganglia
> Let me know if you have issues/questions. This is using metrics-ganglia
> 2.2.0 directly so it is not a ganglia plugin but rather a kafka "add-on".
> I don't know the proper way to distribute this yet for installation on
> brokers, it could also be part of some contrib kafka code.
> Cheers,
> Maxime

View raw message