kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David DeMaagd <ddema...@linkedin.com>
Subject Re: Kafka Important Metrics
Date Wed, 03 Jul 2013 16:07:35 GMT
I've also used jolokia, http://jolokia.org/, though it can get a little slow 
to respond if you don't use it right.  Have rolled a JMX/HTTP 'data dumper'
from scratch (can be done in a couple hundred lines of Java without too
much issue)...

-- 
Dave DeMaagd
ddemaagd@linkedin.com | 818 262 7958

(clehene@adobe.com - Wed, Jul 03, 2013 at 04:22:38PM +0100)
> I believe something like https://github.com/jmxtrans/jmxtrans could solve
> this without the need to implement 3rd party monitoring integrations.
> 
> On 7/2/13 12:57 AM, "Maxime Brugidou" <maxime.brugidou@gmail.com> wrote:
> 
> >By the way, having an official contrib package with graphite, ganglia and
> >other well-known reporters would be awesome so that not everyone has to
> >write their own.
> >On Jul 1, 2013 10:27 PM, "Joel Koshy" <jjkoshy.w@gmail.com> wrote:
> >
> >> Also, there are several key metrics on the broker and client side - we
> >> should compile a list and put it on a wiki. Can you file a jira for
> >> this?
> >>
> >> On Mon, Jul 1, 2013 at 1:26 PM, Joel Koshy <jjkoshy.w@gmail.com> wrote:
> >> > CSVreporter is probably not an ideal fit for production monitoring -
> >> > we use it for getting stats out of period system test runs.
> >> >
> >> > For production monitoring you are probably better off reading off JMX
> >> > and feeding your monitoring system of choice. You can also write a
> >> > custom metrics reporter and additionally implement
> >> > KafkaMetricsReporter (see KafkaCSVMetricsReporter.scala for an
> >> > example) and plug it in the KafkaConfig. Your custom metrics reporter
> >> > can directly feed into your monitoring system. E.g., if you use
> >> > graphite, you can write a KafkaGraphiteReporter that wraps the
> >> > GraphiteReporter that coda hale metrics provides.
> >> >
> >> > Joel
> >> >
> >> > On Mon, Jul 1, 2013 at 11:21 AM, Vadim Keylis <vkeylis2009@gmail.com>
> >> wrote:
> >> >> Good morning. What is the best way to monitor kafka through jmx or
by
> >> >> enabling kafka.csv.metrics.reporter.enabled?
> >> >> What are the important metrics in JMX to watch for and/or graph?
> >> >> What are the important metrics in csv files to watch for and/or
> >>graph?
> >> >>
> >> >> Thanks,
> >> >> Vadim
> >>
> 

Mime
View raw message