samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Ravits <michaelr...@gmail.com>
Subject Monitoring consumer lag
Date Mon, 16 Nov 2015 17:16:03 GMT
Hi,

I'd like to monitor consumer's lag.
Found this tool https://github.com/linkedin/Burrow.
But now realized that Samza is using it's own checkpointing mechanism.

So question is what's the best way to monitor whether and how much the
consumer is lagging?

On a related subject, I'd also like to monitor throughput per topic in
terms of messages per second and bytes per second. Should I query brokers
periodically, or maybe there is a better way?

Thanks,
Michael

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message