kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: How to know how many messages not yet processed ?
Date Fri, 30 Dec 2011 22:35:28 GMT

Currently, Kafka doesn't expose # of unconsumed messages. We do have a
monitoring tool ConsumerOffsetCheck that tells you the lag in bytes per
partition for a given consumer. There is also a jmx bean ConsumerTopicStat
that stores the # of consumed messages per topic for a consumer.



On Fri, Dec 30, 2011 at 5:59 AM, Stone <stones.gao@gmail.com> wrote:

> Our current messaging system is redis based (resque). So it's easy to know
> how many messages got queued (not processed ) using LLEN to get the length
> of a list (or using resque-web interface). For Kafka what's the recommended
> way to get metrics such as # of unprocessed messages, how many messages got
> by day or hour ? Is there any web based interface to view the metrics ?
> Best Regards,
> Stone

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message