kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Consumer Events Problem
Date Tue, 10 Dec 2013 15:46:30 GMT
Yes, you can use the ConsumerOffsetChecker tool.

Thanks,

Jun


On Mon, Dec 9, 2013 at 9:40 PM, Sanket Maru <sanket@ecinity.com> wrote:

> For mine topic the offset isn't increasing which means the consumer has
> stopped. I wanted to get the count(#) of events that are still remaining to
> be processed. Is that possible ?
>
>
>
> On Mon, Dec 9, 2013 at 9:44 PM, Jun Rao <junrao@gmail.com> wrote:
>
> > By default, each topic is kept on the broker for 7 days. Older data,
> > whether consumed or not, will be deleted.
> >
> > To check # of unconsumed messages, you can either use the
> > ConsumerOffsetChecker tool (see
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Myconsumerseemstohavestopped%2Cwhy%3F
> > )
> > or use the maxlag jmx in the consumer application (see
> > http://kafka.apache.org/documentation.html#consumerconfigs)
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Mon, Dec 9, 2013 at 4:30 AM, Sanket Maru <sanket@ecinity.com> wrote:
> >
> > > I am working on a small project and discovered that our consumer hasn't
> > > been executed for over a month now.
> > >
> > > How can i check the unprocessed events ? From which date the events are
> > > available and what is the retention policy on the producer side ?
> > >
> > > Thanks,
> > > Sanket Maru
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message