kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sanket Maru <san...@ecinity.com>
Subject Re: Consumer Events Problem
Date Tue, 10 Dec 2013 05:40:16 GMT
For mine topic the offset isn't increasing which means the consumer has
stopped. I wanted to get the count(#) of events that are still remaining to
be processed. Is that possible ?



On Mon, Dec 9, 2013 at 9:44 PM, Jun Rao <junrao@gmail.com> wrote:

> By default, each topic is kept on the broker for 7 days. Older data,
> whether consumed or not, will be deleted.
>
> To check # of unconsumed messages, you can either use the
> ConsumerOffsetChecker tool (see
>
> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Myconsumerseemstohavestopped%2Cwhy%3F
> )
> or use the maxlag jmx in the consumer application (see
> http://kafka.apache.org/documentation.html#consumerconfigs)
>
> Thanks,
>
> Jun
>
>
> On Mon, Dec 9, 2013 at 4:30 AM, Sanket Maru <sanket@ecinity.com> wrote:
>
> > I am working on a small project and discovered that our consumer hasn't
> > been executed for over a month now.
> >
> > How can i check the unprocessed events ? From which date the events are
> > available and what is the retention policy on the producer side ?
> >
> > Thanks,
> > Sanket Maru
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message