By default, each topic is kept on the broker for 7 days. Older data,
whether consumed or not, will be deleted.
To check # of unconsumed messages, you can either use the
ConsumerOffsetChecker tool (see
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Myconsumerseemstohavestopped%2Cwhy%3F)
or use the maxlag jmx in the consumer application (see
http://kafka.apache.org/documentation.html#consumerconfigs)
Thanks,
Jun
On Mon, Dec 9, 2013 at 4:30 AM, Sanket Maru <sanket@ecinity.com> wrote:
> I am working on a small project and discovered that our consumer hasn't
> been executed for over a month now.
>
> How can i check the unprocessed events ? From which date the events are
> available and what is the retention policy on the producer side ?
>
> Thanks,
> Sanket Maru
>
|