From users-return-7629-apmail-kafka-users-archive=kafka.apache.org@kafka.apache.org Tue Dec 10 05:40:47 2013 Return-Path: X-Original-To: apmail-kafka-users-archive@www.apache.org Delivered-To: apmail-kafka-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4366310B25 for ; Tue, 10 Dec 2013 05:40:47 +0000 (UTC) Received: (qmail 44731 invoked by uid 500); 10 Dec 2013 05:40:44 -0000 Delivered-To: apmail-kafka-users-archive@kafka.apache.org Received: (qmail 44684 invoked by uid 500); 10 Dec 2013 05:40:44 -0000 Mailing-List: contact users-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@kafka.apache.org Delivered-To: mailing list users@kafka.apache.org Received: (qmail 44676 invoked by uid 99); 10 Dec 2013 05:40:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Dec 2013 05:40:43 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_SOFTFAIL X-Spam-Check-By: apache.org Received-SPF: softfail (athena.apache.org: transitioning domain of sanket@ecinity.com does not designate 74.125.82.53 as permitted sender) Received: from [74.125.82.53] (HELO mail-wg0-f53.google.com) (74.125.82.53) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Dec 2013 05:40:38 +0000 Received: by mail-wg0-f53.google.com with SMTP id k14so4494090wgh.32 for ; Mon, 09 Dec 2013 21:40:16 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=Pv8w2yaUG3bVeEvWUm9uWeSuMl+VAgt7Rwqcj+J6jk4=; b=Xe8Bs5kqcny2/7X8gswUbrm6ZnBZbRKbQWx7B4aDIYxQjIr/H06mkzX6vY631IOPfW zNY082VMeiMif9EvsbzxZ8sIwXFcpAD/0vcyPvyg4EPADQL1tfRfO9fryLW7riGhWgrk 5jSs5EXK9oJLqAxh4xJdLJq+iwYISU6b87O5/EdeZ+X1VNnU6jukctJcAOSS0pFxPjxL JlysNSunEYweLLGZTzZgEdztzcUx5P8fuwsxrqpxc9LZh9PsmRHouwNJpRGrRw+ZwHf8 +QCP2gC+yNXBuPsCn2VbpYpb3PmO6HRbYHY9XiYtjhSFrxRd8k1ApDuR468MH2xNcB2Z AY2w== X-Gm-Message-State: ALoCoQnDXu6NesorNdbdSgEb32A1T/YG88M/h5hYTgGQfe0Ui//JJsPnTi7s07LKuERhyLiUlL3Z MIME-Version: 1.0 X-Received: by 10.180.189.49 with SMTP id gf17mr17400978wic.23.1386654016351; Mon, 09 Dec 2013 21:40:16 -0800 (PST) Received: by 10.194.164.226 with HTTP; Mon, 9 Dec 2013 21:40:16 -0800 (PST) X-Originating-IP: [124.124.14.73] In-Reply-To: References: Date: Tue, 10 Dec 2013 11:10:16 +0530 Message-ID: Subject: Re: Consumer Events Problem From: Sanket Maru To: users@kafka.apache.org Content-Type: multipart/alternative; boundary=001a11c33fd012415b04ed278c71 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c33fd012415b04ed278c71 Content-Type: text/plain; charset=ISO-8859-1 For mine topic the offset isn't increasing which means the consumer has stopped. I wanted to get the count(#) of events that are still remaining to be processed. Is that possible ? On Mon, Dec 9, 2013 at 9:44 PM, Jun Rao wrote: > By default, each topic is kept on the broker for 7 days. Older data, > whether consumed or not, will be deleted. > > To check # of unconsumed messages, you can either use the > ConsumerOffsetChecker tool (see > > https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Myconsumerseemstohavestopped%2Cwhy%3F > ) > or use the maxlag jmx in the consumer application (see > http://kafka.apache.org/documentation.html#consumerconfigs) > > Thanks, > > Jun > > > On Mon, Dec 9, 2013 at 4:30 AM, Sanket Maru wrote: > > > I am working on a small project and discovered that our consumer hasn't > > been executed for over a month now. > > > > How can i check the unprocessed events ? From which date the events are > > available and what is the retention policy on the producer side ? > > > > Thanks, > > Sanket Maru > > > --001a11c33fd012415b04ed278c71--