storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Priyank Shah <ps...@hortonworks.com>
Subject Re: Storm Kafka offset monitoring
Date Tue, 21 Feb 2017 22:34:37 GMT
Hi Pradeep,

A release vote for RC1 of 1.1.0 is in progress. You can track that and once it gets released
you can upgrade.

Regarding upgrading your spout, you don’t need to make any code changes. You just need to
use the latest released spout code. Usually it involves updating a pom file that has a dependency
on storm-kafka module to latest version.

From: pradeep s <sreekumar.pradeep@gmail.com>
Reply-To: "user@storm.apache.org" <user@storm.apache.org>
Date: Tuesday, February 21, 2017 at 12:49 PM
To: "user@storm.apache.org" <user@storm.apache.org>
Subject: Re: Storm Kafka offset monitoring

Hi Priyank
Thanks for your reply.i was not able to find 1.1.0 version of storm
Can you please point to that.also can you please  confirm on what specific spout changes to
make.
Regards
Pradeep S
On Tue, Feb 21, 2017 at 10:54 AM Priyank Shah <pshah@hortonworks.com<mailto:pshah@hortonworks.com>>
wrote:
Hi Pradeep,

If you upgrade your spout in the topology and storm code to a later version(I checked v1.1.0
and it has the tool) you will get a table in storm ui which show you offsets. If you cannot
upgrade then I think you will have to do it manually.

From: pradeep s <sreekumar.pradeep@gmail.com<mailto:sreekumar.pradeep@gmail.com>>
Reply-To: "user@storm.apache.org<mailto:user@storm.apache.org>" <user@storm.apache.org<mailto:user@storm.apache.org>>
Date: Tuesday, February 21, 2017 at 9:44 AM
To: "user@storm.apache.org<mailto:user@storm.apache.org>" <user@storm.apache.org<mailto:user@storm.apache.org>>
Subject: Storm Kafka offset monitoring

Hi ,
I am using Storm 1.0.2 and Kafka 0.10.1.1 versions . Storm spout is configured using zookeeper
broker hosts. Is there a monitoring ui which i can use to track the consumer offsets and lag.
I was using yahoo kafka manager , but its showing storm spout as a consumer.Any help?
Regards
Pradeep S
Mime
View raw message