storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From S G <sg.online.em...@gmail.com>
Subject Re: Kafka Spouts Lag via REST API
Date Thu, 23 Feb 2017 23:58:23 GMT
Thanks Priyank.

Actually, I was asking about the kafka version.
Does the latest storm release report kafka-offsets in its REST api for
kafka 0.8.x versions too?
I ask this because now storm has two kafka-spouts - one for 0.8.x and other
for .10 versions.

We are using 0.8.x and would love to have the offsets reported for 0.8.x
version.

Thanks
SG

On Thu, Feb 23, 2017 at 12:11 PM, Priyank Shah <pshah@hortonworks.com>
wrote:

> Hi SG,
>
>
>
> You will need to update your storm-kafka dependency to latest storm
> release version for you to be able to see the spout lag
>
>
>
> *From: *S G <sg.online.email@gmail.com>
> *Reply-To: *"user@storm.apache.org" <user@storm.apache.org>
> *Date: *Thursday, February 23, 2017 at 8:53 AM
> *To: *"user@storm.apache.org" <user@storm.apache.org>
> *Subject: *Re: Kafka Spouts Lag via REST API
>
>
>
> Hi Jungtaek,
>
>
>
> This lag will be reported only for latest kafka-spout versions or for
> kafka 0.8.x versions too?
>
>
>
> Thanks
>
> SG
>
>
>
> On Thu, Feb 23, 2017 at 5:25 AM, Jungtaek Lim <kabhwan@gmail.com> wrote:
>
> For avoiding confusion: Kafka spout lag feature is included to Apache
> Storm 1.1.0 which is not released yet. It's available for HDP and HDF now,
> but not Apache release.
>
> We're working on releasing 1.1.0 soon.
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
>
>
> On Thu, 23 Feb 2017 at 9:32 PM Davide Ferrari <davide@billymob.com> wrote:
>
> Ok, found it by looking at the ajax calls in the storm UI:
>
> /api/v1/topology/:id/lag
>
> Hope it helps someone in the future :)
>
> Thanks
>
>
>
> 2017-02-23 12:59 GMT+01:00 Davide Ferrari <davide@billymob.com>:
>
> Hello everyone
>
> I'm using Storm 1.0.1 (HDP 2.5.3), is there a way to get the data for
> "Kafka Spouts Lag", as shown in the Storm UI, through the REST API? I was
> looking at the documentation http://storm.apache.org/
> releases/1.0.0/STORM-UI-REST-API.html but I cannot see it
>
> Thanks!
>
>
> --
>
> Davide Ferrari
>
> Senior Systems Engineer
>
> Billy Mobile
>
>
>
>
> --
>
> Davide Ferrari
>
> Senior Systems Engineer
>
>
>

Mime
View raw message