kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marina <ppi...@yahoo.com.INVALID>
Subject Re: how to modify offsets stored in Kafka in 0.8.2.1 version?
Date Fri, 19 Jun 2015 13:43:50 GMT
Thanks, Stevo, for the quick reply,
Yes, I understand how to do this programmatically - but I would like to be able to do this
manually from a command line, just as before I was able to do this in the Zookeeper shell.
I don't want to write and run a Java app just to set an offset :)

[unless, of course, this is the only way to do this.....]

thanks!
Marina




----- Original Message -----
From: Stevo Slavić <sslavic@gmail.com>
To: users@kafka.apache.org; Marina <ppine7@yahoo.com>
Cc: 
Sent: Friday, June 19, 2015 9:33 AM
Subject: Re: how to modify offsets stored in Kafka in 0.8.2.1 version?

Hello Marina,

There's Kafka API to fetch and commit offsets
https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+consumer+offsets+in+Kafka
- maybe it will work for you.

Kind regards,
Stevo Slavic.


On Fri, Jun 19, 2015 at 3:23 PM, Marina <ppine7@yahoo.com.invalid> wrote:

> Hi,
>
> in older Kafka versions where offsets were stored in Zookeeper - I could
> manually update the value of the Zookeeper's node:
>
> /consumers/<consumer_group_name>/offsets/<topic_name>/<partition_number>/<offset_value>.
>
> In 0.8.2.1 - there are no values in offsets anymore, but there is a new
> topic,
> __consumer_offsets, where as I understand offsets are tracked now.
>
> the ConsumerOffsetChecker tool seems to be able to get the offsets values
> from this topic , since I see correct value running it.
> So, how do I access this info myself?
>
>
> I tried:
>
> ./kafka-console-consumer.sh --zookeeper localhost:2181 --topic
> __consumer_offsets --from-beginning
>
> but it does not show anything....
> Also, how would I change the offset? I need to do this sometimes if I want
> to skip/ignore some messages and just advance offset manually.
>
> thanks,
> Marina
>

Mime
View raw message