kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rajasekar Elango <rela...@salesforce.com>
Subject Re: how to modify offsets stored in Kafka in 0.8.2.1 version?
Date Fri, 19 Jun 2015 14:11:40 GMT
Hi Marina,

Check slide 32 in this presentation
<http://www.slideshare.net/jjkoshy/offset-management-in-kafka>.

Hope this helps.

Thanks,
Raja.

On Fri, Jun 19, 2015 at 9:43 AM, Marina <ppine7@yahoo.com.invalid> wrote:

> Thanks, Stevo, for the quick reply,
> Yes, I understand how to do this programmatically - but I would like to be
> able to do this manually from a command line, just as before I was able to
> do this in the Zookeeper shell. I don't want to write and run a Java app
> just to set an offset :)
>
> [unless, of course, this is the only way to do this.....]
>
> thanks!
> Marina
>
>
>
>
> ----- Original Message -----
> From: Stevo Slavić <sslavic@gmail.com>
> To: users@kafka.apache.org; Marina <ppine7@yahoo.com>
> Cc:
> Sent: Friday, June 19, 2015 9:33 AM
> Subject: Re: how to modify offsets stored in Kafka in 0.8.2.1 version?
>
> Hello Marina,
>
> There's Kafka API to fetch and commit offsets
>
> https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+consumer+offsets+in+Kafka
> - maybe it will work for you.
>
> Kind regards,
> Stevo Slavic.
>
>
> On Fri, Jun 19, 2015 at 3:23 PM, Marina <ppine7@yahoo.com.invalid> wrote:
>
> > Hi,
> >
> > in older Kafka versions where offsets were stored in Zookeeper - I could
> > manually update the value of the Zookeeper's node:
> >
> >
> /consumers/<consumer_group_name>/offsets/<topic_name>/<partition_number>/<offset_value>.
> >
> > In 0.8.2.1 - there are no values in offsets anymore, but there is a new
> > topic,
> > __consumer_offsets, where as I understand offsets are tracked now.
> >
> > the ConsumerOffsetChecker tool seems to be able to get the offsets values
> > from this topic , since I see correct value running it.
> > So, how do I access this info myself?
> >
> >
> > I tried:
> >
> > ./kafka-console-consumer.sh --zookeeper localhost:2181 --topic
> > __consumer_offsets --from-beginning
> >
> > but it does not show anything....
> > Also, how would I change the offset? I need to do this sometimes if I
> want
> > to skip/ignore some messages and just advance offset manually.
> >
> > thanks,
> > Marina
> >
>



-- 
Thanks,
Raja.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message