kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kris K <squareksc...@gmail.com>
Subject offset storage as kafka with zookeeper 3.4.6
Date Thu, 11 Jun 2015 08:03:09 GMT
I am trying to migrate the offset storage to kafka (3 brokers of version
0.8.2.1) using the consumer property offsets.storage=kafka.  I noticed that
a new topic, __consumer_offsets got created.
But nothing is being written to this topic, while the consumer offsets
continue to reside on zookeeper.

I am using a 3 node zookeeper ensemble (version 3.4.6) and not using the
one that comes with kafka.

The current config consumer.properties now contains:

offsets.storage=kafka
dual.commit.enabled=false
exclude.internal.topics=false

Is it mandatory to use the zookeeper that comes with kafka for offset
storage to be migrated to kafka?

I tried both the approaches:

1. As listed on slide 34 of
http://www.slideshare.net/jjkoshy/offset-management-in-kafka.
2. By deleting the zookeeper data directories and kafka log directories.

None of them worked.

Thanks
Kris

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message