kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergio Gonzalez <sgonza...@cecropiasolutions.com>
Subject Kafka isn't recovering all the messages after i lose a broker from a new topic created
Date Thu, 28 Jul 2016 15:18:01 GMT
Hello guys,

I have a java consumer with these properties:

          Properties props = new Properties();
props.put("zookeeper.connect", this.settings.getZookeeperUrl() );
props.put("group.id", this.settings.getGroupId());
props.put("client.id", infoCompania.getCompania());
  props.put("zookeeper.session.timeout.ms", "600000");
  props.put("zookeeper.connection.timeout.ms", "10000");
  props.put("zookeeper.sync.time.ms", "2000");
  props.put("socket.timeout.ms", "5000");
  props.put("fetch.wait.max.ms", "2000");
  props.put("auto.offset.reset", esNuevo ? "smallest" : "largest");

Also, i have configured 3 brokers. But, when i lose a broker, create a new
topic and send a lot messages to this new topic.

The issue occur when the broker start again and it can NOT recover all the
messages from this new topic (start from x offset).

Someone can help me please? What else a need to setting?

Thanks a lot.


*Sergio A. González Quirós*
*Computer Engineering, QA **Engineer*

*Cartago, Costa Rica*
*Telephone*: *(+506) 8965-3890*

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message