kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudia Wegmann <c.wegm...@kasasi.de>
Subject Problems with broker upgrade from 1.1.0 to 2.0.0
Date Mon, 08 Oct 2018 15:09:22 GMT
Dear community,

I updated my kafka cluster from version 1.1.0 to 2.0.0 according to the upgrade guide for
rolling upgrades today. I encountered a problem after starting the new broker version. The
log is full of
"Found a corrupted index file corresponding to log file /data/kafka-logs/resultGatewayDataDispatcher-22/00000000000002858226.log
due to Corrupt time index found, time index file (/data/kafka-logs/resultGatewayDataDispatcher-22/00000000000002858226.timeindex)
has non-zero size but the last timestamp is 0 which is less than the first timestamp 1538583935827},
recovering segment and rebuilding index files... (kafka.log.Log)"

Said recovering takes quite a bit of time.

Now I'm not too keen to do the broker update in the production environment because of the
relative long processing pause. 
The questions are:
1.) Is there a way to avoid this error and therefore make starting the new broker faster?
2.) Does the error imply any data loss?

Any help is apricated 😊
View raw message