kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anish Mashankar <an...@systeminsights.com>
Subject Old replica data does not clear following the retention.ms property
Date Fri, 16 Sep 2016 05:10:16 GMT
I recently ran partition assignment on some topics. This made the replicas
of some partitions move around the cluster. It was seamless. However, when
it came to purging old logs following the retention.ms property of the
topic, the replica partitions were not clear. The leader partition,
however, was purged correctly.
As our consumers have caught up, a quick fix was to reduce retention period
to 1 day, let Kafka purge those replicas and reset the retention policy.

This looks like a bug. We had almost run out of disk space on few of our
brokers due to this.
Anish Samir Mashankar

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message