kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Heslop <john.heslop.3...@gmail.com>
Subject Re: Records with null value (tombstone) are not removed during compaction
Date Mon, 04 Nov 2019 18:05:23 GMT


On 2019/10/10 16:06:39, Uma Maheswari <umaselvam76@gmail.com> wrote: 
> I have created a topic with cleanup.policy set to compact. segment.ms and delete.retention.ms
are also configured for the topic. Compaction is happening but records with null value are
not removed. But when segment.bytes is configured, records with null value are removed. Please
help.
> 
> Thanks,
> Uma
> 

These links might give some useful background:

https://issues.apache.org/jira/browse/KAFKA-7321
ensure timely processing of deletion requests in Kafka topic (Time-based log compaction)

https://issues.apache.org/jira/browse/KAFKA-7137
ability to trigger compaction for tombstoning and GDPR

Regards,
John

Mime
View raw message