kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brett Rann <br...@zendesk.com.INVALID>
Subject Re: Question about KIP-107
Date Tue, 20 Mar 2018 02:27:19 GMT
Looks to be addressed in 1.1.0 which is currently being voted on for
release:

https://issues.apache.org/jira/browse/KAFKA-5925


------------

The KIP-107
<https://cwiki.apache.org/confluence/display/KAFKA/KIP-107%3A+Add+purgeDataBefore%28%29+API+in+AdminClient>
provides
a way to delete messages starting from a specified offset inside a topic
partition which we don’t want to take anymore so without relying on
time-based and size-based log retention policies. The already implemented
protocol request and response messages (DeleteRecords API, key 21) are used
only by the “legacy” Admin Client in Scala and aren’t provided by the new
Admin Client API in Java.

The KIP-204
<https://cwiki.apache.org/confluence/display/KAFKA/KIP-204+%3A+adding+records+deletion+operation+to+the+new+Admin+Client+API>
is
about addressing this JIRA.

------------

Link to the PR:

https://github.com/apache/kafka/pull/4132/files

And JavaDoc:

https://kafka.apache.org/11/javadoc/org/apache/kafka/clients/admin/DeleteRecordsResult.html


On Tue, Mar 20, 2018 at 1:03 PM, Jason Turim <jason@signalvine.com> wrote:

> Hi folks,
>
> My team and I are just getting started with Kafka, and I'm looking for
> information about removing individual items in the log. It led me to this
> article about implementing GDPR with Kafka
> <https://www.confluent.io/blog/handling-gdpr-log-forget/
> <https://www.confluent.io/blog/handling-gdpr-log-forget/>>. That article
> links to KIP-107: Add purgeDataBefore() API in AdminClient
> <https://cwiki.apache.org/confluence/display/KAFKA/KIP-107: Add
> purgeDataBefore() API in AdminClient
> <https://cwiki.apache.org/confluence/display/KAFKA/KIP-107: Add purgeDataBefore()
API in AdminClient>>.
>
>
> It looks like the KIP was released in version 0.11
> <https://archive.apache.org/dist/kafka/0.11.0.0/RELEASE_NOTES.html
> <https://archive.apache.org/dist/kafka/0.11.0.0/RELEASE_NOTES.html>> but, I
> don't see the method in the AdminClient API documentation
> <https://kafka.apache.org/10/javadoc/index.html?org/apache/
> kafka/clients/admin/AdminClient.html
> <https://kafka.apache.org/10/javadoc/index.html?org/apache/kafka/clients/admin/AdminClient.html>>.
>
>
> is this feature available?
>
> thanks,
> Jason
>



-- 

Brett Rann

Senior DevOps Engineer


Zendesk International Ltd

395 Collins Street, Melbourne VIC 3000 Australia

Mobile: +61 (0) 418 826 017

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message