kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Kreps <...@confluent.io>
Subject Re: Checkpointing with custom metadata
Date Tue, 04 Aug 2015 16:36:00 GMT
Hey James,

You are right the intended use of that was to have a way to capture some
very small metadata about your state at the time of offset commit in an
atomic way.

That field isn't exposed but we do need to add it to the new consumer api
(I think just no one has done it yet.


On Mon, Aug 3, 2015 at 1:52 PM, James Cheng <jcheng@tivo.com> wrote:

> According to
> https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-OffsetCommitRequest,
> we can store custom metadata with our checkpoints. It looks like the high
> level consumer does not support committing offsets with metadata, and that
> in order to checkpoint with custom metadata, we have to issue the
> OffsetCommitRequest ourselves. Is that correct?
> Thanks,
> -James

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message