kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hacker win7 <hackersw...@gmail.com>
Subject Re: consumer fetch multiple topic partitions committed offset
Date Fri, 02 Nov 2018 10:31:13 GMT
Thanks for your reply, I want to know why new consumer did not add the committed(TopicPartitions)?
 Just modify the source in committed(TopicPartition, Duration) from ‘coordinator.fetchCommittedOffsets(Collections.single)’
to ‘coordinator.fetchCommittedOffsets(TopicPartitions)’.
Besides, call multiple times with committed() will send multiple request to coordinator, maybe
block in the middle request, why not accumulate the multiple TopicPartitions and send one
fetch offset request to coordinator?

> On Nov 2, 2018, at 04:20, Matthias J. Sax <matthias@confluent.io> wrote:
> You need to call `committed()` multiple times.
> -Matthias
> On 11/1/18 12:28 AM, hacker win7 wrote:
>> Hi,
>> After reviewing the KafkaConsumer source about API of *committed():*
>> I found that old consumer support committed(mutipleTopicPartitions) to
>> return multiple committed offset, while in new consumer, there is only
>> committed(singleTopicPartition) and return only one committed offset.
>> It is a little weird for me that why new consumer only support fetch single
>> topic partition committed offset. I search some KIPs but didn't find the
>> reason about this. Anyway, How to fetch multiple topic partitions committed
>> offset in new consumer?

View raw message