kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Exactly once semantics
Date Thu, 08 Dec 2011 17:32:30 GMT
Currently, the high level consumer (with ZK integration) doesn't expose
offsets to the consumer. Only SimpleConsumer does.

Jun

On Thu, Dec 8, 2011 at 9:15 AM, Mark <static.void.dev@gmail.com> wrote:

> "This is only possible through SimpleConsumer right now."
>
>
> Is that correct? Did you mean SimpleConsumer or HighLevelConsumer? What
> are the differences?
>
>
> On 12/8/11 8:53 AM, Jun Rao wrote:
>
>> Mark,
>>
>> Today, this is mostly the responsibility of the consumer, by managing the
>> offsets properly. For example, if the consumer periodically flushes
>> messages to disk, it has to checkpoint to disk the offset corresponding to
>> the last flush. On failure, the consumer has to rewind the consumption
>> from
>> the last checkpointed offset. This is only possible through SimpleConsumer
>> right now.
>>
>> Thanks,
>>
>> Jun
>>
>> On Thu, Dec 8, 2011 at 8:18 AM, Mark<static.void.dev@gmail.com**>  wrote:
>>
>>  How can one guarantee exactly one semantics when using Kafka as a
>>> traditional queue? Is this guarantee the responsibility of the consumer?
>>>
>>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message