kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eno Thereska <eno.there...@gmail.com>
Subject Re: Kafka Streams: Is it possible to pause/resume consuming a topic?
Date Sat, 01 Apr 2017 16:44:07 GMT
Sure, here is an example of pausing:
https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java#L165
<https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java#L165>

And resuming:
https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java#L215
<https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java#L215>

Cheers
Eno
> On 1 Apr 2017, at 17:14, Tianji Li <skyahead@gmail.com> wrote:
> 
> Hi Eno,
> 
> Could you point to me where in code this is happening please?
> 
> Thanks
> Tianji
> 
> On Sat, Apr 1, 2017 at 11:45 AM, Eno Thereska <eno.thereska@gmail.com>
> wrote:
> 
>> Tianji,
>> 
>> You shouldn’t have to worry about pausing and resuming the consumer, since
>> that happens internally automatically.
>> 
>> Eno
>> 
>>> On Apr 1, 2017, at 3:26 PM, Tianji Li <skyahead@gmail.com> wrote:
>>> 
>>> Hi there,
>>> 
>>> Say a processor that is consuming topic A and producing into topic B, and
>>> somehow the processing takes long time, is it possible to pause the
>>> consuming from topic A, and later on resume?
>>> 
>>> Or does it make sense to do so? If not, what are the options to resolve
>>> this issue?
>>> 
>>> Thanks
>>> Tianji
>> 
>> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message