samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 舒琦 <sh...@eefung.com>
Subject Re: A Question About multi-output
Date Wed, 12 Jul 2017 03:26:04 GMT
Hi Jagadish,

	Thank you very much!

————————
QiShu

> 在 2017年7月12日,10:45,Jagadish Venkatraman <jagadish1989@gmail.com> 写道:
> 
> Yes, before the completion of a checkpoint/commit, all pending messages
> (across all streams) are guaranteed to be flushed.
> 
> On Tue, Jul 11, 2017 at 7:33 PM 舒琦 <shuqi@eefung.com> wrote:
> 
>> Hi Jagadish,
>> 
>>        When write one message to two different output streams, Samza will
>> wait acks from two different streams and then process checkpointing. Do I
>> understand right?
>> 
>>        Thanks for your help!
>> 
>> ————————
>> QiShu
>> 
>>> 在 2017年7月12日,03:48,Jagadish Venkatraman <jagadish1989@gmail.com>
写道:
>>> 
>>> To write to two different output streams, you can call collector.send()
>>> twice.
>>> 
>>>>>       For what I understand now, MessageCollector.send can only be
>>> called once in process, because it relates to Acks, checkpoint and
>>> processing loop.
>>> 
>>> These should be pretty orthogonal. If the docs are misleading, please let
>>> us know. We'll fix them
>>> 
>>> On Mon, Jul 10, 2017 at 11:56 PM, 舒琦 <shuqi@eefung.com> wrote:
>>> 
>>>> Hi guys,
>>>> 
>>>>       How to write one message to two different output stream, let’s
>>>> say two different kafka cluster?
>>>> 
>>>>       For what I understand now, MessageCollector.send can only be
>>>> called once in process, because it relates to Acks, checkpoint and
>>>> processing loop.
>>>> 
>>>>       Thanks for you help!
>>>> 
>>>> ————————
>>>> Qi Shu
>>>> 
>>>> 
>>> 
>>> 
>>> --
>>> Jagadish V,
>>> Graduate Student,
>>> Department of Computer Science,
>>> Stanford University
>> 
>> --
> Sent from my iphone.


Mime
View raw message