samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jagadish Venkatraman <jagadish1...@gmail.com>
Subject Re: A Question About multi-output
Date Wed, 12 Jul 2017 02:45:53 GMT
Yes, before the completion of a checkpoint/commit, all pending messages
(across all streams) are guaranteed to be flushed.

On Tue, Jul 11, 2017 at 7:33 PM 舒琦 <shuqi@eefung.com> wrote:

> Hi Jagadish,
>
>         When write one message to two different output streams, Samza will
> wait acks from two different streams and then process checkpointing. Do I
> understand right?
>
>         Thanks for your help!
>
> ————————
> QiShu
>
> > 在 2017年7月12日,03:48,Jagadish Venkatraman <jagadish1989@gmail.com>
写道:
> >
> > To write to two different output streams, you can call collector.send()
> > twice.
> >
> >>>        For what I understand now, MessageCollector.send can only be
> > called once in process, because it relates to Acks, checkpoint and
> > processing loop.
> >
> > These should be pretty orthogonal. If the docs are misleading, please let
> > us know. We'll fix them
> >
> > On Mon, Jul 10, 2017 at 11:56 PM, 舒琦 <shuqi@eefung.com> wrote:
> >
> >> Hi guys,
> >>
> >>        How to write one message to two different output stream, let’s
> >> say two different kafka cluster?
> >>
> >>        For what I understand now, MessageCollector.send can only be
> >> called once in process, because it relates to Acks, checkpoint and
> >> processing loop.
> >>
> >>        Thanks for you help!
> >>
> >> ————————
> >> Qi Shu
> >>
> >>
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
>
> --
Sent from my iphone.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message