samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aram Mkrtchyan <aram.mkrtch...@picsart.com.INVALID>
Subject Re: Samza hdfs
Date Wed, 11 Nov 2015 08:11:14 GMT
Hi Jae,

The main reason was the job scheduling on each batch processing. Also, we
need to process messages one by one, which means whenever the message is
consumed it needs to be  processed immediately.

Thanks.

On Wed, Nov 11, 2015 at 11:21 AM, Bae, Jae Hyeon <metacret@gmail.com> wrote:

> Hi Aram
>
> May I know why you're moving off from Spark streaming to Samza?
>
> On Tue, Nov 10, 2015 at 11:04 PM, Aram Mkrtchyan <
> aram.mkrtchyan@picsart.com.invalid> wrote:
>
> > Hi Yi,
> > Many thanks! :)
> > It's wonderful ! We really need samza-hdfs module.
> > Thanks to samza being very simple we have been able to create cassandra
> > producer for samza and we can share it if you think it's will be useful
> for
> > others.
> >
> > Thanks.
> >
> > On Wed, Nov 11, 2015 at 9:13 AM, Yi Pan <nickpan47@gmail.com> wrote:
> >
> > > Hi, Aram,
> > >
> > > Welcome to the community! :) We are planning to release 0.10 in this
> > month
> > > and YES HDFS producer is included in this release!
> > >
> > > -Yi
> > >
> > > On Tue, Nov 10, 2015 at 3:18 AM, Aram Mkrtchyan <
> > > aram.mkrtchyan@picsart.com.invalid> wrote:
> > >
> > > > Hi guys,
> > > >
> > > > We are considering to move from spark streaming to Samza and we want
> to
> > > use
> > > > samza as our main stream processor.
> > > > We would like to know when you are planning to release 0.10.0 and
> will
> > > > samza-hdfs be included in that release.
> > > >
> > > > Thanks.
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message