samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dan <danharve...@gmail.com>
Subject Re: [DISCUSS] Release 0.10.0
Date Wed, 29 Jul 2015 07:10:42 GMT
I agree SAMZA-741 for the ElasticSearch producer should be in too so we've
got a better API as part of that release.

 - Dan


On 29 July 2015 at 07:51, Yan Fang <yanfang724@gmail.com> wrote:

> Actually, I also want to include a few patch-available features,
> especially:
>
> 1. broadcast stream (SAMZA-676)
>     - waiting for review
>
> 2. graphite support (SAMZA-340)
> 3. meter and histogram (SAMZA-683)
> 4. utility (SAMZA-401)
>     - 2,3,4 belong to Luis, if he does not have time to update, since they
> only need some small changes, we can edit it and get +1 from another
> committer.
>
> 5. hdfs producer (SAMZA-693)
>     - I am reviewing.
>
> 6. upgrade yarn to 2.7.1 (SAMZA-563)
>    - though I am reviewing, this ticket is negotiable if we want to put
> into the 0.10.0 release. If we do not, I think, when users enable the
> worker-persisting and container-persisting features, Samza will not be able
> to handle it. (Some classes are only available after yarn 2.5.0 while Samza
> currently only support yarn 2.4.0)
>
> 7. others: scrooge, class loader isolation, etc.
>     - those are waiting for reviewing too.
>
> My opinion is that, if we can clean up all the patch-available tickets, it
> will be great. Most of them have been already reviewed more than once. So I
> think it should not be very time-consuming to have them in the 0.10.0
> release.
>
> What do you think?
>
> Of course, another must-have is the bug-fix of the Stream Appender. :)
>
> Thanks,
>
> Fang, Yan
> yanfang724@gmail.com
>
> On Tue, Jul 28, 2015 at 10:27 PM, Roger Hoover <roger.hoover@gmail.com>
> wrote:
>
> > Thanks, Yi.
> >
> > I propose that we also include SAMZA-741 for Elasticsearch versioning
> > support with the new ES producer.  I think it's very close to being
> merged.
> >
> > Roger
> >
> >
> > On Tue, Jul 28, 2015 at 10:08 PM, Yi Pan <nickpan47@gmail.com> wrote:
> >
> > > Hi, all,
> > >
> > > I want to start the discussion on the release schedule for 0.10.0.
> There
> > > are a few important features that we plan to release in 0.10.0 and I
> want
> > > to start this thread s.t. we can agree on what to include in 0.10.0
> > > release.
> > >
> > > There are the following main features added in 0.10.0:
> > > - RocksDB TTL support
> > > - Add CoordinatorStream and disable CheckpointManager
> > > - Elasticsearch Producer
> > > - Host affinity
> > > And other 0.10.0 tickets:
> > >
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(%22In%20Progress%22%2C%20Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.10.0
> > >
> > > I propose to cut a 0.10.0 release after we get the following issues
> > > resolved:
> > > - SAMZA-615: Migrate checkpoint from checkpoint topic to Coordinator
> > stream
> > > - SAMZA-617: YARN host affinity in Samza
> > >
> > > Thoughts?
> > >
> > > Thanks!
> > >
> > > -Yi
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message