samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Navina Ramesh <nram...@linkedin.com.INVALID>
Subject Re: [DISCUSS] Release 0.10.0
Date Wed, 29 Jul 2015 16:57:20 GMT
+1 for StreamAppender bug fix as a mandatory in 0.10.

@Yan: will review SAMZA-676 today and test it out locally.

Thanks!
Navina

On Wed, Jul 29, 2015 at 8:38 AM, Chinmay Soman <chinmay.cerebro@gmail.com>
wrote:

> I can take care of SAMZA-340, SAMZA-683  and will follow up with Luis for
> SAMZA-401,2,3,4
>
> On Wed, Jul 29, 2015 at 12:10 AM, Dan <danharvey42@gmail.com> wrote:
>
> > I agree SAMZA-741 for the ElasticSearch producer should be in too so
> we've
> > got a better API as part of that release.
> >
> >  - Dan
> >
> >
> > On 29 July 2015 at 07:51, Yan Fang <yanfang724@gmail.com> wrote:
> >
> > > Actually, I also want to include a few patch-available features,
> > > especially:
> > >
> > > 1. broadcast stream (SAMZA-676)
> > >     - waiting for review
> > >
> > > 2. graphite support (SAMZA-340)
> > > 3. meter and histogram (SAMZA-683)
> > > 4. utility (SAMZA-401)
> > >     - 2,3,4 belong to Luis, if he does not have time to update, since
> > they
> > > only need some small changes, we can edit it and get +1 from another
> > > committer.
> > >
> > > 5. hdfs producer (SAMZA-693)
> > >     - I am reviewing.
> > >
> > > 6. upgrade yarn to 2.7.1 (SAMZA-563)
> > >    - though I am reviewing, this ticket is negotiable if we want to put
> > > into the 0.10.0 release. If we do not, I think, when users enable the
> > > worker-persisting and container-persisting features, Samza will not be
> > able
> > > to handle it. (Some classes are only available after yarn 2.5.0 while
> > Samza
> > > currently only support yarn 2.4.0)
> > >
> > > 7. others: scrooge, class loader isolation, etc.
> > >     - those are waiting for reviewing too.
> > >
> > > My opinion is that, if we can clean up all the patch-available tickets,
> > it
> > > will be great. Most of them have been already reviewed more than once.
> > So I
> > > think it should not be very time-consuming to have them in the 0.10.0
> > > release.
> > >
> > > What do you think?
> > >
> > > Of course, another must-have is the bug-fix of the Stream Appender. :)
> > >
> > > Thanks,
> > >
> > > Fang, Yan
> > > yanfang724@gmail.com
> > >
> > > On Tue, Jul 28, 2015 at 10:27 PM, Roger Hoover <roger.hoover@gmail.com
> >
> > > wrote:
> > >
> > > > Thanks, Yi.
> > > >
> > > > I propose that we also include SAMZA-741 for Elasticsearch versioning
> > > > support with the new ES producer.  I think it's very close to being
> > > merged.
> > > >
> > > > Roger
> > > >
> > > >
> > > > On Tue, Jul 28, 2015 at 10:08 PM, Yi Pan <nickpan47@gmail.com>
> wrote:
> > > >
> > > > > Hi, all,
> > > > >
> > > > > I want to start the discussion on the release schedule for 0.10.0.
> > > There
> > > > > are a few important features that we plan to release in 0.10.0 and
> I
> > > want
> > > > > to start this thread s.t. we can agree on what to include in 0.10.0
> > > > > release.
> > > > >
> > > > > There are the following main features added in 0.10.0:
> > > > > - RocksDB TTL support
> > > > > - Add CoordinatorStream and disable CheckpointManager
> > > > > - Elasticsearch Producer
> > > > > - Host affinity
> > > > > And other 0.10.0 tickets:
> > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(%22In%20Progress%22%2C%20Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.10.0
> > > > >
> > > > > I propose to cut a 0.10.0 release after we get the following issues
> > > > > resolved:
> > > > > - SAMZA-615: Migrate checkpoint from checkpoint topic to
> Coordinator
> > > > stream
> > > > > - SAMZA-617: YARN host affinity in Samza
> > > > >
> > > > > Thoughts?
> > > > >
> > > > > Thanks!
> > > > >
> > > > > -Yi
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Thanks and regards
>
> Chinmay Soman
>



-- 
Navina R.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message