hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zhankun tang <tangzhan...@gmail.com>
Subject Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1
Date Tue, 15 Jan 2019 05:48:41 GMT
Thanks for the great work, Sunil!

+1(non-binding)

- Use the tarball and set up a one node cluster
- Run basic wordcount and DS
- Run some Submarine job which utilizes Docker

Non-blocker:
The Submarine job needs a yarn service dependency ready before it can run
successfully. The trunk has no such issue.
Users can work around this per YARN-9190 (run a service example or certain
service command can set up the dependency).

Best Regards,
Zhankun

On Tue, 15 Jan 2019 at 02:26, Virajith Jalaparti <virajith.j@gmail.com>
wrote:

> Thanks Sunil and others who have worked on the making this release happen!
>
> +1 (non-binding)
>
> - Built from source
> - Deployed a pseudo-distributed one node cluster
> - Ran basic wordcount, sort, pi jobs
> - Basic HDFS/WebHDFS commands
> - Ran all the ABFS driver tests against an ADLS Gen 2 account in EAST US
>
> Non-blockers (AFAICT): The following tests in ABFS (HADOOP-15407) fail:
> - For ACLs ({{ITestAzureBlobFilesystemAcl}}) -- However, I believe these
> have been fixed in trunk.
> -
> {{ITestAzureBlobFileSystemE2EScale#testWriteHeavyBytesToFileAcrossThreads}}
> fails with an OutOfMemoryError exception. I see the same failure on trunk
> as well.
>
>
> On Mon, Jan 14, 2019 at 6:21 AM Elek, Marton <elek@apache.org> wrote:
>
> > Thanks Sunil to manage this release.
> >
> > +1 (non-binding)
> >
> > 1. built from the source (with clean local maven repo)
> > 2. verified signatures + checksum
> > 3. deployed 3 node cluster to Google Kubernetes Engine with generated
> > k8s resources [1]
> > 4. Executed basic HDFS commands
> > 5. Executed basic yarn example jobs
> >
> > Marton
> >
> > [1]: FTR: resources:
> > https://github.com/flokkr/k8s/tree/master/examples/hadoop , generator:
> > https://github.com/elek/flekszible
> >
> >
> > On 1/8/19 12:42 PM, Sunil G wrote:
> > > Hi folks,
> > >
> > >
> > > Thanks to all of you who helped in this release [1] and for helping to
> > vote
> > > for RC0. I have created second release candidate (RC1) for Apache
> Hadoop
> > > 3.2.0.
> > >
> > >
> > > Artifacts for this RC are available here:
> > >
> > > http://home.apache.org/~sunilg/hadoop-3.2.0-RC1/
> > >
> > >
> > > RC tag in git is release-3.2.0-RC1.
> > >
> > >
> > >
> > > The maven artifacts are available via repository.apache.org at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1178/
> > >
> > >
> > > This vote will run 7 days (5 weekdays), ending on 14th Jan at 11:59 pm
> > PST.
> > >
> > >
> > >
> > > 3.2.0 contains 1092 [2] fixed JIRA issues since 3.1.0. Below feature
> > > additions
> > >
> > > are the highlights of this release.
> > >
> > > 1. Node Attributes Support in YARN
> > >
> > > 2. Hadoop Submarine project for running Deep Learning workloads on YARN
> > >
> > > 3. Support service upgrade via YARN Service API and CLI
> > >
> > > 4. HDFS Storage Policy Satisfier
> > >
> > > 5. Support Windows Azure Storage - Blob file system in Hadoop
> > >
> > > 6. Phase 3 improvements for S3Guard and Phase 5 improvements S3a
> > >
> > > 7. Improvements in Router-based HDFS federation
> > >
> > >
> > >
> > > Thanks to Wangda, Vinod, Marton for helping me in preparing the
> release.
> > >
> > > I have done few testing with my pseudo cluster. My +1 to start.
> > >
> > >
> > >
> > > Regards,
> > >
> > > Sunil
> > >
> > >
> > >
> > > [1]
> > >
> > >
> >
> https://lists.apache.org/thread.html/68c1745dcb65602aecce6f7e6b7f0af3d974b1bf0048e7823e58b06f@%3Cyarn-dev.hadoop.apache.org%3E
> > >
> > > [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.2.0)
> > > AND fixVersion not in (3.1.0, 3.0.0, 3.0.0-beta1) AND status = Resolved
> > > ORDER BY fixVersion ASC
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message