hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arpit Agarwal <aagar...@hortonworks.com>
Subject Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)
Date Mon, 02 Apr 2018 20:37:33 GMT
Thanks for putting together this RC, Wangda.

The guidance from Apache is to omit MD5s, specifically:
  > SHOULD NOT supply a MD5 checksum file (because MD5 is too broken).


On Apr 2, 2018, at 7:03 AM, Wangda Tan <wheeleast@gmail.com<mailto:wheeleast@gmail.com>>

Hi Gera,

It's my bad, I thought only src/bin tarball is enough.

I just uploaded all other things under artifact/ to

Please let me know if you have any other comments.


On Mon, Apr 2, 2018 at 12:50 AM, Gera Shegalov <gera05@gmail.com> wrote:

Thanks, Wangda!

There are many more artifacts in previous votes, e.g., see
http://home.apache.org/~junping_du/hadoop-2.8.3-RC0/ .  Among others the
site tarball is missing.

On Sun, Apr 1, 2018 at 11:54 PM Sunil G <sunilg@apache.org> wrote:

Thanks Wangda for initiating the release.

I tested this RC built from source file.

  - Tested MR apps (sleep, wc) and verified both new YARN UI and old RM
  - Below feature sanity is done
     - Application priority
     - Application timeout
     - Intra Queue preemption with priority based
     - DS based affinity tests to verify placement constraints.
  - Tested basic NodeLabel scenarios.
     - Added couple of labels to few of nodes and behavior is coming
     - Verified old UI  and new YARN UI for labels.
     - Submitted apps to labelled cluster and it works fine.
     - Also performed few cli commands related to nodelabel.
  - Test basic HA cases and seems correct.
  - Tested new YARN UI . All pages are getting loaded correctly.

- Sunil

On Fri, Mar 30, 2018 at 9:45 AM Wangda Tan <wheeleast@gmail.com> wrote:

Hi folks,

Thanks to the many who helped with this release since Dec 2017 [1].
created RC1 for Apache Hadoop 3.1.0. The artifacts are available here:


The RC tag in git is release-3.1.0-RC1. Last git commit SHA is

The maven artifacts are available via repository.apache.org at
This vote will run 5 days, ending on Apr 3 at 11:59 pm Pacific.

3.1.0 contains 766 [2] fixed JIRA issues since 3.0.0. Notable additions
include the first class GPU/FPGA support on YARN, Native services,
rich placement constraints in YARN, S3-related enhancements, allow HDFS
block replicas to be provided by an external storage system, etc.

For 3.1.0 RC0 vote discussion, please see [3].

We’d like to use this as a starting release for 3.1.x [1], depending on
it goes, get it stabilized and potentially use a 3.1.1 in several weeks
the stable release.

We have done testing with a pseudo cluster:
- Ran distributed job.
- GPU scheduling/isolation.
- Placement constraints (intra-application anti-affinity) by using
distributed shell.

My +1 to start.



[2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.0)
AND fixVersion not in (3.0.0, 3.0.0-beta1) AND status = Resolved ORDER
fixVersion ASC


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message