hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Hung <jyhung2...@gmail.com>
Subject Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)
Date Wed, 23 Oct 2019 17:48:25 GMT
Hi Eric, thanks for trying it out. We talked about this in today's YARN
community sync up, summarizing here for everyone else:

I don't think it's worth delaying the 2.10.0 release further, we can
address this in a subsequent 2.10.x release. Wangda mentioned it might be
related to changes in dominant resource calculator, but root cause remains
to be seen.

Jonathan Hung


On Wed, Oct 23, 2019 at 9:02 AM epayne@apache.org <epayne@apache.org> wrote:

> Hi Jonathan,
>
> Thanks very much for all of your work on this release.
>
> I have a concern about cross-queue (inter-queue) preemption in 2.10.
>
> In 2.8, on a 6 node pseudo-cluster, preempting from one queue to meet the
> needs of another queue seems to work as expected. However, 2.10 in the same
> pseudo-cluster (with the same config properties), only one container was
> preempted for the AM and then nothing else.
>
> I don't know how the community feels about holding up the 2.10.0 release
> for this issue, but we need to get to the bottom of this before we can go
> to 2.10.x. I am still investigating.
>
> Thanks,
> -Eric
>
>
>
>
>  On Tuesday, October 22, 2019, 4:55:29 PM CDT, Jonathan Hung <
> jyhung2357@gmail.com> wrote:
> > Hi folks,
> >
> > This is the second release candidate for the first release of Apache
> Hadoop
> > 2.10 line. It contains 362 fixes/improvements since 2.9 [1]. It includes
> > features such as:
> >
> > - User-defined resource types
> > - Native GPU support as a schedulable resource type
> > - Consistent reads from standby node
> > - Namenode port based selective encryption
> > - Improvements related to rolling upgrade support from 2.x to 3.x
> > - Cost based fair call queue
> >
> > The RC1 artifacts are at:
> http://home.apache.org/~jhung/hadoop-2.10.0-RC1/
> >
> > RC tag is release-2.10.0-RC1.
> >
> > The maven artifacts are hosted here:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1243/
> >
> > My public key is available here:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The vote will run for 5 weekdays, until Tuesday, October 29 at 3:00 pm
> PDT.
> >
> > Thanks,
> > Jonathan Hung
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message