hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "epayne@apache.org" <epa...@apache.org>
Subject Re: [Virtual MEETUP]: Migration to Hadoop 3
Date Thu, 27 Aug 2020 14:28:13 GMT
Wei-Chiu, our plans are tentative at the moment, but we have internally discussed migrating
from 2.10 to 3.2.

And, thank you all again for the great participation, especially those of you in timezones
where it was late in the evening.

-Eric

On Thursday, August 27, 2020, 12:47:43 AM CDT, Wei-Chiu Chuang <weichiu@cloudera.com.invalid>
wrote: 

Thanks Brahma,

Eric, do you have a target Hadoop 3 release line in mind?

The "unofficial" plan here at Cloudera is to rebase our current dev
codebase from Hadoop 3.1.1 to 3.3 some time later. The Hadoop 3.1 code line
will approach its 3rd anniversary by this year's end so perhaps we can
start to sunset it.

On Wed, Aug 26, 2020 at 10:51 AM Brahma Reddy Battula <brahma@apache.org>
wrote:

> One more update from me.
>
> We didn't face any issues with YARN, for HDFS you can have a look at the
> following jira's.
>
> https://issues.apache.org/jira/browse/HDFS-13596
> https://issues.apache.org/jira/browse/HDFS-14396
> https://issues.apache.org/jira/browse/HDFS-14509
>
> Following jira is incompatible for ACL commands.Only hadoop-3 clients will
> work against hadoop-3 server during the upgrade.
>
> https://issues.apache.org/jira/browse/HDFS-6984
>
>
>
> On Wed, Aug 26, 2020 at 11:06 PM Brahma Reddy Battula <brahma@apache.org>
> wrote:
>
> >
> > Hi Eric,
> >
> > check the following references for the same.
> >
> > 01/02/2020 Didi talked about their large scale HDFS cluster upgrade
> > experience.
> >
> > Slides:
> > https://drive.google.com/open?id=1iwJ1asalYfgnOCBuE-RfeG-NpSocjIcy
> >
> > Recording:
> >
> https://cloudera.zoom.us/rec/share/7MF_dLX0339OY5391xvkZP8NLrXieaa8gyZK-fYJnUkGOUUXvaUh5cl_6AVYetQl
> >
> > Didi studied two upgrade approaches from the community documentation:
> > express upgrade and rolling upgrade. Rolling upgrade was selected.
> >
> > Yahoo Japan was trying out from hadoop-2.6 to hadop-3.2.1
> >
> > https://techblog.yahoo.co.jp/entry/20191206786320/
> >
> > On Wed, Aug 26, 2020 at 6:56 PM epayne@apache.org <epayne@apache.org>
> > wrote:
> >
> >> Hello. Just a reminder that today I would like to invite you all to
> >> discuss your
> >> experiences migrating from Hadoop 2 to Hadoop 3.
> >>
> >> -Eric
> >>
> >> On Monday, August 24, 2020, 1:58:37 PM CDT, epayne@apache.org <
> >> epayne@apache.org> wrote:
> >>
> >> Hello everyone!
> >>
> >> We are considering migrating to Hadoop 3, and we would be very
> interested
> >> to
> >> hear about your experiences. If you have migrated from Hadoop 2 to
> Hadoop
> >> 3
> >> and can provide insights, please kindly consider attending the
> following:
> >>
> >> Date: Wednesday, Aug 26, 2020
> >> Time: 10:00 A.M. PDT / 12:00 P.M. CDT / 01:00 P.M. EDT / 05:00 P.M. GMT
> >> Location: Zoom: https://cloudera.zoom.us/j/880548968
> >>
> >> Hope to see you there!
> >>
> >> Thank you!
> >> Eric Payne
> >> @ Verizon Media
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >>
> >>
> >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
>
> --
>
>
>
> --Brahma Reddy Battula
>

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message