hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Naganarasimha Garla <naganarasimha...@apache.org>
Subject Re: [Vote] Merge discussion for Node attribute support feature YARN-3409
Date Wed, 12 Sep 2018 20:28:39 GMT
Thanks for reporting Sean and Sunil for acting on it. My bad i had used
alias to compile which was skipping the javadoc !
Will try to commit as soon as the jenkins results are out.

On Thu, Sep 13, 2018 at 1:18 AM Sunil G <sunilg@apache.org> wrote:

> Thanks Sean
>
> YARN-8768 is raised and we will get this in very soon.
>
> - Sunil
>
> On Wed, Sep 12, 2018 at 9:16 PM Sean Mackrory <mackrorysd@gmail.com>
> wrote:
>
>> `mvn install` fails on trunk right now due to javadoc error in yarn-api.
>> Is
>> that related? If so, can we revert or fix ASAP please?
>>
>> On Wed, Sep 12, 2018 at 6:05 AM Naganarasimha Garla <
>> naganarasimha_gr@apache.org> wrote:
>>
>> > Hi All,
>> >          Me and Sunil have successfully merged YARN-3409 to the trunk
>> and
>> > we have created new umbrella jira YARN-8766 to track the pending jiras
>> and
>> > the remaining planned improvement features.
>> > Thanks all for the support !
>> >
>> > Regards,
>> > + Naga
>> >
>> >
>> > On Wed, Sep 12, 2018 at 7:46 AM Naganarasimha Garla <
>> > naganarasimha_gr@apache.org> wrote:
>> >
>> > > Hi All,
>> > >          Voting has been running since 6 days and adding my vote we
>> have
>> > 4
>> > > binding and 2 non binding +1's with no -1's this voting passes and we
>> > will
>> > > be merging the branch shortly. Thanks for all who participated in the
>> > > discussion and voting thread !
>> > >
>> > > Thanks and Regards,
>> > > + Naga
>> > >
>> > > On Mon, Sep 10, 2018 at 2:50 PM Zian Chen <zchen@hortonworks.com>
>> wrote:
>> > >
>> > >> +1 for merge.
>> > >>
>> > >> > On Sep 9, 2018, at 10:47 PM, Weiwei Yang <abvclouds@gmail.com>
>> wrote:
>> > >> >
>> > >> > +1 for the merge
>> > >> >
>> > >> > On Mon, Sep 10, 2018 at 12:06 PM Rohith Sharma K S <
>> > >> > rohithsharmaks@apache.org> wrote:
>> > >> >
>> > >> >> +1 for merge
>> > >> >>
>> > >> >> -Rohith Sharma K S
>> > >> >>
>> > >> >> On Wed, 5 Sep 2018 at 18:01, Naganarasimha Garla <
>> > >> >> naganarasimha_gr@apache.org> wrote:
>> > >> >>
>> > >> >>> Hi All,
>> > >> >>>        Thanks for feedback folks, based on the positive
response
>> > >> >> starting
>> > >> >>> a Vote thread for merging YARN-3409 to master.
>> > >> >>>
>> > >> >>> Regards,
>> > >> >>> + Naga & Sunil
>> > >> >>>
>> > >> >>> On Wed, 5 Sep 2018 2:51 am Wangda Tan, <wheeleast@gmail.com>
>> wrote:
>> > >> >>>
>> > >> >>>> +1 for the merge, it gonna be a great addition to
3.2.0 release.
>> > >> Thanks
>> > >> >>> to
>> > >> >>>> everybody for pushing this feature to complete.
>> > >> >>>>
>> > >> >>>> Best,
>> > >> >>>> Wangda
>> > >> >>>>
>> > >> >>>> On Tue, Sep 4, 2018 at 8:25 AM Bibinchundatt <
>> > >> >> bibin.chundatt@huawei.com>
>> > >> >>>> wrote:
>> > >> >>>>
>> > >> >>>>> +1 for merge. Fetaure would be a good addition
to 3.2 release.
>> > >> >>>>>
>> > >> >>>>> --------------------------------------------------
>> > >> >>>>> Bibin A Chundatt
>> > >> >>>>> M: +91-9742095715 <+91%2097420%2095715><tel:+91-9742095715>
>> > >> >>>>> E: bibin.chundatt@huawei.com<mailto:bibin.chundatt@huawei.com>
>> > >> >>>>> 2012<tel:2012>实验室-印研IT&Cloud
BU分部
>> > >> >>>>> 2012<tel:2012> Laboratories-IT&Cloud
BU Branch Dept.
>> > >> >>>>> From:Naganarasimha Garla
>> > >> >>>>> To:common-dev@hadoop.apache.org,Hdfs-dev,
>> > yarn-dev@hadoop.apache.org
>> > >> ,
>> > >> >>>>> mapreduce-dev@hadoop.apache.org,
>> > >> >>>>> Date:2018-08-29 20:00:44
>> > >> >>>>> Subject:[Discuss] Merge discussion for Node attribute
support
>> > >> feature
>> > >> >>>>> YARN-3409
>> > >> >>>>>
>> > >> >>>>> Hi All,
>> > >> >>>>>
>> > >> >>>>> We would like to hear your thoughts on merging
“Node Attributes
>> > >> >> Support
>> > >> >>> in
>> > >> >>>>> YARN” branch (YARN-3409) [2] into trunk in a
few weeks. The
>> goal
>> > is
>> > >> to
>> > >> >>> get
>> > >> >>>>> it in for HADOOP 3.2.
>> > >> >>>>>
>> > >> >>>>> *Major work happened in this branch*
>> > >> >>>>>
>> > >> >>>>> YARN-6858. Attribute Manager to store and provide
node
>> attributes
>> > in
>> > >> >> RM
>> > >> >>>>> YARN-7871. Support Node attributes reporting from
NM to RM(
>> > >> >> distributed
>> > >> >>>>> node attributes)
>> > >> >>>>> YARN-7863. Modify placement constraints to support
node
>> attributes
>> > >> >>>>> YARN-7875. Node Attribute store for storing and
recovering
>> > >> attributes
>> > >> >>>>>
>> > >> >>>>> *Detailed Design:*
>> > >> >>>>>
>> > >> >>>>> Please refer [1] for detailed design document.
>> > >> >>>>>
>> > >> >>>>> *Testing Efforts:*
>> > >> >>>>>
>> > >> >>>>> We did detailed tests for the feature in the last
few weeks.
>> > >> >>>>> This feature will be enabled only when Node Attributes
>> constraints
>> > >> are
>> > >> >>>>> specified through SchedulingRequest from AM.
>> > >> >>>>> Manager implementation will help to store and
recover Node
>> > >> Attributes.
>> > >> >>>>> This
>> > >> >>>>> works with existing placement constraints.
>> > >> >>>>>
>> > >> >>>>> *Regarding to API stability:*
>> > >> >>>>>
>> > >> >>>>> All newly added @Public APIs are @Unstable.
>> > >> >>>>>
>> > >> >>>>> Documentation jira [3] could help to provide detailed
>> > configuration
>> > >> >>>>> details. This feature works from end-to-end and
we tested this
>> in
>> > >> our
>> > >> >>>>> local
>> > >> >>>>> cluster. Branch code is run against trunk and
tracked via [4].
>> > >> >>>>>
>> > >> >>>>> We would love to get your thoughts before opening
a voting
>> thread.
>> > >> >>>>>
>> > >> >>>>> Special thanks to a team of folks who worked hard
and
>> contributed
>> > >> >>> towards
>> > >> >>>>> this efforts including design discussion / patch
/ reviews,
>> etc.:
>> > >> >> Weiwei
>> > >> >>>>> Yang, Bibin Chundatt, Wangda Tan, Vinod Kumar
Vavilappali,
>> > >> >> Konstantinos
>> > >> >>>>> Karanasos, Arun Suresh, Varun Saxena, Devaraj
Kavali, Lei Guo,
>> > Chong
>> > >> >>> Chen.
>> > >> >>>>>
>> > >> >>>>> [1] :
>> > >> >>>>>
>> > >> >>>>>
>> > >> >>>
>> > >> >>
>> > >>
>> >
>> https://issues.apache.org/jira/secure/attachment/12937633/Node-Attributes-Requirements-Design-doc_v2.pdf
>> > >> >>>>> [2] : https://issues.apache.org/jira/browse/YARN-3409
>> > >> >>>>> [3] : https://issues.apache.org/jira/browse/YARN-7865
>> > >> >>>>> [4] : https://issues.apache.org/jira/browse/YARN-8718
>> > >> >>>>>
>> > >> >>>>> Thanks,
>> > >> >>>>> + Naga & Sunil Govindan
>> > >> >>>>>
>> > >> >>>>
>> > >> >>>
>> > >> >>
>> > >> >
>> > >> >
>> > >> > --
>> > >> > Weiwei Yang
>> > >>
>> > >>
>> >
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message