hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tao Yang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-8925) Updating distributed node attributes only when necessary
Date Mon, 22 Oct 2018 06:56:00 GMT
Tao Yang created YARN-8925:

             Summary: Updating distributed node attributes only when necessary
                 Key: YARN-8925
                 URL: https://issues.apache.org/jira/browse/YARN-8925
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: resourcemanager
    Affects Versions: 3.2.1
            Reporter: Tao Yang
            Assignee: Tao Yang

Currently if distributed node attributes exist, even though there is no change, updating for
distributed node attributes will happen in every heartbeat between NM and RM. Updating process
will hold NodeAttributesManagerImpl#writeLock and may have some influence in a large cluster.
We have found nodes UI of a large cluster is opened slowly and most time it's waiting for
the lock in NodeAttributesManagerImpl. I think this updating should be called only when necessary
to enhance the performance of related process.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

View raw message