hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-8013) Support app-tag namespace for allocation tags
Date Thu, 08 Mar 2018 11:28:00 GMT
Weiwei Yang created YARN-8013:

             Summary: Support app-tag namespace for allocation tags
                 Key: YARN-8013
                 URL: https://issues.apache.org/jira/browse/YARN-8013
             Project: Hadoop YARN
          Issue Type: Sub-task
            Reporter: Weiwei Yang
            Assignee: Weiwei Yang

YARN-1461 adds *Application Tag* concept to Yarn applications, user is able to annotate application
with multiple tags to classify apps. We can leverage this to represent a namespace for a certain
group of apps. So instead of calling *app-label*, propose to call it *app-tag*.

A typical use case is,

There are a lot of TF jobs running on Yarn, and some of them are consuming resources heavily.
So we want to limit number of PS on each node for such BIG players but ignore those SMALL
ones. To achieve this, we can do following steps:
 # Add application tag "big-tf" to these big TF jobs
 # For each PS request, we add "ps" source tag and map it to constraint "notin, node, tensorflow/ps"
or "cardinality, node, tensorflow/ps, 0, 2" for finer grained controls.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

View raw message