hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-7226) Whitelisted variables do not support delayed variable expansion
Date Wed, 20 Sep 2017 14:11:00 GMT
Jason Lowe created YARN-7226:
--------------------------------

             Summary: Whitelisted variables do not support delayed variable expansion
                 Key: YARN-7226
                 URL: https://issues.apache.org/jira/browse/YARN-7226
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 3.0.0-alpha4, 2.8.1, 2.9.0
            Reporter: Jason Lowe
            Assignee: Jason Lowe


The nodemanager supports a configurable list of environment variables, via yarn.nodemanager.env-whitelist,
that will be propagated to the container's environment unless those variables were specified
in the container launch context.  Unfortunately the handling of these whitelisted variables
prevents using delayed variable expansion.  For example, if a user shipped their own version
of hadoop with their job via the distributed cache and specified:
{noformat}
HADOOP_COMMON_HOME={{PWD}}/my-private-hadoop/
{noformat}
 as part of their job, the variable will be set as the *literal* string:
{noformat}
$PWD/my-private-hadoop/
{noformat}
rather than having $PWD expand to the container's current directory as it does for any other,
non-whitelisted variable being set to the same value.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message