tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajkumar Singh (Jira)" <j...@apache.org>
Subject [jira] [Created] (TEZ-4254) Don't unset the tez config if both mr and tez config have same value.
Date Wed, 02 Dec 2020 20:22:00 GMT
Rajkumar Singh created TEZ-4254:
-----------------------------------

             Summary: Don't unset the tez config if both mr and tez config have same value.
                 Key: TEZ-4254
                 URL: https://issues.apache.org/jira/browse/TEZ-4254
             Project: Apache Tez
          Issue Type: Bug
    Affects Versions: 0.9.1
            Reporter: Rajkumar Singh


while translated mr config to the tez config we unset config here.
https://github.com/apache/tez/blob/master/tez-mapreduce/src/main/java/org/apache/tez/mapreduce/hadoop/MRHelpers.java#L187

There is no need to unset the config if both mr and tez have same value.

we observed if equivalent of tez config for mapreduce.shuffle.ssl.enabled (tez.runtime.shuffle.ssl.enable)
set to true, we unset the config, this propagate config tez.runtime.shuffle.ssl.enable={mapreduce.shuffle.ssl.enabled}
at runtime and variable substitution does not work correctly in the absence of mrconfig runtime.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message