tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mustafa Iman (Jira)" <j...@apache.org>
Subject [jira] [Created] (TEZ-4141) Let Input/Output Processors load local xml configs
Date Fri, 10 Apr 2020 04:01:00 GMT
Mustafa Iman created TEZ-4141:

             Summary: Let Input/Output Processors load local xml configs
                 Key: TEZ-4141
                 URL: https://issues.apache.org/jira/browse/TEZ-4141
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Mustafa Iman
            Assignee: Mustafa Iman

We would like to reduce the amount of configuration going over the wire from a client to application
master. If Input/Output processors load local config files, we can reduce the configuration
overhead when client and the processors have the exact same config on both sides. It is on
user of client to keep the configs same on both sides. Currently, clients have to send all
config in payload. Even if we preload config with local xml files, these should be overridden
by the full config object coming in payload. Therefore, old clients that send all the config
anyway would not be affected in terms of correctness from this change.

This message was sent by Atlassian Jira

View raw message