tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [tez] mustafaiman opened a new pull request #64: TEZ-4137: Input/Output/Processor should merge payload to local conf
Date Tue, 21 Apr 2020 22:53:58 GMT

mustafaiman opened a new pull request #64:
URL: https://github.com/apache/tez/pull/64

   Runtime components do not have access to session config. Because of that, we have to send
all config options to every task eventhough a large part of the configs are in session config,
just not accessible to the task. This patch makes it accessible to the tasks. All input/output/processor
s can merge their user payload config to this session config. Therefore, we can send less
bytes over the wire, saving time in serializing and transmitting configs client-to-am and
am-to-task communication.
   Change-Id: I8cc0d17deec1e03793b884fd05460e3e69afab6a

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:

View raw message