tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [tez] mustafaiman opened a new pull request #64: TEZ-4137: Input/Output/Processor should merge payload to local conf
Date Tue, 21 Apr 2020 22:53:58 GMT

mustafaiman opened a new pull request #64:
URL: https://github.com/apache/tez/pull/64


   Runtime components do not have access to session config. Because of that, we have to send
all config options to every task eventhough a large part of the configs are in session config,
just not accessible to the task. This patch makes it accessible to the tasks. All input/output/processor
s can merge their user payload config to this session config. Therefore, we can send less
bytes over the wire, saving time in serializing and transmitting configs client-to-am and
am-to-task communication.
   
   Change-Id: I8cc0d17deec1e03793b884fd05460e3e69afab6a


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



Mime
View raw message