hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-7157) Expose the API for upstream applications to pass in a caller context to MR
Date Fri, 02 Nov 2018 22:41:00 GMT
Aihua Xu created MAPREDUCE-7157:
-----------------------------------

             Summary: Expose the API for upstream applications to pass in a caller context
to MR
                 Key: MAPREDUCE-7157
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7157
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Aihua Xu


YARN-4349 adds the callerContext support to Yarn so Yarn job id (or attempt id) is logged
into hdfs audit log when the job accesses the HDFS, while it's still hard to figure out the
original client from audit log, e.g., when hive submits a job to MR, it would be very helpful
to log hive queryId as well. both TEZ engine (TEZ-2851) and spark (SPARK-16759) have implemented
such function.  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org


Mime
View raw message