spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mikhailau, Alex" <Alex.Mikhai...@mlb.com>
Subject Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements?
Date Mon, 28 Aug 2017 20:43:45 GMT
Does anyone have a working solution for logging YARN application id, YARN container hostname,
Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Are there
specific ENV variables available or other workflow for doing that?

Thank you

Alex
Mime
View raw message