spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From raman gugnani <>
Subject How to get logging right for Spark applications in the YARN ecosystem
Date Thu, 01 Aug 2019 16:47:02 GMT
HI ,

I am looking for right solution for logging the logs produced by the
executors. Most of the places I have seen logging done by log4j properties,
but no where people I have seen any solution where logs are being

Is there anyway I can compress the logs, So that further those logs can be
shipped to S3.

Raman Gugnani

View raw message