spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From raman gugnani <ramangugnani....@gmail.com>
Subject How to get logging right for Spark applications in the YARN ecosystem
Date Thu, 01 Aug 2019 16:47:02 GMT
HI ,

I am looking for right solution for logging the logs produced by the
executors. Most of the places I have seen logging done by log4j properties,
but no where people I have seen any solution where logs are being
compressed.

Is there anyway I can compress the logs, So that further those logs can be
shipped to S3.

-- 
Raman Gugnani

Mime
View raw message