spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chandan prakash <>
Subject spark streaming: issue with logging with separate log4j properties files for driver and executor
Date Mon, 23 May 2016 11:48:18 GMT
I am able to do logging for driver but not for executor.

I am running spark streaming under mesos.
Want to do log4j logging separately for driver and executor.

Used the below option in spark-submit command :
--conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=file:

Logging for driver at path mentioned as in is happening
But for executor, there is no logging happening (shud be at
/tmp/requestLogExecutor.log as mentioned in
on executor machines)

*Any suggestions how to get logging enabled for executor ?*


Chandan Prakash

View raw message