spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ji ZHANG <>
Subject Executor Log Rotation Is Not Working?
Date Tue, 04 Nov 2014 04:24:11 GMT

I'm using Spark Streaming 1.1, and I have the following logs keep growing:


I think it is executor log, so I setup the following options in

spark.executor.logs.rolling.strategy time
spark.executor.logs.rolling.time.interval daily
spark.executor.logs.rolling.maxRetainedFiles 10

I can see these options on Web UI, so I suppose they are effective.
However, the stderr is still not rotated.

Am I doing wrong?



To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message