spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ji ZHANG <zhangj...@gmail.com>
Subject Executor Log Rotation Is Not Working?
Date Tue, 04 Nov 2014 04:24:11 GMT
Hi,

I'm using Spark Streaming 1.1, and I have the following logs keep growing:

/opt/spark-1.1.0-bin-cdh4/work/app-20141029175309-0005/2/stderr

I think it is executor log, so I setup the following options in
spark-defaults.conf:

spark.executor.logs.rolling.strategy time
spark.executor.logs.rolling.time.interval daily
spark.executor.logs.rolling.maxRetainedFiles 10

I can see these options on Web UI, so I suppose they are effective.
However, the stderr is still not rotated.

Am I doing wrong?

Thanks.

-- 
Jerry

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message