spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "haitao .yao" <>
Subject add support for separate GC log files for different executor
Date Wed, 05 Nov 2014 09:53:38 GMT
Hey, guys. Here's my problem:
While using the standalone mode, I always use the following args for

-XX:+PrintGCDetails -XX:+PrintGCDateStamps -verbose:gc

But as we know, hotspot JVM does not support variable substitution on
-Xloggc parameter, which will cause gc log be overwritten by other later

May I create a new path, which will add variable substitution before worker
forks a new executor to avoid GC log overwriteen?

First thoughts: configure the executor jvm args like this:

-XX:+PrintGCDetails -XX:+PrintGCDateStamps -verbose:gc

and this will replace the %applicationId% with the current application ID
and pass the final args into java command line

We can support more variables such as executorId


View raw message