spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Tretyakov <>
Subject Is there a way to provide individual property to each Spark executor?
Date Thu, 02 Oct 2014 12:25:14 GMT
Hi, here in Sematext we almost done with Spark monitoring

But we need 1 thing from Spark, something like!topic/storm-user/2fNCF341yqU in Storm.

Something like 'placeholder' in java opts which Spark will fills for
executor, with executorId (0,1,2,3...).

For example I will write in spark-defaults.conf:


and will get in executor processes:

Can I do something like that in Spark for executor? If not maybe it can be
done in the future? Will be useful.

Thx, best redgards, Vladimir Tretyakov.

View raw message