spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wenlei Xie <wenlei....@gmail.com>
Subject spark.storage.blockManagerHeartBeatMs flag
Date Thu, 12 Sep 2013 08:02:53 GMT
Hi,

I am seeing something like
     Removing BlockManager xxx with no recent heart beats: 52913ms exceeds
45000ms.

 I think probably it is because of GC (from the GC log, some Full GC would
take 50s-60s). I am wondering should I increase this threshold?

>From https://github.com/mesos/spark/pull/640, it looks like there is
no spark.storage.blockManagerHeartBeatMs flag in 0.8. I am wondering how
should I set it then? Directly set the timeout threshold?

Thank you!

Best,
Wenlei

Mime
View raw message