spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dillian Murphey <crackshotm...@gmail.com>
Subject Master is listing DEAD slaves, can they be cleaned up?
Date Wed, 02 Dec 2015 00:12:55 GMT
On the status page on port 8080 I see the slaves that have been stopped.
They are marked as DEAD.  If I implement an autoscaling system on aws,
which is the plan, then I can see there be hundreds of slaves going up and
down.

Is there a way to force a cleanup of dead slaves so they are not piling up?
Or will they be cleaned automatically after a time??

Thanks

Mime
View raw message