spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Or <and...@databricks.com>
Subject Re: Lost executors
Date Wed, 23 Jul 2014 18:07:43 GMT
Hi Eric,

Have you checked the executor logs? It is possible they died because of
some exception, and the message you see is just a side effect.

Andrew


2014-07-23 8:27 GMT-07:00 Eric Friedman <eric.d.friedman@gmail.com>:

> I'm using spark 1.0.1 on a quite large cluster, with gobs of memory, etc.
>  Cluster resources are available to me via Yarn and I am seeing these
> errors quite often.
>
> ERROR YarnClientClusterScheduler: Lost executor 63 on <host>: remote Akka
> client disassociated
>
>
> This is in an interactive shell session.  I don't know a lot about Yarn
> plumbing and am wondering if there's some constraint in play -- executors
> can't be idle for too long or they get cleared out.
>
>
> Any insights here?
>

Mime
View raw message