spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexey Romanchuk <alexey.romanc...@gmail.com>
Subject Re: akka.remote.transport.Transport$InvalidAssociationException: The remote system terminated the association because it is shutting down
Date Tue, 02 Dec 2014 12:38:43 GMT
Any ideas? Anyone got the same error?

On Mon, Dec 1, 2014 at 2:37 PM, Alexey Romanchuk <alexey.romanchuk@gmail.com
> wrote:

> Hello spark users!
>
> I found lots of strange messages in driver log. Here it is:
>
> 2014-12-01 11:54:23,849 [sparkDriver-akka.actor.default-dispatcher-25]
> ERROR
> akka.remote.EndpointWriter[akka://sparkDriver/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FsparkExecutor%40data1.hadoop%3A17372-5/endpointWriter]
> - AssociationError [akka.tcp://sparkDriver@10.54.87.173:55034] <-
> [akka.tcp://sparkExecutor@data1.hadoop:17372]: Error [Shut down address:
> akka.tcp://sparkExecutor@data1.hadoop:17372] [
> akka.remote.ShutDownAssociation: Shut down address:
> akka.tcp://sparkExecutor@data1.hadoop:17372
> Caused by: akka.remote.transport.Transport$InvalidAssociationException:
> The remote system terminated the association because it is shutting down.
> ]
>
> I got this message for every worker twice. First - for driverPropsFetcher
> and next for sparkExecutor. Looks like spark shutdown remote akka system
> incorrectly or there is some race condition in this process and driver sent
> some data to worker, but worker's actor system already in shutdown state.
>
> Except for this message everything works fine. But this is ERROR level
> message and I found it in my "ERROR only" log.
>
> Do you have any idea is it configuration issue, bug in spark or akka or
> something else?
>
> Thanks!
>
>

Mime
View raw message