spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Morbious <knowledgefromgro...@gmail.com>
Subject Spark in cluster [ remote.EndpointWriter: AssociationError]
Date Thu, 09 Oct 2014 20:13:41 GMT
Hi,

Recently I've configured spark in cluster with zookeper.
I have 2 masters ( active/standby) and 6 workers.
I've begun my installation with samples from example directory.
Everything worked fine when I only used memory .
When I used word count example I got messages like the ones below:

14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError [akka.tcp://
sparkWorker@spark-slave1.domain.org:7078] -> [akka.tcp://
sparkExecutor@spark-slave1.domain.org:53757]: Error [Association failed
with [akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]] [
akka.remote.EndpointAssociationException: Association failed with
[akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]
Caused by:
akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2:
Connection refused: spark-slave1.domain.org/10.0.6.228:53757
]
14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError [akka.tcp://
sparkWorker@spark-slave1.domain.org:7078] -> [akka.tcp://
sparkExecutor@spark-slave1.domain.org:53757]: Error [Association failed
with [akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]] [
akka.remote.EndpointAssociationException: Association failed with
[akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]
Caused by:
akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2:
Connection refused: spark-slave1.domain.org/10.0.6.228:53757
]

I'm a little confused because I can't find any solution to my problem.
I use Cloudera hadoop with spark.

Best regards,

Morbious

Mime
View raw message