spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: Spark in cluster [ remote.EndpointWriter: AssociationError]
Date Fri, 10 Oct 2014 07:15:11 GMT
Can you paste your spark-env.sh file? Looks like you have it misconfigured.

Thanks
Best Regards

On Fri, Oct 10, 2014 at 1:43 AM, Morbious <knowledgefromgroups@gmail.com>
wrote:

> Hi,
>
> Recently I've configured spark in cluster with zookeper.
> I have 2 masters ( active/standby) and 6 workers.
> I've begun my installation with samples from example directory.
> Everything worked fine when I only used memory .
> When I used word count example I got messages like the ones below:
>
> 14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError
> [akka.tcp://sparkWorker@spark-slave1.domain.org:7078] -> [akka.tcp://
> sparkExecutor@spark-slave1.domain.org:53757]: Error [Association failed
> with [akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]] [
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]
> Caused by:
> akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2:
> Connection refused: spark-slave1.domain.org/10.0.6.228:53757
> ]
> 14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError
> [akka.tcp://sparkWorker@spark-slave1.domain.org:7078] -> [akka.tcp://
> sparkExecutor@spark-slave1.domain.org:53757]: Error [Association failed
> with [akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]] [
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkExecutor@spark-slave1.domain.org:53757]
> Caused by:
> akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2:
> Connection refused: spark-slave1.domain.org/10.0.6.228:53757
> ]
>
> I'm a little confused because I can't find any solution to my problem.
> I use Cloudera hadoop with spark.
>
> Best regards,
>
> Morbious
>

Mime
View raw message