spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toby Douglass <t...@avocet.io>
Subject spark EC2 bring-up problems
Date Thu, 12 Jun 2014 19:38:19 GMT
Gents,

I have been bringing up a cluster on EC2 using the spark_ec2.py script.

This works if the cluster has a single slave.

This fails if the cluster has sixteen slaves, during the work to transfer
the SSH key to the slaves.  I cannot currently bring up a large cluster.

Can anyone shed any light on this issue?

As an aside, that script does not work out of the box in Amazon EC2
instances.  Python 2.7 must be installed, and then boto for 2.7.

Mime
View raw message