spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicholas Chammas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-5298) Spark not starting on EC2 using spark-ec2
Date Sat, 17 Jan 2015 20:01:35 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14281514#comment-14281514
] 

Nicholas Chammas commented on SPARK-5298:
-----------------------------------------

A few questions for you:

1. What happens if you try to launch on {{m3.medium}} instances? {{t2.micro}} is not fully
supported by {{spark-ec2}}, as the warning hints at.

The error about Shark is harmless since Shark doesn't exist as of 1.2.0. This error won't
show up anymore in 1.3.0.

The error about Spark is strange since you passed in the version correctly. 2. What happens
if you launch without explicitly setting the version? 3. What happens if you launch into the
{{us-east-1}} region?

> Spark not starting on EC2 using spark-ec2
> -----------------------------------------
>
>                 Key: SPARK-5298
>                 URL: https://issues.apache.org/jira/browse/SPARK-5298
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 1.2.0
>         Environment: I use Spark 1.2.0 + this PR https://github.com/mesos/spark-ec2/pull/76
from my fork https://github.com/grzegorz-dubicki/spark and v4 Spark EC2 script with the same
fix from https://github.com/grzegorz-dubicki/spark-ec2
>            Reporter: Grzegorz Dubicki
>
> Spark doesn't start after creating it with:
> {noformat}
> ./spark-ec2 -k * -i * -s 1 --region=eu-west-1 --instance-type=t2.micro --spark-version=1.2.0
launch test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/f15caf9ff6c96ec69fee)
> ..or after stopping the instances on EC2 via AWS Console and starting the cluster with:
> {noformat}
> ./spark-ec2 -k * -i * --region=eu-west-1 start test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/8b87192b3aa4e0ed028c)
> Please note these errors in launch output:
> {noformat}
> ~/spark-ec2
> Initializing spark
> ~ ~/spark-ec2
> ERROR: Unknown Spark version
> Initializing shark
> ~ ~/spark-ec2 ~/spark-ec2
> ERROR: Unknown Shark version
> {noformat}
> ..and then these in start output:
> {noformat}
> ./spark-standalone/setup.sh: line 26: /root/spark/sbin/stop-all.sh: Nie ma takiego pliku
ani katalogu
> ./spark-standalone/setup.sh: line 31: /root/spark/sbin/start-master.sh: Nie ma takiego
pliku ani katalogu
> ./spark-standalone/setup.sh: line 37: /root/spark/sbin/start-slaves.sh: Nie ma takiego
pliku ani katalogu
> {noformat}
> (the error message is "No such file or directory", in Polish)
> It seems to be related with http://mail-archives.us.apache.org/mod_mbox/spark-user/201412.mbox/%3cCAJ5A9B_U=mDCXYftDkbk+sLJzBCdPcb0qQS83u0grOzfgkcEow@mail.gmail.com%3e
- I also have almost empty Spark and Shark dirs on the master of test2 cluster:
> {noformat}
> root@ip-172-31-7-179 ~]$ ls spark
> conf  work
> root@ip-172-31-7-179 ~]$ ls shark/
> conf
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message