spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Vogel (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-6403) Launch master as spot instance on EC2
Date Wed, 18 Mar 2015 19:14:38 GMT
Adam Vogel created SPARK-6403:
---------------------------------

             Summary: Launch master as spot instance on EC2
                 Key: SPARK-6403
                 URL: https://issues.apache.org/jira/browse/SPARK-6403
             Project: Spark
          Issue Type: New Feature
          Components: EC2
    Affects Versions: 1.2.1
            Reporter: Adam Vogel
            Priority: Minor
             Fix For: 1.2.1


Currently the spark_ec2.py script only supports requesting slaves as spot instances. Launching
the master as a spot instance has potential cost savings, at the risk of losing the Spark
cluster without warning. Unless users include logic for relaunching slaves when lost, it is
usually the case that all slaves are lost simultaneously. Thus, for jobs which do not require
resilience to losing spot instances, being able to launch the master as a spot instance saves
money.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message