spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Or (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-19522) --executor-memory flag doesn't work in local-cluster mode
Date Wed, 08 Feb 2017 22:44:41 GMT
Andrew Or created SPARK-19522:
---------------------------------

             Summary: --executor-memory flag doesn't work in local-cluster mode
                 Key: SPARK-19522
                 URL: https://issues.apache.org/jira/browse/SPARK-19522
             Project: Spark
          Issue Type: Bug
          Components: Deploy
    Affects Versions: 2.0.0
            Reporter: Andrew Or
            Assignee: Andrew Or


{code}
bin/spark-shell --master local-cluster[2,1,2048] --executor-memory 2G
{code}

doesn't do what you think it does. You'll end up getting executors with 1GB each because that's
the default. This is because the executor memory flag isn't actually read in local mode.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message