spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Or (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-19522) --executor-memory flag doesn't work in local-cluster mode
Date Wed, 08 Feb 2017 23:27:42 GMT

     [ https://issues.apache.org/jira/browse/SPARK-19522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Or updated SPARK-19522:
------------------------------
    Description: 
{code}
bin/spark-shell --master local-cluster[2,1,2048]
{code}

doesn't do what you think it does. You'll end up getting executors with 1GB each because that's
the default. This is because the executor memory flag isn't actually read in local mode.

  was:
{code}
bin/spark-shell --master local-cluster[2,1,2048] --executor-memory 2G
{code}

doesn't do what you think it does. You'll end up getting executors with 1GB each because that's
the default. This is because the executor memory flag isn't actually read in local mode.


> --executor-memory flag doesn't work in local-cluster mode
> ---------------------------------------------------------
>
>                 Key: SPARK-19522
>                 URL: https://issues.apache.org/jira/browse/SPARK-19522
>             Project: Spark
>          Issue Type: Bug
>          Components: Deploy
>    Affects Versions: 2.0.0
>            Reporter: Andrew Or
>            Assignee: Andrew Or
>
> {code}
> bin/spark-shell --master local-cluster[2,1,2048]
> {code}
> doesn't do what you think it does. You'll end up getting executors with 1GB each because
that's the default. This is because the executor memory flag isn't actually read in local
mode.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message