Andrew Or created SPARK-19522:
---------------------------------
Summary: --executor-memory flag doesn't work in local-cluster mode
Key: SPARK-19522
URL: https://issues.apache.org/jira/browse/SPARK-19522
Project: Spark
Issue Type: Bug
Components: Deploy
Affects Versions: 2.0.0
Reporter: Andrew Or
Assignee: Andrew Or
{code}
bin/spark-shell --master local-cluster[2,1,2048] --executor-memory 2G
{code}
doesn't do what you think it does. You'll end up getting executors with 1GB each because that's
the default. This is because the executor memory flag isn't actually read in local mode.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|