spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Or (JIRA)" <>
Subject [jira] [Created] (SPARK-19522) --executor-memory flag doesn't work in local-cluster mode
Date Wed, 08 Feb 2017 22:44:41 GMT
Andrew Or created SPARK-19522:

             Summary: --executor-memory flag doesn't work in local-cluster mode
                 Key: SPARK-19522
             Project: Spark
          Issue Type: Bug
          Components: Deploy
    Affects Versions: 2.0.0
            Reporter: Andrew Or
            Assignee: Andrew Or

bin/spark-shell --master local-cluster[2,1,2048] --executor-memory 2G

doesn't do what you think it does. You'll end up getting executors with 1GB each because that's
the default. This is because the executor memory flag isn't actually read in local mode.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message