spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Braithwaite (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-13005) Don't require spark.shuffle.service.port to be set on job conf
Date Tue, 26 Jan 2016 19:13:39 GMT
Alan Braithwaite created SPARK-13005:
----------------------------------------

             Summary: Don't require spark.shuffle.service.port to be set on job conf
                 Key: SPARK-13005
                 URL: https://issues.apache.org/jira/browse/SPARK-13005
             Project: Spark
          Issue Type: Improvement
          Components: Block Manager, Shuffle
    Affects Versions: 1.6.0
            Reporter: Alan Braithwaite


It appears that the shuffle client gets the external service port from the spark properties
instead of discovering it from the driver or the master.

Not sure how this can be made cleaner, but when you're dynamically allocating ports for things
like the shuffle service, it becomes a pain.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message