spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "quanfuwang (JIRA)" <>
Subject [jira] [Created] (SPARK-17984) Add support for numa aware
Date Tue, 18 Oct 2016 02:21:58 GMT
quanfuwang created SPARK-17984:

             Summary: Add support for numa aware
                 Key: SPARK-17984
             Project: Spark
          Issue Type: Task
          Components: Deploy, Mesos, YARN
    Affects Versions: 2.0.1
         Environment: Cluster Topo: 1 Master + 4 Slaves
CPU: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz(72 Cores)
Memory: 128GB(2 NUMA Nodes)
SW Version: Hadoop-5.7.0 + Spark-2.0.0
            Reporter: quanfuwang
             Fix For: 2.0.1

This Jira is target to add support numa aware feature which make can help improve performance
by making core access local memory rather the remote one. 

 A patch is being developed, see
And the whole task includes 3 subtask and will be developed iteratively:
Numa aware support for Yarn based deployment mode
Numa aware support for Mesos based deployment mode
Numa aware support for Standalone based deployment mode

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message