spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yin Huai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-6377) Set the number of shuffle partitions automatically based on the size of input tables and the reduce-side operation.
Date Tue, 17 Mar 2015 03:51:38 GMT
Yin Huai created SPARK-6377:
-------------------------------

             Summary: Set the number of shuffle partitions automatically based on the size
of input tables and the reduce-side operation.
                 Key: SPARK-6377
                 URL: https://issues.apache.org/jira/browse/SPARK-6377
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Yin Huai


It will be helpful to automatically set the number of shuffle partitions based on the size
of input tables and the operation at the reduce side for an Exchange operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message