[ https://issues.apache.org/jira/browse/SPARK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Óscar Puertas updated SPARK-6321:
---------------------------------
Comment: was deleted
(was: I've created a new pull request fixing this:
https://github.com/apache/spark/pull/5013
Kind regards)
> Adapt the number of partitions used by the Exchange rule to the cluster specifications
> --------------------------------------------------------------------------------------
>
> Key: SPARK-6321
> URL: https://issues.apache.org/jira/browse/SPARK-6321
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.3.1
> Reporter: Óscar Puertas
>
> Currently, the exchange rule is using a default value of 200 fixed partitions. In my
opinion, it would be nice if we can set that default value to something more related to the
cluster specifications instead of a magic number.
> My proposal is to use the default.parallelism value in the Spark configuration.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|