Carson Wang created SPARK-28356:
-----------------------------------
Summary: Do not reduce the number of partitions for repartition in adaptive execution
Key: SPARK-28356
URL: https://issues.apache.org/jira/browse/SPARK-28356
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.0
Reporter: Carson Wang
Adaptive execution reduces the number of post-shuffle partitions at runtime, even for shuffles caused
by repartition. However, the user likely wants to get the desired number of partition when
he calls repartition even in adaptive execution. It will be good to support not changing the
number of post-shuffle partition for repartition in adaptive execution.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|