spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carson Wang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-28356) Do not reduce the number of partitions for repartition in adaptive execution
Date Thu, 11 Jul 2019 22:27:00 GMT
Carson Wang created SPARK-28356:
-----------------------------------

             Summary: Do not reduce the number of partitions for repartition in adaptive execution
                 Key: SPARK-28356
                 URL: https://issues.apache.org/jira/browse/SPARK-28356
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Carson Wang


Adaptive execution reduces the number of post-shuffle partitions at runtime, even for shuffles caused
by repartition. However, the user likely wants to get the desired number of partition when
he calls repartition even in adaptive execution. It will be good to support not changing the
number of post-shuffle partition for repartition in adaptive execution.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message