spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From CodingCat <coding...@apache.org>
Subject is it possible to apply AQE rules only on some of nodes?
Date Mon, 31 Aug 2020 07:40:37 GMT
Hi, Spark devs

I am wondering if it is possible to apply AQE on part of the physical plan?
e.g. I only want to apply coalesce partitions on a
particular ShuffleQueryStageExec?

I didn't find a very straightforward way to achieve this, but is there a
way to workaround the current limitation?

Thanks!

Nan

Mime
View raw message