spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mayank Pradhan <mayank.prad...@workday.com>
Subject Fw: A question about skew join hint
Date Tue, 05 Nov 2019 05:40:58 GMT
watch this thread folks.

@Eugene Koifman<mailto:eugene.koifman@workday.com> if you recall this is the same question
I was asking you earlier.

-Mayank

________________________________
From: zhangliyun <kellyzly@126.com>
Sent: Monday, November 4, 2019 5:21 PM
To: Spark Dev List <dev@spark.apache.org>; user@spark.apache.org <user@spark.apache.org>
Subject: A question about skew join hint


Hi all:
  i saw skewed join hint optimization in  https://docs.azuredatabricks.net/delta/join-performance/skew-join.html.

it  is a great feature to help users to avoid the problem brought from skewed data. My question
1. which version we will have this ? i have not found the feature in the master branch by
key word "+SKEW"
2. the article is under Documentation -> Delta Lake->  Optimizations->  Optimize
Join Performance -> Skew Join Optimization,
   is this feature  only in delta lake?


Best Regards
Kelly  Zhang





Mime
View raw message