spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yuri Makhno <ymak...@gmail.com>
Subject spark.sql.shuffle.partitions parameter
Date Sat, 03 Jan 2015 20:36:24 GMT
Hello everyone,

I'm using SparkSQL and would like to understand how can I determine right
value for "spark.sql.shuffle.partitions" parameter? For example if I'm
joining two RDDs where first has 10 partitions and second - 60, how big
this parameter should be?

Thank you,
Yuri

Mime
View raw message