spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Trinadh Kaja <ktr.hadoo...@gmail.com>
Subject SPARK PERFORMANCE TUNING
Date Wed, 21 Sep 2016 11:37:23 GMT
Hi all,

how to increase spark performance ,i am using pyspark.

cluster info :

Total memory :600gb
Cores            :96

command :
spark-submit --master  yarn-client --executor-memory 10G --num-executors 50
--executor-cores 2 --driver-memory 10g --queue thequeue


please help on this

-- 
Thanks&Regards
K.Trinadh
Ph-7348826118

Mime
View raw message