Hi all,

how to increase spark performance ,i am using pyspark.

cluster info :

Total memory :600gb
Cores            :96

command :
spark-submit --master  yarn-client --executor-memory 10G --num-executors 50 --executor-cores 2 --driver-memory 10g --queue thequeue
 

please help on this 

--
Thanks&Regards
K.Trinadh
Ph-7348826118