| Message view | « Date » · « Thread » |
|---|---|
| Top | « Date » · « Thread » |
| From | Trinadh Kaja <ktr.hadoo...@gmail.com> |
| Subject | SPARK PERFORMANCE TUNING |
| Date | Wed, 21 Sep 2016 11:37:23 GMT |
Hi all, how to increase spark performance ,i am using pyspark. cluster info : Total memory :600gb Cores :96 command : spark-submit --master yarn-client --executor-memory 10G --num-executors 50 --executor-cores 2 --driver-memory 10g --queue thequeue please help on this -- Thanks&Regards K.Trinadh Ph-7348826118 | |
| Mime |
|
| View raw message | |