spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: number of executors
Date Sun, 17 May 2015 15:16:51 GMT
Did you try --executor-cores param? While you submit the job, do a ps aux |
grep spark-submit and see the exact command parameters.

Thanks
Best Regards

On Sat, May 16, 2015 at 12:31 PM, xiaohe lan <zombiexcoder@gmail.com> wrote:

> Hi,
>
> I have a 5 nodes yarn cluster, I used spark-submit to submit a simple app.
>
>  spark-submit --master yarn target/scala-2.10/simple-project_2.10-1.0.jar
> --class scala.SimpleApp --num-executors 5
>
> I have set the number of executor to 5, but from sparkui I could see only
> two executors and it ran very slow. What did I miss ?
>
> Thanks,
> Xiaohe
>

Mime
View raw message