spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siva <sbhavan...@gmail.com>
Subject Re: spark-submit is ignoring "--executor-cores"
Date Tue, 22 Dec 2015 18:48:17 GMT
Thanks a lot Saisai and Zhan, I see DefaultResourceCalculator currently
being used for Capacity scheduler. We will change it to
DominantResourceCalculator.

Thanks,
Sivakumar Bhavanari.

On Mon, Dec 21, 2015 at 5:56 PM, Zhan Zhang <zzhang@hortonworks.com> wrote:

> BTW: It is not only a Yarn-webui issue. In capacity scheduler, vcore is
> ignored. If you want Yarn to honor vcore requests, you have to
> use DominantResourceCalculator as Saisai suggested.
>
> Thanks.
>
> Zhan Zhang
>
> On Dec 21, 2015, at 5:30 PM, Saisai Shao <sai.sai.shao@gmail.com> wrote:
>
>  and you'll see the right vcores y
>
>
>

Mime
View raw message