spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jörn Franke <jornfra...@gmail.com>
Subject Re: Spark on Yarn, is it possible to manually blacklist nodes before running spark job?
Date Tue, 22 Jan 2019 12:09:15 GMT
You can try with Yarn node labels:
https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html

Then you can whitelist nodes.

> Am 19.01.2019 um 00:20 schrieb Serega Sheypak <serega.sheypak@gmail.com>:
> 
> Hi, is there any possibility to tell Scheduler to blacklist specific nodes in advance?

Mime
View raw message