spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pavel Plotnikov <pavel.plotni...@team.wrike.com>
Subject Spark diclines mesos offers
Date Mon, 24 Apr 2017 11:53:03 GMT
Hi, everyone! I run spark 2.1.0 jobs on the top of Mesos cluster in
coarse-grained mode with dynamic resource allocation. And sometimes spark
mesos scheduler declines mesos offers despite the fact that not all
available resources were used (I have less workers than the possible
maximum) and the maximum threshold in the spark configuration is not
reached and the queue have lot of pending tasks.

May be I have wrong spark or mesos configuration? Does anyone have the same
problems?

Mime
View raw message