spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Gummelt <>
Subject Re: Spark diclines mesos offers
Date Mon, 24 Apr 2017 18:30:32 GMT
Have you run with debug logging?  There are some hints in the debug logs:

On Mon, Apr 24, 2017 at 4:53 AM, Pavel Plotnikov <> wrote:

> Hi, everyone! I run spark 2.1.0 jobs on the top of Mesos cluster in
> coarse-grained mode with dynamic resource allocation. And sometimes spark
> mesos scheduler declines mesos offers despite the fact that not all
> available resources were used (I have less workers than the possible
> maximum) and the maximum threshold in the spark configuration is not
> reached and the queue have lot of pending tasks.
> May be I have wrong spark or mesos configuration? Does anyone have the
> same problems?

Michael Gummelt
Software Engineer

View raw message