spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Evo Eftimov" <>
Subject RE: Spark Fair Scheduler for Spark Streaming - 1.2 and beyond
Date Fri, 15 May 2015 18:13:28 GMT
No pools for the moment – for each of the apps using the straightforward way with the spark
conf param for scheduling = FAIR 


Spark is running in a Standalone Mode 


Are you saying that Configuring Pools is mandatory to get the FAIR scheduling working –
from the docs it seemed optional to me 


From: Tathagata Das [] 
Sent: Friday, May 15, 2015 6:45 PM
To: Evo Eftimov
Cc: user
Subject: Re: Spark Fair Scheduler for Spark Streaming - 1.2 and beyond


How are you configuring the fair scheduler pools?


On Fri, May 15, 2015 at 8:33 AM, Evo Eftimov <> wrote:

I have run / submitted a few Spark Streaming apps configured with Fair
scheduling on Spark Streaming 1.2.0, however they still run in a FIFO mode.
Is FAIR scheduling supported at all for Spark Streaming apps and from what
release / version - e.g. 1.3.1

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:


View raw message