spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fang, Mike" <chuf...@paypal.com.INVALID>
Subject questions on the "waiting batches" and "scheduling delay" in Streaming UI
Date Wed, 17 Jun 2015 02:13:56 GMT
Hi,

I have a spark streaming program running for ~ 25hrs. When I check the Streaming UI tab. I
found the "Waiting batches" is 144. But the "scheduling delay" is 0. I am a bit confused.
If the "waiting batches" is 144, that means many batches are waiting in the queue to be processed?
If this is the case, the scheduling delay should be high rather than 0. Am I missing anything?

Thanks,
Mike


Mime
View raw message