spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shivaram Venkataraman <shiva...@eecs.berkeley.edu>
Subject Re: What does (### skipped) mean in the Spark UI?
Date Wed, 07 Jan 2015 20:52:00 GMT
+Josh, who added the Job UI page.

I've seen this as well and was a bit confused about what it meant. Josh, is
there a specific scenario that creates these skipped stages in the Job UI ?

Thanks
Shivaram

On Wed, Jan 7, 2015 at 12:32 PM, Corey Nolet <cjnolet@gmail.com> wrote:

> Sorry- replace ### with an actual number. What does a "skipped" stage
> mean? I'm running a series of jobs and it seems like after a certain point,
> the number of skipped stages is larger than the number of actual completed
> stages.
>
> On Wed, Jan 7, 2015 at 3:28 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
>> Looks like the number of skipped stages couldn't be formatted.
>>
>> Cheers
>>
>> On Wed, Jan 7, 2015 at 12:08 PM, Corey Nolet <cjnolet@gmail.com> wrote:
>>
>>> We just upgraded to Spark 1.2.0 and we're seeing this in the UI.
>>>
>>
>>
>

Mime
View raw message