spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Darabos <>
Subject Re: Information on Spark UI
Date Wed, 11 Jun 2014 15:57:26 GMT
About more succeeded tasks than total tasks:
 - This can happen if you have enabled speculative execution. Some
partitions can get processed multiple times.
 - More commonly, the result of the stage may be used in a later
calculation, and has to be recalculated. This happens if some of the
results were evicted from cache.

On Wed, Jun 11, 2014 at 2:23 AM, Shuo Xiang <> wrote:

> Hi,
>   Came up with some confusion regarding the information on SparkUI. The
> following info is gathered while factorizing a large matrix using ALS:
>   1. some stages have more succeeded tasks than total tasks, which are
> displayed in the 5th column.
>   2. duplicate stages with exactly same stageID (stage 1/3/7)
>   3. Clicking into some stages, some executors cannot be addressed. Does
> that mean lost of executor or this does not matter?
>   Any explanation are appreciated!

View raw message