spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 周康 <zhoukang199...@gmail.com>
Subject Re: DAGScheduler - two runtimes
Date Tue, 15 Aug 2017 11:59:07 GMT
ResultStage cost time is your job's last stage cost time.
Job 13 finished: reduce at VertexRDDImpl.scala:90, took 0.035546 s is the
time your job cost

2017-08-14 18:58 GMT+08:00 Kaepke, Marc <marc.kaepke@haw-hamburg.de>:

> Hi everyone,
>
> I’m a Spark newbie and have one question:
> What is the difference between the duration measures in my log/ console
> output?
>
> 17/08/14 12:48:58 INFO DAGScheduler: ResultStage 232 (reduce at
> VertexRDDImpl.scala:90) finished in 0.026 s
> 17/08/14 12:48:58 INFO DAGScheduler: Job 13 finished: reduce at
> VertexRDDImpl.scala:90, took 0.035546 s
>
> I need the total runtime of the job in ms. Or seconds with decimal
>
> Thanks!
>
> Best
> Marc
>
>
>

Mime
View raw message