spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kaepke, Marc" <marc.kae...@haw-hamburg.de>
Subject DAGScheduler - two runtimes
Date Mon, 14 Aug 2017 10:58:16 GMT
Hi everyone,

I’m a Spark newbie and have one question:
What is the difference between the duration measures in my log/ console output?

17/08/14 12:48:58 INFO DAGScheduler: ResultStage 232 (reduce at VertexRDDImpl.scala:90) finished
in 0.026 s
17/08/14 12:48:58 INFO DAGScheduler: Job 13 finished: reduce at VertexRDDImpl.scala:90, took
0.035546 s

I need the total runtime of the job in ms. Or seconds with decimal

Thanks!

Best
Marc


Mime
View raw message