spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Walrus theCat <walrusthe...@gmail.com>
Subject cluster hangs for no apparent reason
Date Thu, 31 Oct 2013 23:56:43 GMT
Hi,

I'm not sure what's going on here.  My code seems to be working thus far
(map at SparkLR:90 completed.)  What can I do to help the scheduler out
here?

Thanks

13/10/31 02:10:13 INFO scheduler.DAGScheduler: Completed ShuffleMapTask(10,
211)
13/10/31 02:10:13 INFO scheduler.DAGScheduler: Stage 10 (map at
SparkLR.scala:90) finished in 0.923 s
13/10/31 02:10:13 INFO scheduler.DAGScheduler: looking for newly runnable
stages
13/10/31 02:10:13 INFO scheduler.DAGScheduler: running: Set(Stage 11)
13/10/31 02:10:13 INFO scheduler.DAGScheduler: waiting: Set(Stage 9, Stage
8)
13/10/31 02:10:13 INFO scheduler.DAGScheduler: failed: Set()
13/10/31 02:10:16 INFO scheduler.DAGScheduler: Missing parents for Stage 9:
List(Stage 11)
13/10/31 02:10:16 INFO scheduler.DAGScheduler: Missing parents for Stage 8:
List(Stage 9)

Mime
View raw message