spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: Missing parents for stage (Spark Streaming)
Date Sat, 22 Nov 2014 17:01:49 GMT
This message appears in normal operation. I do not think it refers to
anything in your code.
On Nov 21, 2014 11:57 PM, "YaoPau" <jonrgregg@gmail.com> wrote:

> When I submit a Spark Streaming job, I see these INFO logs printing
> frequently:
>
> 14/11/21 18:53:17 INFO DAGScheduler: waiting: Set(Stage 216)
> 14/11/21 18:53:17 INFO DAGScheduler: failed: Set()
> 14/11/21 18:53:17 INFO DAGScheduler: Missing parents for Stage 216: List()
> 14/11/21 18:53:17 INFO DAGScheduler: Submitting Stage 216 (MappedRDD[1733]
> at map at MappedDStream.scala:35), which is now runnable
>
> I have a feeling this means there is some error with a Map I created as a
> broadcast variable, but I'm not sure.  How can I figure out what this is
> referring to?
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Missing-parents-for-stage-Spark-Streaming-tp19530.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message