spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From nilmish <>
Subject Re: Error related to serialisation in spark streaming
Date Thu, 05 Jun 2014 08:31:34 GMT
Thanx a lot for your reply. I can see kryo serialiser in the UI. 

I have 1 another query :

I wanted to know the meaning of the following log message when running a
spark streaming job : 

[] INFO 
org.apache.spark.streaming.scheduler.JobScheduler - Total delay: 5.432 s for
time 1401870454500 ms (execution: 0.593 s) 

According to my understanding, total delay here means total end-to-end delay
which is here 5.432 sec. 

What is the meaning of execution : 0.593 ?? 

Is it the time taken for executing this particular query ? 

PS : I am running a streaming job over a window of 5 mins and quering every
1.5 sec. 

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message