spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gusiri <dreame...@gmail.com>
Subject Is executor computing time affected by network latency?
Date Thu, 22 Sep 2016 13:54:09 GMT
Hi,

When I increase the network latency among spark nodes, 

I see compute time (=executor computing time in Spark Web UI) also
increases. 

In the graph attached, left = latency 1ms vs right = latency 500ms.

Is there any communication between worker and driver/master even 'during'
executor computing? or any idea on this result?


<http://apache-spark-user-list.1001560.n3.nabble.com/file/n27779/Screen_Shot_2016-09-21_at_5.png>






Thank you very much in advance. 

//gusiri




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-executor-computing-time-affected-by-network-latency-tp27779.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message