spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From paja <vybi...@gmail.com>
Subject Re: Join stucks in the last stage step
Date Thu, 08 Jan 2015 08:41:39 GMT
Just to demonstrate BIG difference between ordinary task (id 450) and last
remaining task (id 0)

Index	ID	Attempt	Status ▾	Locality Level    Launch Time   Duration	GC Time
Shuffle Read	Shuffle Spill (Memory)	Shuffle Spill (Disk)	Errors
0	2413	0	RUNNING	2015/01/08 08:03:19	*1.5 h		10.9 GB	176.9 GB*	4.4 GB	
450	2863	0	SUCCESS	2015/01/08 08:06:55	*1.1 min	42.7 MB	968.7 MB* 32.9 MB	



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Join-stucks-in-the-last-stage-step-tp21018p21028.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message