spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arijit <arij...@live.com>
Subject Understanding code/closure shipment to Spark workers‏
Date Wed, 07 Oct 2015 23:47:14 GMT
 Hi,
 
I want to understand the code flow starting from the Spark jar that I submit through spark-submit,
how does Spark identify and extract the closures, clean and serialize them and ship them to
workers to execute as tasks. Can someone point me to any documentation or a pointer to the
source code path to help me understand this.
 
Thanks, Arijit 		 	   		  
Mime
View raw message