spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From praveen S <>
Subject Concurrent execution of actions within a driver
Date Mon, 26 Oct 2015 11:26:59 GMT
Does spark run different actions of an rdd within a driver in parallel

Let's say
class Driver{

val rdd1= sc. textFile("... ")
val rdd2=sc.textFile("....")
rdd1. collect //Action 1
rdd2. collect //Action 2


Does Spark run Action 1 & 2 run in parallel? ( some kind of a pass through
the driver code and than start the execution)?

if not than is using threads safe for independent actions/red's?

View raw message