spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nicholas Chammas <nicholas.cham...@gmail.com>
Subject Re: process local vs node local subtlety question/issue
Date Fri, 13 Jun 2014 21:30:55 GMT
On Fri, Jun 13, 2014 at 1:55 PM, Albert Chu <chu11@llnl.gov> wrote:

> 1) How is this data process-local?  I *just* copied it into HDFS.  No
> spark worker or executor should have loaded it.
>

Yeah, I thought that PROCESS_LOCAL meant the data was already in the JVM on
the worker node, but I do see the same thing for data loaded from S3...

Nick

Mime
View raw message