spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From raintung li <raintung...@gmail.com>
Subject How about the fetch the shuffle data in one same machine?
Date Wed, 10 May 2017 09:53:46 GMT
Hi all,

Now Spark only think the executorId same that fetch local file, but for
same IP different ExecutorId will fetch using network that actually it can
be fetch in the local Or Loopback.

Apparently fetch the local file that it is fast that can use the LVS cache.

How do you think?

Regards
-Raintung

Mime
View raw message