spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yash datta <sau...@gmail.com>
Subject External Shuffle service over yarn
Date Fri, 26 Jun 2015 06:08:41 GMT
Hi devs,

Can someone point out if there are any distinct advantages of using
external shuffle service over yarn (runs on node manager  as an auxiliary
service

https://issues.apache.org/jira/browse/SPARK-3797)  instead of the default
execution in the executor containers ?

Please also mention if you have seen any differences having used both ways ?

Thanks and Best Regards
Yash

-- 
When events unfold with calm and ease
When the winds that blow are merely breeze
Learn from nature, from birds and bees
Live your life in love, and let joy not cease.

Mime
View raw message