spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reynold Xin <r...@databricks.com>
Subject Re: Eliminate copy while sending data : any Akka experts here ?
Date Thu, 03 Jul 2014 06:02:14 GMT
On Wed, Jul 2, 2014 at 3:44 AM, Mridul Muralidharan <mridul@gmail.com>
wrote:

>
> >
> > The other thing we do need is the location of blocks. This is actually
> just
> > O(n) because we just need to know where the map was run.
>
> For well partitioned data, wont this not involve a lot of unwanted
> requests to nodes which are not hosting data for a reducer (and lack
> of ability to throttle).
>

Was that a question? (I'm guessing it is). What do you mean exactly?

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message