spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evan Chan ...@ooyala.com>
Subject Re: How did spark implement serialization of functions?
Date Wed, 30 Oct 2013 05:36:04 GMT
You might want to have a look at ClosureCleaner.scala.


On Tue, Oct 29, 2013 at 1:10 PM, Bochun Zhang <bochun@umich.edu> wrote:

> In spark REPL, we can type in a function and let it run remotely. Anybody
> know how is it implemented?
>
> I’m trying to serialize a function or a class, send it to a remote server,
> and let the server invoke it. I don’t care much about securities. What i’m
> unable to do was how to get it serialized.
>
> Thanks in advance.
>
> --Bochun
>
>


-- 
--
Evan Chan
Staff Engineer
ev@ooyala.com  |

<http://www.ooyala.com/>
<http://www.facebook.com/ooyala><http://www.linkedin.com/company/ooyala><http://www.twitter.com/ooyala>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message