spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: SparkContext & Threading
Date Fri, 05 Jun 2015 18:50:50 GMT
On Fri, Jun 5, 2015 at 11:48 AM, Lee McFadden <spleeman@gmail.com> wrote:

> Initially I had issues passing the SparkContext to other threads as it is
> not serializable.  Eventually I found that adding the @transient annotation
> prevents a NotSerializableException.
>

This is really puzzling. How are you passing the context around that you
need to do serialization?

Threads run all in the same process so serialization should not be needed
at all.

-- 
Marcelo

Mime
View raw message