spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: How to access objects declared and initialized outside the call() method of JavaRDD
Date Tue, 28 Oct 2014 07:12:05 GMT
It might kind of work, but you are effectively making all of your
workers into mini, separate Spark drivers in their own right. This
might cause snags down the line as this isn't the normal thing to do.

On Tue, Oct 28, 2014 at 12:11 AM, Localhost shell
<universal.localhost@gmail.com> wrote:
> Hey lordjoe,
>
> Apologies for the late reply.
>
> I followed your threadlocal approach and it worked fine. I will update the
> thread if I get to know more on this.
> (Don't know how Spark Scala does it but what I wanted to achieve in java is
> quiet common in many spark-scala github gists)
>
> Thanks.
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message