spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Siegmann <daniel.siegm...@velos.io>
Subject Re: How can I dispose an Accumulator?
Date Wed, 04 Jun 2014 21:22:55 GMT
Will the broadcast variables be disposed automatically if the context is
stopped, or do I still need to unpersist()?


On Sat, May 31, 2014 at 1:20 PM, Patrick Wendell <pwendell@gmail.com> wrote:

> Hey There,
>
> You can remove an accumulator by just letting it go out of scope and
> it will be garbage collected. For broadcast variables we actually
> store extra information for it, so we provide hooks for users to
> remove the associated state. There is no such need for accumulators,
> though.
>
> - Patrick
>
> On Thu, May 29, 2014 at 2:13 AM, innowireless TaeYun Kim
> <taeyun.kim@innowireless.co.kr> wrote:
> > Hi,
> >
> >
> >
> > How can I dispose an Accumulator?
> >
> > It has no method like 'unpersist()' which Broadcast provides.
> >
> >
> >
> > Thanks.
> >
> >
>



-- 
Daniel Siegmann, Software Developer
Velos
Accelerating Machine Learning

440 NINTH AVENUE, 11TH FLOOR, NEW YORK, NY 10001
E: daniel.siegmann@velos.io W: www.velos.io

Mime
View raw message