kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dana Powers <dana.pow...@gmail.com>
Subject Re: newbie does python del, gc.collect() release all resources?
Date Mon, 01 Aug 2016 19:19:56 GMT
Are you asking about a Kafka python driver? Or are referring to pyspark?
On Aug 1, 2016 10:03, "Andy Davidson" <Andy@santacruzintegration.com> wrote:

> I am new to python.
>
> I find my self working with several data frames at the same time. I have
> run
> into some driver memory problems and want to make sure I release all
> resource as soon as possible.
>
> 1. should I be calling del and gc.collect() ?
> 2. If a dataframe was cached do I need to explicitly call unpersist() or
> will del,gc.collect() do this for me?
>
> Thanks
>
> Andy
>
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message