spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tobias Pfeiffer <>
Subject Re: Is there setup and cleanup function in spark?
Date Tue, 18 Nov 2014 02:28:01 GMT

On Fri, Nov 14, 2014 at 2:49 PM, Jianshi Huang <>

> Ok, then we need another trick.
> let's have an *implicit lazy var connection/context* around our code. And
> setup() will trigger the eval and initialization.

Due to lazy evaluation, I think having setup/teardown is a bit tricky. In
particular teardown, because it is not easy to execute code after all
computation is done. You can check
for an example of what worked for me.


View raw message