spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tobias Pfeiffer <...@preferred.jp>
Subject Re: Closing over a var with changing value in Streaming application
Date Wed, 21 Jan 2015 07:53:09 GMT
Hi,

On Wed, Jan 21, 2015 at 4:46 PM, Akhil Das <akhil@sigmoidanalytics.com>
wrote:

> How about using accumulators
> <http://spark.apache.org/docs/1.2.0/programming-guide.html#accumulators>?
>

As far as I understand, they solve the part of the problem that I am not
worried about, namely increasing the counter. I was more worried about
getting that counter/accumulator value back to the executors.

Thanks
Tobias

Mime
View raw message