spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From N B <nb.nos...@gmail.com>
Subject Re: Broadcast variables can be rebroadcast?
Date Sat, 16 May 2015 00:39:45 GMT
Thanks Ilya. Does one have to call broadcast again once the underlying data
is updated in order to get the changes visible on all nodes?

Thanks
NB


On Fri, May 15, 2015 at 5:29 PM, Ilya Ganelin <ilganeli@gmail.com> wrote:

> The broadcast variable is like a pointer. If the underlying data changes
> then the changes will be visible throughout the cluster.
> On Fri, May 15, 2015 at 5:18 PM NB <nb.nospam@gmail.com> wrote:
>
>> Hello,
>>
>> Once a broadcast variable is created using sparkContext.broadcast(), can
>> it
>> ever be updated again? The use case is for something like the underlying
>> lookup data changing over time.
>>
>> Thanks
>> NB
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-variables-can-be-rebroadcast-tp22908.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>

Mime
View raw message