spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ilya Ganelin <ilgan...@gmail.com>
Subject Re: Broadcast variables can be rebroadcast?
Date Sat, 16 May 2015 01:02:25 GMT
Nope. It will just work when you all x.value.
On Fri, May 15, 2015 at 5:39 PM N B <nb.nospam@gmail.com> wrote:

> Thanks Ilya. Does one have to call broadcast again once the underlying
> data is updated in order to get the changes visible on all nodes?
>
> Thanks
> NB
>
>
> On Fri, May 15, 2015 at 5:29 PM, Ilya Ganelin <ilganeli@gmail.com> wrote:
>
>> The broadcast variable is like a pointer. If the underlying data changes
>> then the changes will be visible throughout the cluster.
>> On Fri, May 15, 2015 at 5:18 PM NB <nb.nospam@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> Once a broadcast variable is created using sparkContext.broadcast(), can
>>> it
>>> ever be updated again? The use case is for something like the underlying
>>> lookup data changing over time.
>>>
>>> Thanks
>>> NB
>>>
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-variables-can-be-rebroadcast-tp22908.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>

Mime
View raw message