spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bode, Meikel, NMA-CFD" <Meikel.B...@Bertelsmann.de>
Subject Broadcast Variable
Date Mon, 03 May 2021 12:54:02 GMT
Hi all,

when broadcasting a large dict containing several million entries to executors what exactly
happens when calling bc_var.value within a UDF like:

..
d = bc_var.value
..

Does d receives a copy of the dict inside value or is this handled like a pointer?

Thanks,
Meikel

Mime
View raw message