spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tobias Pfeiffer <...@preferred.jp>
Subject Re: How to replace user.id to user.names in a file
Date Wed, 07 Jan 2015 01:34:36 GMT
Hi,

it looks to me as if you need the whole user database on every node, so
maybe put the id->name information as a Map[Id, String] in a broadcast
variable and then do something like

recommendations.map(line => {
  line.map(uid => usernames(uid))
})

or so?

Tobias

Mime
View raw message