spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gourav Sengupta <gourav.sengu...@gmail.com>
Subject Re: [Spark 2.x Core] Adding to ArrayList inside rdd.foreach()
Date Sun, 08 Apr 2018 03:54:01 GMT
Hi,

in case the key value store is large then can you give redis a try? SPARK
does work quite well with redis.


Regards,
Gourav Sengupta

On Sat, Apr 7, 2018 at 6:29 PM, klrmowse <klrmowse@gmail.com> wrote:

> okie, well...
>
> i'm working with a pair rdd <key, iterable(value)>
>
> i need to extract the values and store them somehow (maybe a simple
> Array??), which i later parallelize and reuse
>
> since adding to a list is a no-no, what, if any, are the other options?
> (Java Spark, btw)
>
>
>
> thanks
>
>
>
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>

Mime
View raw message