spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: Do we still need to use Kryo serializer in Spark 1.6.2 ?
Date Mon, 22 Aug 2016 18:36:32 GMT
Hi,

I've not heard this. And moreover I see Kryo supported in Encoders
(SerDes) in Spark 2.0.

https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/Encoders.scala#L151

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski


On Mon, Aug 22, 2016 at 8:00 PM, Eric Ho <eric@analyticsmd.com> wrote:
> I heard that Kryo will get phased out at some point but not sure which Spark
> release.
> I'm using PySpark, does anyone has any docs on how to call / use Kryo
> Serializer in PySpark ?
>
> Thanks.
>
> --
>
> -eric ho
>

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message