spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <Saif.A.Ell...@wellsfargo.com>
Subject Kryo makes String data invalid
Date Mon, 26 Oct 2015 19:17:22 GMT
Hi all,

I have a parquet file, which I am loading in a shell. When I launch the shell with -driver-java-options
="-Dspark.serializer=...kryo", makes a couple fields look like:

03-?????? ??????-?? ??-???????
when calling > data.first

I will confirm briefly, but I am utterly sure it happens only on StringType fields.

Why could this be happening? perhaps when creating the parquet file from spark, Kryo wasn't
set up?

If I disable Kryo, data looks good.

Any ideas?
Saif


Mime
View raw message