spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul Stewart <paul.stew...@imperva.com>
Subject Spark 2.0 Encoder().schema() is sorting StructFields
Date Fri, 07 Oct 2016 15:42:06 GMT
When using the Encoder(Bean.class).schema() method to generate the StructType array
of StructFields the class attributes are returned as a sorted list and not
in the defined order within the Bean.class.  This makes the schema unusable
for reading from a CSV file where the ordering of the attributes is
significant.

Is there anyway to cause the Encoder().schema() method to return the array
of StructFields in the original definition order of the Bean.class?

Regards,
Paul


---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message