spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Irving Duran <irving.du...@gmail.com>
Subject Re: If there is timestamp type data in DF, Spark 2.3 toPandas is much slower than spark 2.2.
Date Fri, 08 Jun 2018 01:04:20 GMT
I haven't noticed or seen this behavior.  Have you noticed this with by
testing the same dataset between versions?

Thank you,

Irving Duran

On 06/06/2018 11:22 PM, 李斌松 wrote:
> If there is timestamp type data in DF, Spark 2.3 toPandas is much
> slower than spark 2.2.


Mime
View raw message