spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Imran Rashid <>
Subject Re: Timestamp interoperability design doc available for review
Date Mon, 11 Sep 2017 15:05:52 GMT
I've posted a design doc on SPARK-12297, which builds on what Zoltan posted
here earlier.  It addresses the parquet issues and also considers current
inconsistencies in timestamp behavior for spark across data formats and
versions.  I believe this incorporates all of the prior concerns and
feedback.  I should post a PR for it soon.


On Wed, Aug 16, 2017 at 12:33 PM, Zoltan Ivanfi <> wrote:

> Dear Spark Community,
> Based on earlier feedback from the Spark community, we would like to
> suggest a short-term fix for the timestamp interoperability problem[1]
> between different SQL-on-Hadoop engines. I created a design document[2] and
> would like to ask you to review it and let me know of any concerns and/or
> suggestions you may have.
> [1]
> [2]
> XiZB03pgi3r1razM/edit
> Thanks,
> Zoltan

View raw message