spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Imran Rashid (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.
Date Thu, 02 Feb 2017 14:28:51 GMT

    [ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849974#comment-15849974
] 

Imran Rashid commented on SPARK-12297:
--------------------------------------

This is related to HIVE-12767.  It doesn't make sense to commit a patch to spark until hive
fixes that issue, so we are sure we can follow the same scheme.  But I'll be posting a POC
patch to discuss, given the current proposal on the hive side.

> Add work-around for Parquet/Hive int96 timestamp bug.
> -----------------------------------------------------
>
>                 Key: SPARK-12297
>                 URL: https://issues.apache.org/jira/browse/SPARK-12297
>             Project: Spark
>          Issue Type: Task
>          Components: Spark Core
>            Reporter: Ryan Blue
>
> Hive has a bug where timestamps in Parquet data are incorrectly adjusted as though they
were in the SQL session time zone to UTC. This is incorrect behavior because timestamp values
are SQL timestamp without time zone and should not be internally changed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message