hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HIVE-22476) Hive datediff function provided inconsistent results when hive.fetch.task.conversion is set to none
Date Mon, 01 Jun 2020 21:48:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-22476?focusedWorklogId=439758&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-439758
]

ASF GitHub Bot logged work on HIVE-22476:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 01/Jun/20 21:47
            Start Date: 01/Jun/20 21:47
    Worklog Time Spent: 10m 
      Work Description: jcamachor opened a new pull request #1046:
URL: https://github.com/apache/hive/pull/1046


   … hive.fetch.task.conversion is set to none (Slim Bouguerra via Jesus Camacho Rodriguez)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 439758)
    Remaining Estimate: 0h
            Time Spent: 10m

> Hive datediff function provided inconsistent results when hive.fetch.task.conversion
is set to none
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-22476
>                 URL: https://issues.apache.org/jira/browse/HIVE-22476
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Slim Bouguerra
>            Assignee: Slim Bouguerra
>            Priority: Major
>         Attachments: HIVE-22476.10.patch, HIVE-22476.2.patch, HIVE-22476.3.patch, HIVE-22476.5.patch,
HIVE-22476.6.patch, HIVE-22476.7.patch, HIVE-22476.7.patch, HIVE-22476.8.patch, HIVE-22476.8.patch,
HIVE-22476.8.patch, HIVE-22476.9.patch
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> The actual issue stems to the different date parser used by various part of the engine.
> Fetch task uses udfdatediff via {code} org.apache.hadoop.hive.ql.udf.generic.GenericUDFToDate{code}
while the vectorized llap execution uses {code}VectorUDFDateDiffScalarCol{code}.
> This fix is meant to be not very intrusive and will add more support to the GenericUDFToDate
by enhancing the parser.
> For the longer term will be better to use one parser for all the operators.
> Thanks [~Rajkumar Singh] for the repro example
> {code} 
> create external table testdatediff(datetimecol string) stored as orc;
> insert into testdatediff values ('2019-09-09T10:45:49+02:00'),('2019-07-24');
> select datetimecol from testdatediff where datediff(cast(current_timestamp as string),
datetimecol)<183;
> set hive.ferch.task.conversion=none;
> select datetimecol from testdatediff where datediff(cast(current_timestamp as string),
datetimecol)<183;
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message