hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-21857) Sort conditions in a filter predicate to accelerate query processing
Date Thu, 13 Jun 2019 14:26:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-21857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863124#comment-16863124
] 

Hive QA commented on HIVE-21857:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12971632/HIVE-21857.03.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/17555/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17555/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17555/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL https://issues.apache.org/jira/secure/attachment/12971632/HIVE-21857.03.patch
was found in seen patch url's cache and a test was probably run already on it. Aborting...
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12971632 - PreCommit-HIVE-Build

> Sort conditions in a filter predicate to accelerate query processing
> --------------------------------------------------------------------
>
>                 Key: HIVE-21857
>                 URL: https://issues.apache.org/jira/browse/HIVE-21857
>             Project: Hive
>          Issue Type: New Feature
>          Components: CBO
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-21857.01.patch, HIVE-21857.02.patch, HIVE-21857.03.patch
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Following approach similar to http://db.cs.berkeley.edu/jmh/miscpapers/sigmod93.pdf .
> To reorder predicates in AND conditions, we could rank each of elements in the clauses
in increasing order based on following formula:
> {code}
> rank = (selectivity - 1) / cost per tuple
> {code}
> Similarly, for OR conditions:
> {code}
> rank = (-selectivity) / cost per tuple
> {code}
> Selectivity can be computed with FilterSelectivityEstimator. For cost per tuple, we will
need to come up with some heuristic based on how expensive is the evaluation of the functions
contained in that predicate. Custom UDFs could be annotated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message