hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16797) Enhance HiveFilterSetOpTransposeRule to remove union branches
Date Fri, 02 Jun 2017 15:45:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034903#comment-16034903
] 

Ashutosh Chauhan commented on HIVE-16797:
-----------------------------------------

This seems to be working. On query 4, instead of 67 vertex Tez Dag, after this patch we are
only getting 33 vertex dag. cc: [~gopalv] [~ndembla]

> Enhance HiveFilterSetOpTransposeRule to remove union branches
> -------------------------------------------------------------
>
>                 Key: HIVE-16797
>                 URL: https://issues.apache.org/jira/browse/HIVE-16797
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Pengcheng Xiong
>            Assignee: Pengcheng Xiong
>         Attachments: HIVE-16797.01.patch
>
>
> in query4.q, we can see that it creates a CTE with union all of 3 branches. Then it is
going to do a 3 way self-join of the CTE with predicates. The predicates actually specifies
only one of the branch in CTE to participate in the join. Thus, in some cases, e.g.,
> {code}
>                /- filter(false) -----TS0 
> union all  - filter(false) -----TS1
>                \-----TS2
> {code}
> we can cut the branches of TS0 and TS1. The union becomes only TS2.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message