hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10755) Rework on HIVE-5193 to enhance the column oriented table acess
Date Fri, 02 Oct 2015 00:38:26 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940647#comment-14940647
] 

Daniel Dai commented on HIVE-10755:
-----------------------------------

The approach should be fine. We also need to avoid appending ids multiple times to conf to
avoid unnecessary warning from ColumnProjectionUtils.getReadColumnIDs. We shall also add a
test case which cause HIVE-10752. A simple join + foreach should reproduce HIVE-10752:
{code}
A = load '" + COMPLEX_TABLE + "' using org.apache.hive.hcatalog.pig.HCatLoader();
B = load '" + COMPLEX_TABLE + "' using org.apache.hive.hcatalog.pig.HCatLoader();
C = join A by name, B by name;
D = foreach C generate B::studentid;
{code}

> Rework on HIVE-5193 to enhance the column oriented table acess
> --------------------------------------------------------------
>
>                 Key: HIVE-10755
>                 URL: https://issues.apache.org/jira/browse/HIVE-10755
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HCatalog
>    Affects Versions: 1.2.0
>            Reporter: Aihua Xu
>            Assignee: Aihua Xu
>             Fix For: 2.0.0
>
>         Attachments: HIVE-10755.patch
>
>
> Add the support of column pruning for column oriented table access which was done in
HIVE-5193 but was reverted due to the join issue in HIVE-10720.
> In 1.3.0, the patch posted by Viray didn't work, probably due to some jar reference.
That seems to get fixed and that patch works in 2.0.0 now.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message