hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <>
Subject [jira] [Updated] (HIVE-11548) HCatLoader should support predicate pushdown.
Date Mon, 24 Aug 2015 23:14:45 GMT


Mithun Radhakrishnan updated HIVE-11548:
    Attachment:     (was: HIVE-11548.1.patch)

> HCatLoader should support predicate pushdown.
> ---------------------------------------------
>                 Key: HIVE-11548
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>          Components: HCatalog
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
> When one uses {{HCatInputFormat}}/{{HCatLoader}} to read from file-formats that support
predicate pushdown (such as ORC, with {{hive.optimize.index.filter=true}}), one sees that
the predicates aren't actually pushed down into the storage layer.
> The forthcoming patch should allow for filter-pushdown, if any of the partitions being
scanned with {{HCatLoader}} support the functionality. The patch should technically allow
the same for users of {{HCatInputFormat}}, but I don't currently have a neat interface to
build a compound predicate-expression. Will add this separately, if required.

This message was sent by Atlassian JIRA

View raw message