hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Teddy Choi (JIRA)" <>
Subject [jira] [Updated] (HIVE-15988) LLAP: cache ORC ACID delete deltas
Date Wed, 08 Mar 2017 14:39:38 GMT


Teddy Choi updated HIVE-15988:
    Attachment: HIVE-15988.1.patch

This patch is a draft implementation and is based on HIVE-12631. Or should I apply these changes
into HIVE-12631 as it's not closed yet?

OrcEncodedRawRecordMerger caches delete delta in LlapRecordReader with high priority. Most
of changed classes are related with adding priority.

> LLAP: cache ORC ACID delete deltas
> ----------------------------------
>                 Key: HIVE-15988
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: llap, Transactions
>            Reporter: Teddy Choi
>            Assignee: Teddy Choi
>         Attachments: HIVE-15988.1.patch
> HIVE-12631 implemented ORC ACID table support in LLAP. If we cache ACID delta in LLAP,
it will be faster.
> The cache is currently low-level (CB-level in ORC), so we could just use it to read bases
and deltas (deltas should be cached with higher priority) and merge as usual. We could also
cache merged representation in future.

This message was sent by Atlassian JIRA

View raw message