hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11595) refactor ORC footer reading to make it usable from outside
Date Fri, 28 Aug 2015 00:11:46 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717814#comment-14717814
] 

Sergey Shelukhin commented on HIVE-11595:
-----------------------------------------

Full footer buffer is not always available, see the comments. I considered that, but the omnly
way around this is to have "fake" full footer buffer with fake offsets into it (ie the buffer
will only have the footer and offsets wil cover the entire buffer), but it's hacky

> refactor ORC footer reading to make it usable from outside
> ----------------------------------------------------------
>
>                 Key: HIVE-11595
>                 URL: https://issues.apache.org/jira/browse/HIVE-11595
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-10595.patch, HIVE-11595.01.patch, HIVE-11595.02.patch, HIVE-11595.03.patch
>
>
> If ORC footer is read from cache, we want to parse it without having the reader, opening
a file, etc. I thought it would be as simple as protobuf parseFrom bytes, but apparently there's
bunch of stuff going on there. It needs to be accessible via something like parseFrom(ByteBuffer),
or similar.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message