hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <>
Subject [jira] [Commented] (HIVE-17600) Make OrcFile's "enforceBufferSize" user-settable.
Date Fri, 29 Sep 2017 21:06:01 GMT


Mithun Radhakrishnan commented on HIVE-17600:

[~prasanth_j], given that ORC-238 has been committed, could I bother you to commit this too?
It's the same change, but for Hive, prior to the ORC -divorce- refactor.

> Make OrcFile's "enforceBufferSize" user-settable.
> -------------------------------------------------
>                 Key: HIVE-17600
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: ORC
>    Affects Versions: 2.2.0, 3.0.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: HIVE-17600.1-branch-2.2.patch
> This is a duplicate of ORC-238, but it applies to {{branch-2.2}}.
> Compression buffer-sizes in OrcFile are computed at runtime, except when enforceBufferSize
is set. The only snag here is that this flag can't be set by the user.
> When runtime-computed buffer-sizes are not optimal (for some reason), the user has no
way to work around it by setting a custom value.
> I have a patch that we use at Yahoo.

This message was sent by Atlassian JIRA

View raw message