hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17600) Make OrcFile's "enforceBufferSize" user-settable.
Date Tue, 05 Dec 2017 08:49:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278213#comment-16278213
] 

Lefty Leverenz commented on HIVE-17600:
---------------------------------------

Doc note:  This adds *hive.exec.orc.buffer.size.enforce* (aka *orc.buffer.size.enforce*) to
OrcConf.java.  I guess it should be documented in the ORC section of Configuration Properties,
although that section needs an explanation about the move from HiveConf.java to OrcConf.java.

* [Configuration Properties -- ORC File Format | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-ORCFileFormat]

Added a TODOC2.2 label.

> Make OrcFile's "enforceBufferSize" user-settable.
> -------------------------------------------------
>
>                 Key: HIVE-17600
>                 URL: https://issues.apache.org/jira/browse/HIVE-17600
>             Project: Hive
>          Issue Type: Improvement
>          Components: ORC
>    Affects Versions: 2.2.0, 3.0.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>              Labels: TODOC2.2
>             Fix For: 2.2.1
>
>         Attachments: HIVE-17600.1-branch-2.2.patch
>
>
> This is a duplicate of ORC-238, but it applies to {{branch-2.2}}.
> Compression buffer-sizes in OrcFile are computed at runtime, except when enforceBufferSize
is set. The only snag here is that this flag can't be set by the user.
> When runtime-computed buffer-sizes are not optimal (for some reason), the user has no
way to work around it by setting a custom value.
> I have a patch that we use at Yahoo.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message