hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <>
Subject [jira] [Updated] (HIVE-17621) Hive-site settings are ignored during HCatInputFormat split-calculation
Date Thu, 28 Sep 2017 23:21:01 GMT


Mithun Radhakrishnan updated HIVE-17621:
    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed to {{master}}, {{branch-2}}, and {{branch-2.2}}. Thanks for the contribution, [~cdrome]
and [~selinazh]!

> Hive-site settings are ignored during HCatInputFormat split-calculation
> -----------------------------------------------------------------------
>                 Key: HIVE-17621
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog
>    Affects Versions: 2.2.0, 3.0.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Chris Drome
>         Attachments: HIVE-17621.1-branch-2.2.patch, HIVE-17621.1-branch-2.patch, HIVE-17621.1.patch
> Another one that [~selinazh] and [~cdrome] worked on.
> The production {{hive-site.xml}} could well contain settings that differ from the defaults
in {{}}. In our case, we introduced a custom ORC split-strategy, which we introduced
as the site-wide default.
> We noticed that during {{HCatInputFormat::getSplits()}}, if the user-script did not contain
the setting, the site-wide default was ignored in favour of the {{HiveConf}} default. HCat
would not convey hive-site settings to the input-format (or anywhere downstream).
> The forthcoming patch fixes this problem.

This message was sent by Atlassian JIRA

View raw message