hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Vary (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-24032) Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
Date Tue, 25 Aug 2020 12:39:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-24032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183992#comment-17183992
] 

Peter Vary commented on HIVE-24032:
-----------------------------------

[~anishek], [~aasha]: I left a comment on the pull request 2 days ago which might be missed
in the noise:
{quote}
Why is this a good thing?
AFAIK we introduced the Shims to be able to abstract out Hadoop dependencies and being able
to work with different versions of Hadoop altogether. Removing shims will again fix as to
a specific Hadoop version.
{quote}

I see that this was committed, but I still would like to understand the reasoning behind this
change. Do we plan to remove the whole Shims module?

Thanks,
Peter


> Remove hadoop shims dependency and use FileSystem Api directly from standalone metastore
> ----------------------------------------------------------------------------------------
>
>                 Key: HIVE-24032
>                 URL: https://issues.apache.org/jira/browse/HIVE-24032
>             Project: Hive
>          Issue Type: Task
>            Reporter: Aasha Medhi
>            Assignee: Aasha Medhi
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-24032.01.patch, HIVE-24032.02.patch, HIVE-24032.03.patch
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Remove hadoop shims dependency from standalone metastore. 
> Rename hive.repl.data.copy.lazy hive conf to hive.repl.run.data.copy.tasks.on.target



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message