hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20395) Parallelize files move in the ql.metadata.Hive#replaceFiles
Date Tue, 21 Aug 2018 16:22:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587679#comment-16587679
] 

ASF GitHub Bot commented on HIVE-20395:
---------------------------------------

GitHub user medb opened a pull request:

    https://github.com/apache/hive/pull/420

    HIVE-20395. Parallelize files move in 'replaceFiles' method

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/medb/hive HIVE-20395

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/hive/pull/420.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #420
    
----
commit 6ee2442b12d409ae8009a9deaf69a03a41e51a6e
Author: Igor Dvorzhak <idv@...>
Date:   2018-08-21T16:20:08Z

    HIVE-20395. Parallelize files move in 'replaceFiles' method

----


> Parallelize files move in the ql.metadata.Hive#replaceFiles
> -----------------------------------------------------------
>
>                 Key: HIVE-20395
>                 URL: https://issues.apache.org/jira/browse/HIVE-20395
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>    Affects Versions: 3.1.0
>            Reporter: Igor Dvorzhak
>            Assignee: Igor Dvorzhak
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-20395.1.patch
>
>
> Files move is not parallelized in `replaceFiles` method and could be very slow on Cloud
Object Stores.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message