hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-22045) HIVE-21711 introduced regression in data load
Date Tue, 30 Jul 2019 01:39:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895692#comment-16895692
] 

Gopal V commented on HIVE-22045:
--------------------------------

The FileSinkDesc:isCTas* method needs more docs in the declaration.

And I'm trying to figure out the actual impact of 

{code}
- boolean isBlobStorage = BlobStorageUtils.isBlobStorageFileSystem(hconf, fs);
{code}

Is that going to be another perf regression?

> HIVE-21711 introduced regression in data load
> ---------------------------------------------
>
>                 Key: HIVE-22045
>                 URL: https://issues.apache.org/jira/browse/HIVE-22045
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Vineet Garg
>            Assignee: Vineet Garg
>            Priority: Major
>         Attachments: HIVE-22045.1.patch, HIVE-22045.2.patch, HIVE-22045.3.patch
>
>
> Better fix for HIVE-21711 is to specialize the handling for CTAS/Create MV statements
to avoid intermittent rename operation but keep INSERT etc statements do intermittent rename
since otherwise final move by file operation is significantly slow for such statements.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Mime
View raw message