hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Vary (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19783) Retrieve only locations in HiveMetaStore.dropPartitionsAndGetLocations
Date Tue, 05 Jun 2018 10:50:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501583#comment-16501583
] 

Peter Vary commented on HIVE-19783:
-----------------------------------

Test results on my laptop, using [~akolb]'s test tool is:
* Before the patch:
{code}
Operation                      AMean    Mean     Med      Min      Max      Err%    
dropTableWithPartitions.10    0.000    53.24    53.25    49.51    56.76    4.393   
dropTableWithPartitions.100   16.82    70.06    70.01    68.59    72.37    1.594   
dropTableWithPartitions.1000  233.5    286.7    277.6    259.0    372.7    10.88   
{code}
* After the patch:
{code}
Operation                      AMean    Mean     Med      Min      Max      Err%    
dropTableWithPartitions.10    0.000    48.89    48.75    46.16    53.48    4.648   
dropTableWithPartitions.100   11.82    60.70    59.99    58.16    65.90    4.072   
dropTableWithPartitions.1000  143.0    191.9    192.3    180.3    204.6    4.014   
{code}

> Retrieve only locations in HiveMetaStore.dropPartitionsAndGetLocations
> ----------------------------------------------------------------------
>
>                 Key: HIVE-19783
>                 URL: https://issues.apache.org/jira/browse/HIVE-19783
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>            Priority: Major
>         Attachments: HIVE-19783.patch
>
>
> Optimize further the dropTable command.
> Currently {{HiveMetaStore.dropPartitionsAndGetLocations}} retrieves the whole partition
object, but we need only the locations instead.
> Create a RawStore method to retrieve only the locations.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message