hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (HIVE-21485) Hive desc operation takes more than 100 seconds after upgrading from Hive 1.2.1 to 2.3.4
Date Fri, 22 Mar 2019 03:18:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21485?focusedWorklogId=217109&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-217109
]

ASF GitHub Bot logged work on HIVE-21485:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 22/Mar/19 03:17
            Start Date: 22/Mar/19 03:17
    Worklog Time Spent: 10m 
      Work Description: rmsmani commented on issue #577: HIVE-21485: Add flag to turn off
fetching partition stats in DESCRIBE…
URL: https://github.com/apache/hive/pull/577#issuecomment-475480051
 
 
   1. Create a patch file (patch file is diff between the latest commit as available in master
with your proposed changes)
   2. Upload the patch file to Jira card
   3 click the submit patch button
   
   The automatic pre built testing will be triggered at Jenkins and the results will be uploaded
to Jira card upon build completion.
   
   For more details check how to contribute to hive wiki
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 217109)
    Time Spent: 20m  (was: 10m)

> Hive desc operation takes more than 100 seconds after upgrading from Hive 1.2.1 to 2.3.4
> ----------------------------------------------------------------------------------------
>
>                 Key: HIVE-21485
>                 URL: https://issues.apache.org/jira/browse/HIVE-21485
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI, Hive
>    Affects Versions: 2.3.4
>            Reporter: Qingxin Wu
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Hive desc [formatted|extended] operation cost more than 100 seconds after upgrading from
Hive 1.2.1 to 2.3.4. This is mainly caused by showing stats for partitioned tables which was
introduced by HIVE-16098 when the partitioned tables have a large amount of partitions. In
our case, the number of partition is 187221.
> {code:java}
> hive> desc bus.kafka_data;
> OK
> id            	        string
> ...
> d                  	    map<string,string>
> stat_date           	string
> log_id              	string
> # Partition Information
> # col_name            	data_type           	comment
> stat_date           	string
> log_id              	string
> Time taken: 115.342 seconds, Fetched: 42 row(s)
> {code}
> same operation executed in hive-1.2.1 and only cost 2 seconds.
> {code:java}
> hive> desc bus.kafka_data;
> OK
> id            	        string
> ...
> d                  	    map<string,string>
> stat_date           	string
> log_id              	string
> # Partition Information
> # col_name            	data_type           	comment
> stat_date           	string
> log_id              	string
> Time taken: 2.037 seconds, Fetched: 42 row(s)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message