hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-23446) LLAP: Reduce IPC connection misses to AM for short queries
Date Thu, 14 May 2020 05:45:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-23446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106925#comment-17106925
] 

Ashutosh Chauhan commented on HIVE-23446:
-----------------------------------------

+1 pending tests.

> LLAP: Reduce IPC connection misses to AM for short queries
> ----------------------------------------------------------
>
>                 Key: HIVE-23446
>                 URL: https://issues.apache.org/jira/browse/HIVE-23446
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Major
>         Attachments: HIVE-23446.1.patch, HIVE-23446.2.patch
>
>
> [https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/QueryInfo.java#L343]
>  
> Umbilical UGI pool for is maintained at QueryInfo level. When there are lots of short
queries, this ends up missing IPC cache and ends up recreating threads/connections to the
same AM.
> It would be good to maintain this pool in {{ContainerRunnerImpl}} instead and recycle
as needed.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message