hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Manamcheri (JIRA)" <j...@apache.org>
Subject [jira] [Work stopped] (HIVE-21045) Add connection pool info and rolling performance info to the metrics system
Date Fri, 28 Dec 2018 18:29:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Work on HIVE-21045 stopped by Karthik Manamcheri.
-------------------------------------------------
> Add connection pool info and rolling performance info to the metrics system
> ---------------------------------------------------------------------------
>
>                 Key: HIVE-21045
>                 URL: https://issues.apache.org/jira/browse/HIVE-21045
>             Project: Hive
>          Issue Type: Improvement
>          Components: Standalone Metastore
>            Reporter: Karthik Manamcheri
>            Assignee: Karthik Manamcheri
>            Priority: Minor
>
> There are two key metrics which I think we lack and which would be really great to help
with scaling visibility in HMS.
> *Average API duration for the past 'n' minutes*
> We already compute and log the duration of API calls in the {{PerfLogger}}. We don't
have any gauge on what the average duration of an API call is for the past some bucket of
time. This will give us an insight into if there is load on the server which is increasing
the average API response time.
>  
> *RDBMS Connection wait time*
> We can use different connection pooling libraries such as bonecp or hikaricp. These pool
managers expose statistics such as average time waiting to get a connection, number of connections
active, etc. We should expose this as a metric so that we can track if the the connection
pool size configured is too small and we are saturating!
> These metrics would help catch problems with HMS resource contention before they actually
have jobs failing.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message