hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12558) LLAP: output QueryFragmentCounters somewhere
Date Tue, 01 Dec 2015 21:44:11 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034638#comment-15034638
] 

Sergey Shelukhin commented on HIVE-12558:
-----------------------------------------

[~sseth] [~prasanth_j] fyi. I know next to nothing about how Hadoop metrics work, so I'd be
interested to look when I have time, but it won't be fast so if you have a quick solution...
;)

> LLAP: output QueryFragmentCounters somewhere
> --------------------------------------------
>
>                 Key: HIVE-12558
>                 URL: https://issues.apache.org/jira/browse/HIVE-12558
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>
> Right now, LLAP logs counters for every fragment; most of them are IO related and could
be very useful, they also include table name so that things like cache hit ratio, etc., could
be partitioned by table.
> We need to output them to some metric system (preserving the breakdown by table, possibly
also adding query ID or even stage) so that they'd be usable without grep/sed/awk.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message