hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19752) PerfLogger integration for critical Hive-on-S3 paths
Date Fri, 01 Jun 2018 14:02:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498029#comment-16498029
] 

Sahil Takiar commented on HIVE-19752:
-------------------------------------

This is probably useful in general too, not just for S3. Added PerLogger wrappers around {{getInputPaths}},
{{loadPartition}}, {{loadTable}}, {{loadDynamicPartitions}} and anywhere where files get moved
to their final directory.

> PerfLogger integration for critical Hive-on-S3 paths
> ----------------------------------------------------
>
>                 Key: HIVE-19752
>                 URL: https://issues.apache.org/jira/browse/HIVE-19752
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>            Priority: Major
>         Attachments: HIVE-19752.1.patch
>
>
> There are several areas where Hive performs a lot of S3 operations, it would be good
to add PerfLogger statements around this so we can measure how long they take.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message