hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18088) Add WM event traces at query level for debugging
Date Sun, 03 Dec 2017 09:55:01 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275875#comment-16275875
] 

Prasanth Jayachandran commented on HIVE-18088:
----------------------------------------------

Updated wm summary events
{code:title=text}
QueryId: pjayachandran_20171203014141_c75c92a9-9f39-424d-8cec-cf20ca8569aa
SessionId: dba75a3b-db41-4d95-9bce-a334f738efcd
Applied Triggers: [{ name: slow_in_bi, expression: ELAPSED_TIME > 1000, action: MOVE TO
default.etl }]
----------------------------------------------------------------------------------------------
  EVENT          START_TIMESTAMP            END_TIMESTAMP  ELAPSED_MS CLUSTER %          POOL
----------------------------------------------------------------------------------------------
    GET 2017-12-03T09:41:41.964Z 2017-12-03T09:41:41.964Z           0     80.00    default.bi
   MOVE 2017-12-03T09:41:43.430Z 2017-12-03T09:41:43.431Z           1     20.00   default.etl
 RETURN 2017-12-03T09:41:54.119Z 2017-12-03T09:41:54.119Z           0      0.00          null
----------------------------------------------------------------------------------------------
{code}

{code:title=json}
{
  "queryId" : "pjayachandran_20171203014257_d09e0fdc-44b3-4034-b120-43e1ed279caf",
  "queryStartTime" : 1512294177317,
  "queryEndTime" : 1512294184917,
  "queryCompleted" : true,
  "queryWmEvents" : [ {
    "wmTezSessionInfo" : {
      "sessionId" : "dba75a3b-db41-4d95-9bce-a334f738efcd",
      "poolName" : "default.bi",
      "clusterPercent" : 80.0
    },
    "eventStartTimestamp" : 1512294177779,
    "eventEndTimestamp" : 1512294177779,
    "eventType" : "GET",
    "elapsedTime" : 0
  }, {
    "wmTezSessionInfo" : {
      "sessionId" : "dba75a3b-db41-4d95-9bce-a334f738efcd",
      "poolName" : "default.etl",
      "clusterPercent" : 20.0
    },
    "eventStartTimestamp" : 1512294179327,
    "eventEndTimestamp" : 1512294179327,
    "eventType" : "MOVE",
    "elapsedTime" : 0
  }, {
    "wmTezSessionInfo" : {
      "sessionId" : "dba75a3b-db41-4d95-9bce-a334f738efcd",
      "poolName" : null,
      "clusterPercent" : 0.0
    },
    "eventStartTimestamp" : 1512294184936,
    "eventEndTimestamp" : 1512294184936,
    "eventType" : "RETURN",
    "elapsedTime" : 0
  } ],
  "appliedTriggers" : [ {
    "name" : "slow_in_bi",
    "expression" : {
      "counterLimit" : {
        "limit" : 1000,
        "name" : "ELAPSED_TIME"
      },
      "predicate" : "GREATER_THAN"
    },
    "action" : {
      "type" : "MOVE_TO_POOL",
      "poolName" : "default.etl"
    },
    "violationMsg" : "Trigger { name: slow_in_bi, expression: ELAPSED_TIME > 1000, action:
MOVE TO default.etl } violated. Current value: 1720"
  } ],
  "desiredCounters" : [ ],
  "currentCounters" : {  },
  "elapsedTime" : 7632
}
{code}

> Add WM event traces at query level for debugging
> ------------------------------------------------
>
>                 Key: HIVE-18088
>                 URL: https://issues.apache.org/jira/browse/HIVE-18088
>             Project: Hive
>          Issue Type: Sub-task
>    Affects Versions: 3.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>         Attachments: HIVE-18088.1.patch, HIVE-18088.2.patch, HIVE-18088.3.patch, HIVE-18088.WIP.patch
>
>
> For debugging and testing purpose, expose workload manager events via /jmx endpoint and
print summary at the scope of query.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message