hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19008) Improve Spark session id logging
Date Fri, 13 Apr 2018 21:14:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16437934#comment-16437934
] 

Sahil Takiar commented on HIVE-19008:
-------------------------------------

Right now we are displaying the Spark session id in the web ui, we should fix that so that
we display the Hive session id as that is probably more relevant.

> Improve Spark session id logging
> --------------------------------
>
>                 Key: HIVE-19008
>                 URL: https://issues.apache.org/jira/browse/HIVE-19008
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Sahil Takiar
>            Priority: Major
>
> HoS users have two session ids, one id for the Hive session and another id for the Spark
session, both are UUIDs.
> I think some improvements could be made here:
> The Spark session id could just be a counter that is incremented for each new Spark session
within a Hive session. Each Spark session is still globally identifiable by its associated
Hive session id + its own counter. This may make more sense since the Hive session - Spark
session has a 1-to-many relationship, as in a single Hive session can contain multiple Spark
sessions, and each Spark session must belong to a Hive session.
> Furthermore, we should include both the Hive session id and Spark session id in the console
logs + the Spark Web UI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message