hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <>
Subject [jira] [Updated] (HIVE-19008) Improve Spark session id logging
Date Mon, 06 Aug 2018 09:35:00 GMT


Sahil Takiar updated HIVE-19008:
       Resolution: Fixed
    Fix Version/s: 4.0.0
           Status: Resolved  (was: Patch Available)

Pushed to master, thanks Aihua for the review!

> Improve Spark session id logging
> --------------------------------
>                 Key: HIVE-19008
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>            Priority: Major
>             Fix For: 4.0.0
>         Attachments: HIVE-19008.1.patch, HIVE-19008.2.patch
> HoS users have two session ids, one id for the Hive session and another id for the Spark
session, both are UUIDs.
> I think some improvements could be made here:
> The Spark session id could just be a counter that is incremented for each new Spark session
within a Hive session. Each Spark session is still globally identifiable by its associated
Hive session id + its own counter. This may make more sense since the Hive session - Spark
session has a 1-to-many relationship, as in a single Hive session can contain multiple Spark
sessions, and each Spark session must belong to a Hive session.
> Furthermore, we should include both the Hive session id and Spark session id in the console
logs + the Spark Web UI.

This message was sent by Atlassian JIRA

View raw message