tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3991) Unmanaged tez sessions
Date Thu, 13 Sep 2018 20:02:00 GMT
Prasanth Jayachandran created TEZ-3991:

             Summary: Unmanaged tez sessions
                 Key: TEZ-3991
                 URL: https://issues.apache.org/jira/browse/TEZ-3991
             Project: Apache Tez
          Issue Type: New Feature
    Affects Versions: 0.10.0
            Reporter: Prasanth Jayachandran

Provide an option for launching tez AM in unmanaged mode. In unmanaged mode, tez AMs can register
itself with Zookeeper which clients (like HiveServer2) can discover via zk registry client. 

HiveServer2 currently manages the lifecycle of tez AMs. The unmanaged mode will let AM come
up on their own (can be via simple java launcher) and be discoverable for others. 

Example use case for this is, HiveServer2 can discover already running AMs and can attach
to it for DAG submission and detach when done executing queries. AMs can similarly discover
LLAP daemons via task scheduler plugin for submitting tasks. 

A mode to cut off interactions with RM will also useful since for LLAP no on-demand containers
are required.

This message was sent by Atlassian JIRA

View raw message