hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <>
Subject [jira] [Updated] (HIVE-18347) Allow dynamic lookup of Hive Metastores via Consul
Date Fri, 29 Dec 2017 16:48:00 GMT


Szehon Ho updated HIVE-18347:
    Attachment: HIVE-18347.1.patch

This patch allows a plugable Hive Metastore URI Resolver hook that is called to resolve Metastore
URI's from HiveMetastoreClient, and implements one that we use in production.  This connects
to our Marathon-based Consul service for lookup of a particular Consul-registered service,
and will read a consul-based scheme for hive.metastore.uris.

One can imagine other schemes, like for example Zookeeper-based Metastore registration, those
could also be implemented via this plugin.

> Allow dynamic lookup of Hive Metastores via Consul
> --------------------------------------------------
>                 Key: HIVE-18347
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Szehon Ho
>            Assignee: Szehon Ho
>         Attachments: HIVE-18347.1.patch
> In our organization, we have deployed HiveMetastore and HiveServer2 on Mesos as dynamic
services for scalability and flexibility.
> In this architecture, we would like to allow HiveServer2 to dynamically load balance
between Metastores (which may be scaled up and down or to different nodes) for different requests.

This message was sent by Atlassian JIRA

View raw message