spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <>
Subject [jira] [Updated] (SPARK-17767) Spark SQL ExternalCatalog API custom implementation support
Date Mon, 03 Oct 2016 23:18:20 GMT


Reynold Xin updated SPARK-17767:
    Issue Type: Sub-task  (was: Improvement)
        Parent: SPARK-15777

> Spark SQL ExternalCatalog API custom implementation support
> -----------------------------------------------------------
>                 Key: SPARK-17767
>                 URL:
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Alex Liu
> There is no way/easy way to configure Spark to use customized ExternalCatalog.  Internal
source code is hardcoded to use either hive or in-memory metastore. Spark SQL thriftserver
is hardcoded to use HiveExternalCatalog. We should be able to create a custom external catalog
and thriftserver should be able to use it. Potentially Spark SQL thriftserver shouldn't depend
on Hive thriftserer.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message