spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-17767) Spark SQL ExternalCatalog API custom implementation support
Date Mon, 03 Oct 2016 23:18:20 GMT

     [ https://issues.apache.org/jira/browse/SPARK-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Reynold Xin updated SPARK-17767:
--------------------------------
    Issue Type: Sub-task  (was: Improvement)
        Parent: SPARK-15777

> Spark SQL ExternalCatalog API custom implementation support
> -----------------------------------------------------------
>
>                 Key: SPARK-17767
>                 URL: https://issues.apache.org/jira/browse/SPARK-17767
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Alex Liu
>
> There is no way/easy way to configure Spark to use customized ExternalCatalog.  Internal
source code is hardcoded to use either hive or in-memory metastore. Spark SQL thriftserver
is hardcoded to use HiveExternalCatalog. We should be able to create a custom external catalog
and thriftserver should be able to use it. Potentially Spark SQL thriftserver shouldn't depend
on Hive thriftserer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message