spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Valeriy Trofimov <valtroffut...@gmail.com>
Subject Re: Error When Creating External Hive Table Via Thrift Server
Date Wed, 03 Jul 2019 20:05:04 GMT
Hi All,

Ping.

Basically, I need a hint on how to enable HiveSQL support in Spark Thrift
Server, instead of using teh default Spark SQL. I need an equivalent of
calling SparkSession.enableHiveSupport() if I did it programmmatically.
I cannot do it programmatically, because the project requirements are to
use Thrift Server, which for some reason uses Spark SQL instead of HiveQL,
which should be a default behavior, because Thrift Server uses Hive.

Thanks,
Val

On Tue, Jul 2, 2019 at 4:34 PM Valeriy Trofimov <valtroffuture@gmail.com>
wrote:

> Hi All,
>
> I'm trying to create and external table using Thrift Server to which I'm
> connected via Beeline. In order to do this I run the following Hive SQL
> query, as described here:
> https://cwiki.apache.org/confluence/display/Hive/Druid+Integration
>
> CREATE EXTERNAL TABLE druid_table_1
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> TBLPROPERTIES ("druid.datasource" = "test");
>
> Doing it shows this error:
>
> 1: jdbc:hive2://localhost:10000> CREATE EXTERNAL TABLE druid_table_1
> 1: jdbc:hive2://localhost:10000> STORED BY
> 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> 1: jdbc:hive2://localhost:10000> TBLPROPERTIES ("druid.datasource" =
> "test");
> Error: org.apache.spark.sql.catalyst.parser.ParseException:
> Operation not allowed: STORED BY(line 2, pos 0)
>
> == SQL ==
> CREATE EXTERNAL TABLE druid_table_1
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> ^^^
> TBLPROPERTIES ("druid.datasource" = "test") (state=,code=0)
>
> Googling this error results in this JIRA:
>
> https://jira.mongodb.org/browse/HADOOP-301
>
> I've tried all the solutions in the JIRA, but none of them worked.
>
> Do you have any advice on how to solve this issue?
>
> Thank you,
> Val
>
>

Mime
View raw message