Cheng Lian created SPARK-6387:
---------------------------------
Summary: HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0
Key: SPARK-6387
URL: https://issues.apache.org/jira/browse/SPARK-6387
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.2.1, 1.3.0
Reporter: Cheng Lian
Reproduction steps:
# Compile Spark against Hive 0.12.0
{noformat}$ ./build/sbt -Pyarn,hadoop-2.4,hive,hive-thriftserver,hive-0.12.0,scala-2.10
-Dhadoop.version=2.4.1 clean assembly/assembly{noformat}
# Start the Thrift server in HTTP mode
Add the following stanza in {{hive-site.xml}}:
{noformat}<property>
<name>hive.server2.transport.mode</name>
<value>http</value>
</property>{noformat}
and
{noformat}$ ./bin/start-thriftserver.sh{noformat}
# Connect to the Thrift server via Beeline
{noformat}$ ./bin/beeline -u "jdbc:hive2://localhost:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice"{noformat}
# Execute any query and check the server log
We can see that no query execution related logs are output.
The reason is that, when running under HTTP mode, although we pass in a {{SparkSQLCLIService}}
instance ([here|https://github.com/apache/spark/blob/master/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala#L102])
to {{ThriftHttpCLIService}}, Hive 0.12.0 just ignores it, and instantiate a new {{CLIService}}
([here|https://github.com/apache/hive/blob/release-0.12.0/service/src/java/org/apache/hive/service/cli/thrift/ThriftHttpCLIService.java#L91-L92]
and [here|https://github.com/apache/hive/blob/release-0.12.0/service/src/java/org/apache/hive/service/cli/thrift/EmbeddedThriftBinaryCLIService.java#L32]).
Notice that while compiling against Hive 0.13.1, Spark SQL doesn't suffer from this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|