spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheng Lian (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-6387) HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0
Date Tue, 17 Mar 2015 12:26:38 GMT
Cheng Lian created SPARK-6387:
---------------------------------

             Summary: HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0
                 Key: SPARK-6387
                 URL: https://issues.apache.org/jira/browse/SPARK-6387
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.2.1, 1.3.0
            Reporter: Cheng Lian


Reproduction steps:
# Compile Spark against Hive 0.12.0
  {noformat}$ ./build/sbt -Pyarn,hadoop-2.4,hive,hive-thriftserver,hive-0.12.0,scala-2.10
-Dhadoop.version=2.4.1 clean assembly/assembly{noformat}
# Start the Thrift server in HTTP mode
  Add the following stanza in {{hive-site.xml}}:
  {noformat}<property>
  <name>hive.server2.transport.mode</name>
  <value>http</value>
</property>{noformat}
  and
  {noformat}$ ./bin/start-thriftserver.sh{noformat}
# Connect to the Thrift server via Beeline
  {noformat}$ ./bin/beeline -u "jdbc:hive2://localhost:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice"{noformat}
# Execute any query and check the server log
  We can see that no query execution related logs are output.

The reason is that, when running under HTTP mode, although we pass in a {{SparkSQLCLIService}}
instance ([here|https://github.com/apache/spark/blob/master/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala#L102])
to {{ThriftHttpCLIService}}, Hive 0.12.0 just ignores it, and instantiate a new {{CLIService}}
([here|https://github.com/apache/hive/blob/release-0.12.0/service/src/java/org/apache/hive/service/cli/thrift/ThriftHttpCLIService.java#L91-L92]
and [here|https://github.com/apache/hive/blob/release-0.12.0/service/src/java/org/apache/hive/service/cli/thrift/EmbeddedThriftBinaryCLIService.java#L32]).

Notice that while compiling against Hive 0.13.1, Spark SQL doesn't suffer from this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message