spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Missing SparkSQLCLIDriver and Beeline drivers in Spark
Date Mon, 17 Nov 2014 18:34:37 GMT
Minor correction: there was a typo in commandline

hive-thirftserver should be hive-thriftserver

Cheers

On Thu, Aug 7, 2014 at 6:49 PM, Cheng Lian <lian.cs.zju@gmail.com> wrote:

> Things have changed a bit in the master branch, and the SQL programming
> guide in master branch actually doesn’t apply to branch-1.0-jdbc.
>
> In branch-1.0-jdbc, Hive Thrift server and Spark SQL CLI are included in
> the hive profile and are thus not enabled by default. You need to either
>
>    - pass -Phive to Maven to enable it, or
>    - use SPARK_HIVE=true ./sbt/sbt assembly
>
> In the most recent master branch, however, Hive Thrift server and Spark
> SQL CLI are moved into a separate hive-thriftserver profile. And our SBT
> build file now delegates to Maven. So, to build the master branch, you can
> either
>
>    - ./sbt/sbt -Phive-thirftserver clean assembly/assembly, or
>    - mvn -Phive-thriftserver clean package -DskipTests
>
> On Fri, Aug 8, 2014 at 6:12 AM, ajatix <ajay@sigmoidanalytics.com> wrote:
>
> Hi
>>
>> I wish to migrate from shark to the spark-sql shell, where I am facing
>> some
>> difficulties in setting up.
>>
>> I cloned the "branch-1.0-jdbc" to test out the spark-sql shell, but I am
>> unable to run it after building the source.
>>
>> I've tried two methods for building (with Hadoop 1.0.4) - sbt/sbt
>> assembly;
>> and mvn -DskipTests clean package -X. Both build successfully, but when I
>> run bin/spark-sql, I get the following error:
>>
>> Exception in thread "main" java.lang.ClassNotFoundException:
>> org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>>         at java.lang.Class.forName0(Native Method)
>>         at java.lang.Class.forName(Class.java:270)
>>         at
>> org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:311)
>>         at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:73)
>>         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>>
>> and when I run bin/beeline, I get this:
>> Error: Could not find or load main class org.apache.hive.beeline.BeeLine
>>
>> bin/spark-shell works fine. It there something else I have to add to the
>> build parameters?
>> According to this -
>> https://github.com/apache/spark/blob/master/docs/sql-programming-guide.md,
>> I
>> tried rebuilding with -Phive-thriftserver, but it failed to detect the
>> library while building.
>>
>> Thanks and Regards
>> Ajay
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Missing-SparkSQLCLIDriver-and-Beeline-drivers-in-Spark-tp11724.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>  ​
>

Mime
View raw message