spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject Problem connecting to HBase
Date Fri, 13 Mar 2015 19:18:24 GMT

I am running a HBase test case. I am using the example from the following:

I created a very small HBase table with 5 rows and 2 columns.
I have attached a screenshot of the error log. I believe it is a problem
where the driver program is unable to establish connection to the hbase.

The following is my simple.sbt:

name := "Simple Project"

version := "1.0"

scalaVersion := "2.10.4"

libraryDependencies ++= Seq(

 "org.apache.spark" %% "spark-core" % "1.2.0",

 "org.apache.hbase" % "hbase" % "0.98.9-hadoop2" % "provided",

 "org.apache.hbase" % "hbase-client" % "0.98.9-hadoop2" % "provided",

 "org.apache.hbase" % "hbase-server" % "0.98.9-hadoop2" % "provided",

 "org.apache.hbase" % "hbase-common" % "0.98.9-hadoop2" % "provided"

I am using a 23 node cluster, did copy hbase-site.xml into /spark/conf
and set spark.executor.extraClassPath pointing to the /hbase/ folder in the

Also, while submitting the spark job I am including the required jars :

spark-submit --class "HBaseTest" --master yarn-cluster --driver-class-path

[image: Inline image 1]

It would be great if you could point where I am going wrong, and what could
be done to correct it.

Thank you for your time.
Thanks & Regards,
Haripriya Ayyalasomayajula
Graduate Student
Department of Computer Science
University of Houston
Contact : 650-796-7112

View raw message