spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From KhajaAsmath Mohammed <mdkhajaasm...@gmail.com>
Subject Spark Hbase Hive error in EMR
Date Fri, 09 Apr 2021 18:15:20 GMT
Hi,

I am trying to connect hbase which sits on top of hive as external table. I
am getting below exception. Am I missing anything to pass here?


21/04/09 18:08:11 INFO ZooKeeper: Client environment:user.dir=/
21/04/09 18:08:11 INFO ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=90000
watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@7217e615
21/04/09 18:08:11 INFO ConnectionManager$HConnectionImplementation: Closing
zookeeper sessionid=0x0
21/04/09 18:08:11 INFO ClientCnxn: Opening socket connection to server
localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL
(unknown error)
21/04/09 18:08:11 INFO ZooKeeper: Session: 0x0 closed
21/04/09 18:08:11 INFO ClientCnxn: EventThread shut down

java.io.IOException: java.lang.reflect.InvocationTargetException
21/04/09 18:08:11 INFO AppLog$:
java.io.IOException: java.lang.reflect.InvocationTargetException

java.lang.reflect.InvocationTargetException

21/04/09 18:08:11 INFO AppLog$:
java.lang.reflect.InvocationTargetException

21/04/09 18:08:11 INFO SparkContext: Invoking stop() from shutdown hook

spark-submit --files
/etc/hbase/conf/hbase-site.xml,/etc/hive/conf/hive-site.xml --jars
/usr/lib/hive/lib/hive-hbase-handler.jar,/usr/lib/hbase/hbase-client.jar,/usr/lib/hbase/hbase-protocol.jar,/usr/lib/hbase/hbase-common.jar,/usr/lib/hbase/hbase-it.jar,/usr/lib/hbase/hbase-server.jar,/usr/lib/hbase/hbase-hadoop2-compat.jar
--deploy-mode client --executor-memory 4g --class
com.figg.clx.drivers.HBASEExportToS3


Thanks,
Asmath

Mime
View raw message