drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Sankaran <sankarmahes...@gmail.com>
Subject Problem with hbase query
Date Thu, 02 Apr 2015 09:43:40 GMT
Hi,
        I am working in Apache Drill to query data from hbase.I
successfully enabled storage plugin for hbase but When i executed the query
it took long time, after that following error is displayed.

0: jdbc:drill:zk=nn01:2181,dn02:2181,dn03:218> select * from hbase.`cars`;
Query failed: NullPointerException:

Error: exception while executing query: Failure while executing query.
(state=,code=0)

*My drillbit.log is shows following error:*


2015-04-02 14:32:04,634 [2ae2feb4-d313-02e5-5455-6478ac17e58a:foreman] WARN
 o.a.d.e.store.hbase.DrillHBaseTable - Failure while loading table names
for database 'hbase'.
org.apache.hadoop.hbase.MasterNotRunningException:
org.apache.hadoop.hbase.MasterNotRunningException: Can't get connection to
ZooKeeper: KeeperErrorCode = OperationTimeout
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$StubMaker.makeStub(HConnectionManager.java:1628)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(HConnectionManager.java:1654)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getKeepAliveMasterService(HConnectionManager.java:1861)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHTableDescriptor(HConnectionManager.java:2649)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:397)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:402)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.drill.exec.store.hbase.DrillHBaseTable.<init>(DrillHBaseTable.java:40)
~[drill-storage-hbase-0.8.0.jar:0.8.0]
at
org.apache.drill.exec.store.hbase.HBaseSchemaFactory$HBaseSchema.getTable(HBaseSchemaFactory.java:77)
[drill-storage-hbase-0.8.0.jar:0.8.0]
at
net.hydromatic.optiq.jdbc.SimpleOptiqSchema.getTable(SimpleOptiqSchema.java:75)
[optiq-core-0.9-drill-r20.jar:na]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTableFrom(OptiqCatalogReader.java:87)
[optiq-core-0.9-drill-r20.jar:na]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTable(OptiqCatalogReader.java:70)
[optiq-core-0.9-drill-r20.jar:na]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTable(OptiqCatalogReader.java:42)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:67)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:75)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:85)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:785)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:774)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2605)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2590)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2813)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:85)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:785)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:774)
[optiq-core-0.9-drill-r20.jar:na]
at org.eigenbase.sql.SqlSelect.validate(SqlSelect.java:211)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:748)
[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:464)
[optiq-core-0.9-drill-r20.jar:na]
at net.hydromatic.optiq.prepare.PlannerImpl.validate(PlannerImpl.java:174)
[optiq-core-0.9-drill-r20.jar:na]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:157)
[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:133)
[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:145)
[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:773)
[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:204)
[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_45]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: org.apache.hadoop.hbase.MasterNotRunningException: Can't get
connection to ZooKeeper: KeeperErrorCode = OperationTimeout
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.checkIfBaseNodeAvailable(HConnectionManager.java:864)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.access$600(HConnectionManager.java:549)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(HConnectionManager.java:1554)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$StubMaker.makeStub(HConnectionManager.java:1600)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
... 35 common frames omitted
Caused by: org.apache.zookeeper.KeeperException$OperationTimeoutException:
KeeperErrorCode = OperationTimeout
at
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.checkZk(RecoverableZooKeeper.java:145)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:222)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:479)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.checkIfBaseNodeAvailable(HConnectionManager.java:853)
~[hbase-client-0.98.7-hadoop2.jar:0.98.7-hadoop2]
... 38 common frames omitted
2015-04-02 14:32:04,635 [2ae2feb4-d313-02e5-5455-6478ac17e58a:foreman] INFO
 o.a.drill.exec.work.foreman.Foreman - State change requested.  PENDING -->
FAILED
org.apache.drill.exec.planner.sql.QueryInputException: Failure validating
SQL. java.lang.NullPointerException
at
org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:147)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:773)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:204)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_45]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: net.hydromatic.optiq.tools.ValidationException:
java.lang.NullPointerException
at net.hydromatic.optiq.prepare.PlannerImpl.validate(PlannerImpl.java:176)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:157)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:133)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:145)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
... 5 common frames omitted
Caused by: java.lang.NullPointerException: null
at
org.apache.drill.exec.store.hbase.DrillHBaseTable.getRowType(DrillHBaseTable.java:54)
~[drill-storage-hbase-0.8.0.jar:0.8.0]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTableFrom(OptiqCatalogReader.java:94)
~[optiq-core-0.9-drill-r20.jar:na]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTable(OptiqCatalogReader.java:70)
~[optiq-core-0.9-drill-r20.jar:na]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTable(OptiqCatalogReader.java:42)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:67)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:75)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:85)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:785)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:774)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2605)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2590)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2813)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:85)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:785)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:774)
~[optiq-core-0.9-drill-r20.jar:na]
at org.eigenbase.sql.SqlSelect.validate(SqlSelect.java:211)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:748)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:464)
~[optiq-core-0.9-drill-r20.jar:na]
at net.hydromatic.optiq.prepare.PlannerImpl.validate(PlannerImpl.java:174)
~[optiq-core-0.9-drill-r20.jar:na]
... 8 common frames omitted
2015-04-02 14:32:04,776 [2ae2feb4-d313-02e5-5455-6478ac17e58a:foreman] INFO
 o.a.drill.exec.work.foreman.Foreman - foreman cleaning up - status: []
2015-04-02 14:32:04,778 [2ae2feb4-d313-02e5-5455-6478ac17e58a:foreman]
ERROR o.a.drill.exec.work.foreman.Foreman - Error
7abfca21-e54e-4ec3-93c8-74dc7f4872c4: NullPointerException:
org.apache.drill.exec.planner.sql.QueryInputException: Failure validating
SQL. java.lang.NullPointerException
at
org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:147)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:773)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:204)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_45]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_45]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: net.hydromatic.optiq.tools.ValidationException:
java.lang.NullPointerException
at net.hydromatic.optiq.prepare.PlannerImpl.validate(PlannerImpl.java:176)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:157)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:133)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
at
org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:145)
~[drill-java-exec-0.8.0-rebuffed.jar:0.8.0]
... 5 common frames omitted
Caused by: java.lang.NullPointerException: null
at
org.apache.drill.exec.store.hbase.DrillHBaseTable.getRowType(DrillHBaseTable.java:54)
~[drill-storage-hbase-0.8.0.jar:0.8.0]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTableFrom(OptiqCatalogReader.java:94)
~[optiq-core-0.9-drill-r20.jar:na]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTable(OptiqCatalogReader.java:70)
~[optiq-core-0.9-drill-r20.jar:na]
at
net.hydromatic.optiq.prepare.OptiqCatalogReader.getTable(OptiqCatalogReader.java:42)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:67)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:75)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:85)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:785)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:774)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2605)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2590)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2813)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:85)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:785)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:774)
~[optiq-core-0.9-drill-r20.jar:na]
at org.eigenbase.sql.SqlSelect.validate(SqlSelect.java:211)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:748)
~[optiq-core-0.9-drill-r20.jar:na]
at
org.eigenbase.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:464)
~[optiq-core-0.9-drill-r20.jar:na]
at net.hydromatic.optiq.prepare.PlannerImpl.validate(PlannerImpl.java:174)
~[optiq-core-0.9-drill-r20.jar:na]
... 8 common frames omitted

*But My Hbase Master is working well.My environment is,*

*Hortonworks hbase---> 0.98.4.2.2.0.0.*
*ApacheDril-----> 0.8*

Thanks
Mahesh Sankaran

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message