drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chetan Kothari <chetan.koth...@oracle.com>
Subject Unknown Host Name issue
Date Thu, 26 Oct 2017 10:08:28 GMT
HI All

 

I am facing following issue when I am trying to query alluxio deployed in docker having host
name from Drill.

Scenario is as follows

 

.       Docker has been started with hostname tomcat on machine xyz.us.abc.com 

.       Alluxio has been started inside this docker and alluxio master running on port 19998

.       I have configured storage  plug-in in Drill with name alluxio mapped to xyz.us.abc.com:19998


.       Drill is able to connect to alluxio when I run use alluxio;

.       I am also able to see files present inside allusion when I run show files in alluxio

.       When I execute queries on these files present in alluxio, I get unknown host exception
with following stack trace

.       File has required permission and ownership to run from Drill

.       Issue here is that we have started docker with host name.  Previously I was able to
query alluxio, when we used to start docker without hostname

.       I tried multiple work around to fix  this issue. But still not able to fix it

 

Any input on following issue will be useful

 

 

Caused by: java.io.IOException: java.lang.RuntimeException: java.net.UnknownHostException:
tomcat

                  at org.apache.drill.exec.store.parquet.Metadata$MetadataGatherer.convertToIOException(Metadata.java:320)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.TimedRunnable.getValue(TimedRunnable.java:79)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.TimedRunnable.run(TimedRunnable.java:173)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.Metadata.getParquetFileMetadata_v3(Metadata.java:293)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.Metadata.getParquetTableMetadata(Metadata.java:270)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.Metadata.getParquetTableMetadata(Metadata.java:131)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.ParquetGroupScan.init(ParquetGroupScan.java:748)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.ParquetGroupScan.<init>(ParquetGroupScan.java:226)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.ParquetGroupScan.<init>(ParquetGroupScan.java:186)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.ParquetFormatPlugin.getGroupScan(ParquetFormatPlugin.java:170)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.ParquetFormatPlugin.getGroupScan(ParquetFormatPlugin.java:66)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.dfs.FileSystemPlugin.getPhysicalScan(FileSystemPlugin.java:144)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.AbstractStoragePlugin.getPhysicalScan(AbstractStoragePlugin.java:100)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.planner.logical.DrillTable.getGroupScan(DrillTable.java:85)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.planner.logical.DrillScanRel.<init>(DrillScanRel.java:90)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  ... 18 common frames omitted

Caused by: java.lang.RuntimeException: java.net.UnknownHostException: tomcat

                  at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-18.0.jar:na]

                  at alluxio.util.network.NetworkAddressUtils.getRpcPortSocketAddress(NetworkAddressUtils.java:560)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.file.FileSystemWorkerClient.<init>(FileSystemWorkerClient.java:85)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.file.FileSystemContext.createWorkerClient(FileSystemContext.java:91)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.block.DelegatedUnderStoreBlockInStream.<init>(DelegatedUnderStoreBlockInStream.java:54)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.block.UnderStoreBlockInStream$Factory.create(UnderStoreBlockInStream.java:92)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.file.FileInStream.createUnderStoreBlockInStream(FileInStream.java:288)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.file.FileInStream.updateBlockInStream(FileInStream.java:518)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.file.FileInStream.updateStreams(FileInStream.java:415)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.client.file.FileInStream.close(FileInStream.java:147) ~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.hadoop.HdfsFileInputStream.close(HdfsFileInputStream.java:108)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at java.io.FilterInputStream.close(FilterInputStream.java:181) ~[na:1.8.0_111]

                  at org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:457)
~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]

                  at org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:412)
~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]

                  at org.apache.drill.exec.store.parquet.Metadata.getParquetFileMetadata_v3(Metadata.java:373)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.Metadata.access$100(Metadata.java:81)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.Metadata$MetadataGatherer.runInner(Metadata.java:312)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.parquet.Metadata$MetadataGatherer.runInner(Metadata.java:300)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.TimedRunnable.run(TimedRunnable.java:56)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.store.TimedRunnable$LatchedRunnable.run(TimedRunnable.java:98)
~[drill-java-exec-1.11.0.jar:1.11.0]

                  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_111]

                  at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_111]

                  ... 3 common frames omitted

Caused by: java.net.UnknownHostException: tomcat

                  at java.net.InetAddress.getAllByName0(InetAddress.java:1280) ~[na:1.8.0_111]

                  at java.net.InetAddress.getAllByName(InetAddress.java:1192) ~[na:1.8.0_111]

                  at java.net.InetAddress.getAllByName(InetAddress.java:1126) ~[na:1.8.0_111]

                  at java.net.InetAddress.getByName(InetAddress.java:1076) ~[na:1.8.0_111]

                  at alluxio.util.network.NetworkAddressUtils.resolveHostName(NetworkAddressUtils.java:473)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.util.network.NetworkAddressUtils.getFqdnHost(NetworkAddressUtils.java:497)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  at alluxio.util.network.NetworkAddressUtils.getRpcPortSocketAddress(NetworkAddressUtils.java:556)
~[alluxio-core-client-spark-1.2.0-jar-with-dependencies.jar:na]

                  ... 23 common frames omitted

2017-10-26 02:21:11,699 [Client-1] INFO  o.a.d.j.i.DrillCursor$ResultsListener - [#2] Query
failed: 

org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: UnknownHostException:
tomcat

[Error Id: 5d0b7607-b9fd-4546-9fe9-755137680735 on xyz.us.abc.com:31010]

                  at org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:123)
[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:368)
[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:90)
[drill-java-exec-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:274)
[drill-rpc-1.11.0.jar:1.11.0]

                  at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:244)
[drill-rpc-1.11.0.jar:1.11.0]

                  at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
[netty-codec-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:254)
[netty-handler-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
[netty-codec-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:242)
[netty-codec-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:847)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
[netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354) [netty-transport-4.0.27.Final.jar:4.0.27.Final]

                  at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
[netty-common-4.0.27.Final.jar:4.0.27.Final]

                  at java.lang.Thread.run(Thread.java:745) [na:1.8.0_111]

     

Regards

Chetan

 

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message