[ https://issues.apache.org/jira/browse/TAJO-522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877241#comment-13877241 ] Hudson commented on TAJO-522: ----------------------------- SUCCESS: Integrated in Tajo-master-build #22 (See [https://builds.apache.org/job/Tajo-master-build/22/]) TAJO-537: After TAJO-522, still OutOfMemoryError: unable to create new native thread. (Min Zhou via hyunsik) (hyunsik: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=e57cf426d8d1d1b924a32a10f81a8912f2b0c45f) * tajo-rpc/src/main/java/org/apache/tajo/rpc/AsyncRpcClient.java * CHANGES.txt * tajo-rpc/src/main/java/org/apache/tajo/rpc/BlockingRpcClient.java * tajo-rpc/src/main/java/org/apache/tajo/rpc/NettyClientBase.java * tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/querymaster/QueryInProgress.java > OutOfMemoryError: unable to create new native thread > ---------------------------------------------------- > > Key: TAJO-522 > URL: https://issues.apache.org/jira/browse/TAJO-522 > Project: Tajo > Issue Type: Bug > Affects Versions: 0.8-incubating > Reporter: Min Zhou > Assignee: hyoungjunkim > Priority: Critical > Fix For: 0.8-incubating > > Attachments: TAJO-522.patch, tajo-site.xml > > > Another exception occurs on the client side when I run a query > {noformat} > Progress: 0%, response time: 190.197 sec > com.google.protobuf.ServiceException: java.lang.OutOfMemoryError: unable to create new native thread > at org.apache.tajo.client.TajoClient.getQueryStatus(TajoClient.java:193) > at org.apache.tajo.cli.TajoCli.getQueryResult(TajoCli.java:353) > at org.apache.tajo.cli.TajoCli.executeStatements(TajoCli.java:319) > at org.apache.tajo.cli.TajoCli.runShell(TajoCli.java:228) > at org.apache.tajo.cli.TajoCli.main(TajoCli.java:735) > Caused by: java.io.IOException: java.lang.OutOfMemoryError: unable to create new native thread > at org.apache.tajo.rpc.NettyClientBase.init(NettyClientBase.java:76) > at org.apache.tajo.rpc.BlockingRpcClient.(BlockingRpcClient.java:71) > at org.apache.tajo.rpc.RpcConnectionPool.makeConnection(RpcConnectionPool.java:54) > at org.apache.tajo.rpc.RpcConnectionPool.getConnection(RpcConnectionPool.java:63) > at org.apache.tajo.client.TajoClient.getQueryStatus(TajoClient.java:188) > ... 4 more > Caused by: java.lang.OutOfMemoryError: unable to create new native thread > at java.lang.Thread.start0(Native Method) > at java.lang.Thread.start(Thread.java:640) > at java.util.concurrent.ThreadPoolExecutor.addIfUnderMaximumPoolSize(ThreadPoolExecutor.java:727) > at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:657) > at org.jboss.netty.util.internal.DeadLockProofWorker.start(DeadLockProofWorker.java:38) > at org.jboss.netty.channel.socket.nio.AbstractNioSelector.openSelector(AbstractNioSelector.java:343) > at org.jboss.netty.channel.socket.nio.AbstractNioSelector.(AbstractNioSelector.java:95) > at org.jboss.netty.channel.socket.nio.AbstractNioWorker.(AbstractNioWorker.java:53) > at org.jboss.netty.channel.socket.nio.NioWorker.(NioWorker.java:45) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.createWorker(NioWorkerPool.java:45) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.createWorker(NioWorkerPool.java:28) > at org.jboss.netty.channel.socket.nio.AbstractNioWorkerPool.newWorker(AbstractNioWorkerPool.java:99) > at org.jboss.netty.channel.socket.nio.AbstractNioWorkerPool.init(AbstractNioWorkerPool.java:69) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.(NioWorkerPool.java:39) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.(NioWorkerPool.java:33) > at org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory.(NioClientSocketChannelFactory.java:151) > at org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory.(NioClientSocketChannelFactory.java:116) > at org.apache.tajo.rpc.NettyClientBase.init(NettyClientBase.java:54) > ... 8 more > java.lang.OutOfMemoryError: unable to create new native thread > 2014-01-19 23:12:19,975 WARN client.TajoClient (TajoClient.java:closeQuery(110)) - Fail to close a QueryMaster connection (qid=q_1390100273039_0012, msg=java.lang.OutOfMemoryError: unable to create new native thread) > java.io.IOException: java.lang.OutOfMemoryError: unable to create new native thread > at org.apache.tajo.rpc.NettyClientBase.init(NettyClientBase.java:76) > at org.apache.tajo.rpc.BlockingRpcClient.(BlockingRpcClient.java:71) > at org.apache.tajo.rpc.RpcConnectionPool.makeConnection(RpcConnectionPool.java:54) > at org.apache.tajo.rpc.RpcConnectionPool.getConnection(RpcConnectionPool.java:63) > at org.apache.tajo.client.TajoClient.closeQuery(TajoClient.java:106) > at org.apache.tajo.cli.TajoCli.executeStatements(TajoCli.java:323) > at org.apache.tajo.cli.TajoCli.runShell(TajoCli.java:228) > at org.apache.tajo.cli.TajoCli.main(TajoCli.java:735) > Caused by: java.lang.OutOfMemoryError: unable to create new native thread > at java.lang.Thread.start0(Native Method) > at java.lang.Thread.start(Thread.java:640) > at java.util.concurrent.ThreadPoolExecutor.addIfUnderMaximumPoolSize(ThreadPoolExecutor.java:727) > at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:657) > at org.jboss.netty.util.internal.DeadLockProofWorker.start(DeadLockProofWorker.java:38) > at org.jboss.netty.channel.socket.nio.AbstractNioSelector.openSelector(AbstractNioSelector.java:343) > at org.jboss.netty.channel.socket.nio.AbstractNioSelector.(AbstractNioSelector.java:95) > at org.jboss.netty.channel.socket.nio.AbstractNioWorker.(AbstractNioWorker.java:53) > at org.jboss.netty.channel.socket.nio.NioWorker.(NioWorker.java:45) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.createWorker(NioWorkerPool.java:45) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.createWorker(NioWorkerPool.java:28) > at org.jboss.netty.channel.socket.nio.AbstractNioWorkerPool.newWorker(AbstractNioWorkerPool.java:99) > at org.jboss.netty.channel.socket.nio.AbstractNioWorkerPool.init(AbstractNioWorkerPool.java:69) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.(NioWorkerPool.java:39) > at org.jboss.netty.channel.socket.nio.NioWorkerPool.(NioWorkerPool.java:33) > at org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory.(NioClientSocketChannelFactory.java:151) > at org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory.(NioClientSocketChannelFactory.java:116) > at org.apache.tajo.rpc.NettyClientBase.init(NettyClientBase.java:54) > ... 7 more > {noformat} > I am not sure why client side need to create quite a lot of threads. -- This message was sent by Atlassian JIRA (v6.1.5#6160)