hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Buttler, David" <buttl...@llnl.gov>
Subject RE: hbase crash after restart
Date Fri, 15 Jul 2011 16:54:12 GMT
You really don't need 3 zookeeper nodes for a 5 node cluster. 1 is sufficient.  
Are you managing zookeeper with hbase or independently?

Dave


-----Original Message-----
From: Jason Chuong [mailto:jason.chuong@cbsinteractive.com] 
Sent: Friday, July 15, 2011 5:17 AM
To: user@hbase.apache.org
Subject: hbase crash after restart

Hi All,

I have a 5-node cluster setup with 3 nodes as a part of zookeeper quorum.
When i restart the hbase master, the server try to connect to an unknown
host and then crash.
Anyone seen this error message before or know how to resolve this thanks

2011-07-15 05:10:49,158 INFO org.apache.hadoop.ipc.HbaseRPC: Problem
connecting to server: 10.16.129.21/10.16.129.21:50712
2011-07-15 05:11:10,162 INFO org.apache.hadoop.ipc.HbaseRPC: Problem
connecting to server: 10.16.129.21/10.16.129.21:50712
2011-07-15 05:11:31,166 INFO org.apache.hadoop.ipc.HbaseRPC: Problem
connecting to server: 10.16.129.21/10.16.129.21:50712
2011-07-15 05:11:31,170 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.net.SocketTimeoutException: 20000 millis timeout while waiting for
channel to be ready for connect. ch :
java.nio.channels.SocketChannel[connection-pending remote=
10.16.129.21/10.16.129.21:50712]
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:213)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:408)
at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:311)
at
org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:865)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:732)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
at $Proxy6.getProtocolVersion(Unknown Source)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:419)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:393)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:444)
at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:349)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.get

Mime
View raw message