hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Bates <christopher.andrew.ba...@gmail.com>
Subject Re: Config Problems with HBase and Jetty
Date Fri, 22 Jan 2010 23:42:06 GMT
So I've been still trying to work this problem out and haven't had any
success.  Here is another pastebin of the issues:

http://pastebin.com/m2e19f84b

So basically here is what I'm trying to do:
1. Run HBase Java API (0.20.1) from a Jetty Webserver (setup on
172.16.1.95:8888).  I have handlers that are feeding objects that contain
the different API calls I want to make.  The handlers are setup with Spring.

2. The application is built and then runs after building.  I have stared at
my build.xml file many times and I'm sure hbase-site.xml and
hbase-default.xml are included in the runtime conf directories, and the jars
that I need are all in my runtime lib directory.  I can post screenshots,
but I'm sure they are in my classpath.

3.  I'm running the program on 172.16.1.95.  In the hbase-site.xml, my
zookeepers are 172.16.1.46, 172.16.1.95, 172.16.1.96. My regionservers are
just 172.16.1.95 and 172.16.1.96 (I sorta forget how I originally set up the
system, so my regionserver file could possibly be another source of error).

4.  In a moment of desperation, I just decided to include ALL of Hbase's
conf files in my runtime conf directory.  I get a different response and the
system hangs (doesn't return anything and has a loading sign).

Here is a thread dump for the 95 regionserver box.
http://pastebin.com/m1feb7a8f.  Here is the output I see at the command
line:  http://pastebin.com/ma6e7ef7


Are there any Web-server API configuration setups I can follow?  Should I
upgrade to 0.20.2?  Should I try another web server (Tomcat?).

Thanks again for the help




On Wed, Jan 20, 2010 at 8:04 PM, stack <stack@duboce.net> wrote:

> So, pardon me, I'm a little confused.  The thread dump below looks like a
> bunch of handlers waiting on something to happen.  The hbase web ui looks
> healthy.  You are trying to embed hbase client inside a jetty webapp,
> right?
>
> Looking at this, http://pastebin.com/m3147adf1, this looks wrong:
>
>
>   1.      [exec] 2010-01-20 16:13:00.769::INFO:  Started SocketConnector@
>   0.0.0.0:8888
>   2.      [exec] 16:13:06,133 DEBUG [24109300@qtp-15206466-0
> ,Configuration]
>    java.io.IOException<
> http://www.google.com/search?hl=en&q=allinurl%3AIOException+java.sun.com&btnI=I%27m%20Feeling%20Lucky
> >:
>   config()
>   3.      [exec]     at org.apache.hadoop.conf.Configuration.<init>(
>   Configuration.java:210)
>   4.      [exec]     at org.apache.hadoop.conf.Configuration.<init>(
>   Configuration.java:197)
>   5.      [exec]     at org.apache.hadoop.hbase.HBaseConfiguration.<init>(
>   HBaseConfiguration.java:33)
>   6.      [exec]     at com.grooveshark.HBaseHandler.handle(HBaseHandler.
>   java:25)
>   7.      [exec]     at org.mortbay.jetty.handler.HandlerWrapper.handle(
>   HandlerWrapper.java:152)
>   8.      [exec]     at org.mortbay.jetty.Server.handle(Server.java:326)
>   9.      [exec]     at org.mortbay.jetty.HttpConnection.handleRequest(
>   HttpConnection.java:536)
>   10.      [exec]     at org.mortbay.jetty.HttpConnection$RequestHandler.
>   headerComplete(HttpConnection.java:913)
>   11.      [exec]     at org.mortbay.jetty.HttpParser.parseNext(HttpParser.
>   java:539)
>   12.      [exec]     at org.mortbay.jetty.HttpParser.parseAvailable(
>   HttpParser.java:212)
>   13.      [exec]     at org.mortbay.jetty.HttpConnection.handle(
>   HttpConnection.java:405)
>   14.      [exec]     at org.mortbay.jetty.bio.SocketConnector$Connection.
>   run(SocketConnector.java:228)
>   15.      [exec]     at org.mortbay.thread.QueuedThreadPool$PoolThread.run
>   (QueuedThreadPool.java:582)
>
>
>
>
>
>
> This is as though you still do not have hbase conf directory on the jetty
> CLASSPATH?
>
> This is good: "Connecting to /172.16.1.96:6002"
>
> This is the right location?  It got this from hbase-site.xml?  Maybe its
> missing hbase-default.xml?
>
> Oh, I see you have DEBUG logging on for RPC.  Do you have all DEBUG on for
> all hadoop packages?  It looks like stuff is working?
>
> St.Ack
>
>
> On Wed, Jan 20, 2010 at 4:12 PM, Chris Bates <
> christopher.andrew.bates@gmail.com> wrote:
>
> > What exactly do you mean by client exceptions? Or where can I find them?
>  I
> > pastebin'd the exceptions I got from the command line. The web browser is
> > blank and just has a loading sign until I kill the process.  If I look at
> > the Hbase Web UI from the crunch2 box where I ran the program, everything
> > seems normal, but I'll paste that:
> >
> > Web UI:
> > http://pastebin.com/mef9a432
> >
> > Thread Dump:
> > http://pastebin.com/m76022dea
> >
> > On Wed, Jan 20, 2010 at 6:05 PM, stack <stack@duboce.net> wrote:
> >
> > > I was thinking hadoop perms.  But if shell works, then its probably
> fine.
> > >  Can you pastebin client exceptions?  Thanks,
> > > St.Ack
> > >
> > > On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
> > > christopher.andrew.bates@gmail.com> wrote:
> > >
> > > > Yeah, we're just using the default so no zoo.cfg.  Permissions are
> fine
> > > as
> > > > I
> > > > can ssh into any other hadoop box without password.  Although it
> looks
> > > like
> > > > permissions aren't set on the log directory.  I'm currently VPN'd, so
> > > maybe
> > > > its a networking issue??
> > > >
> > > > Pastebin: http://pastebin.com/m3147adf1
> > > >
> > > > Hbase shell is working:
> > > > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5}
> > > > ROW                          COLUMN+CELL
> > > >
> > > >  -10095526042667             column=user:theme,
> > > timestamp=-10095526042667,
> > > > value=Frost
> > > >  -10095526042683             column=user:theme,
> > > timestamp=-10095526042683,
> > > > value=Frost
> > > >  -10095526042854             column=user:theme,
> > > timestamp=-10095526042854,
> > > > value=Frost
> > > >  -10095526042870             column=user:theme,
> > > timestamp=-10095526042870,
> > > > value=Frost
> > > > 5 row(s) in 0.2570 seconds
> > > >
> > > > Jetty is working:
> > > >
> > > > // Substitute HBase config for test stringbuilder
> > > >
> > > > StringBuilder builder = new StringBuilder();
> > > >
> > > >        builder.append("Blah blah blah");
> > > >
> > > >        response.getOutputStream().write(
> > > >                builder.toString().getBytes());
> > > >
> > > > Outputs "Blah blah blah" to the screen.
> > > >
> > > >
> > > >
> > > > On Wed, Jan 20, 2010 at 4:18 PM, stack <stack@duboce.net> wrote:
> > > >
> > > > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> > > > > Robert.Gibbon@vodafone.com> wrote:
> > > > >
> > > > > >
> > > > > > Try putting the directory holding zoo.cfg on the classpath - you
> > have
> > > a
> > > > > > zoo.cfg file, right?
> > > > > >
> > > > >
> > > > > Default is to read zoo configuration from hbase-site.xml -- e.g.
> > > > > ensemble/quorum members -- but if a zoo.cfg is present, we'll read
> > that
> > > > > ahead of hbase-site.xml.
> > > > > St.Ack
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: saint.ack@gmail.com on behalf of stack
> > > > > > Sent: Wed 1/20/2010 9:53 PM
> > > > > > To: hbase-user@hadoop.apache.org
> > > > > > Subject: Re: Config Problems with HBase and Jetty
> > > > > >
> > > > > > Can you pastebin the below?  Its hard to read in email.  Maybe
> its
> > a
> > > > > > permissions prob?  I see lots of 'from an unknown user got
> value'.
> > >  Can
> > > > > you
> > > > > > get to your hbase cluster using hbase shell ok?   From host
> running
> > > > > jetty?
> > > > > >
> > > > > > St.Ack
> > > > > >
> > > > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > >
> > > > > > > Ah. good catch...getting more errors still....
> > > > > > >
> > > > > > >  [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > >     [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > >     [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > >     [exec] at
> > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > >     [exec] at
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > >     [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > >     [exec] at
> > > > > > >
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > >     [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > >     [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > >     [exec] at
> > > > > > >
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > >     [exec] at
> > > > > > >
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > >     [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > >     [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > >     [exec]
> > > > > > >      [exec] 15:33:31,226 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > > Client
> > > > > > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009
> > > 18:48
> > > > > GMT
> > > > > > >     [exec] 15:33:31,227 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:host.name=crunch2.local
> > > > > > >     [exec] 15:33:31,227 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.version=1.6.0_14
> > > > > > >     [exec] 15:33:31,228 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.vendor=Sun Microsystems Inc.
> > > > > > >     [exec] 15:33:31,228 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > > > > >     [exec] 15:33:31,228 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > > > > >     [exec] 15:33:31,229 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > > > > >     [exec] 15:33:31,229 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.io.tmpdir=/tmp
> > > > > > >     [exec] 15:33:31,230 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.compiler=<NA>
> > > > > > >     [exec] 15:33:31,230 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.name=Linux
> > > > > > >     [exec] 15:33:31,230 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.arch=i386
> > > > > > >     [exec] 15:33:31,231 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.version=2.6.28-11-generic
> > > > > > >     [exec] 15:33:31,232 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.name=hadoop
> > > > > > >     [exec] 15:33:31,232 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.home=/home/hadoop
> > > > > > >     [exec] 15:33:31,233 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > > > > >     [exec] 15:33:31,236 INFO  [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > > > Initiating client connection, connectString=localhost:2181
> > > > > > > sessionTimeout=60000
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > > > > >     [exec] 15:33:31,241 INFO  [24109300@qtp-15206466-0
> > ,ClientCnxn]
> > > > > > > zookeeper.disableAutoWatchReset is false
> > > > > > >     [exec] 15:33:31,291 INFO
>  [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > > > > > >     [exec] 15:33:31,302 INFO
>  [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Priming connection to java.nio.channels.SocketChannel[connected
> > > > > > > local=/0:0:0:0:0:0:0:1:41216
> > remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > > > > >     [exec] 15:33:31,320 INFO
>  [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Server connection successful
> > > > > > >     [exec] 15:33:31,379 DEBUG
> > > > > > > [24109300@qtp-15206466-0-EventThread
> > > > > ,HConnectionManager$ClientZKWatcher]
> > > > > > > Got ZooKeeper event, state: SyncConnected, type: None, path:
> null
> > > > > > >     [exec] 15:33:31,386 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: -8,101  replyHeader::
> > > -8,80,0
> > > > > > >  request:: 0,v{},v{},v{}  response:: null
> > > > > > >     [exec] 15:33:31,404 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 1,1  replyHeader::
> > > 1,81,-110
> > > > > > >  request:: '/hbase,,v{s{31,s{'world,'anyone}}},0  response::
> > > > > > >     [exec] 15:33:31,438 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 2,3  replyHeader::
> 2,81,0
> > > > > > >  request::
> > > > > > > '/hbase/safe-mode,F  response::
> > > > > > >
> > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > > > > >     [exec] 15:33:31,453 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 3,4  replyHeader::
> 3,81,0
> > > > > > >  request::
> > > > > > > '/hbase/root-region-server,F  response::
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > > > > >     [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> > > > > ,ZooKeeperWrapper]
> > > > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > > > > >     [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > The
> > > > > > > ping interval is60000ms.
> > > > > > >     [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > > > Connecting to /172.16.1.96:60020
> > > > > > >     [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user:
> starting,
> > > > > having
> > > > > > > connections 1
> > > > > > >     [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #0
> > > > > > >     [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #0
> > > > > > >     [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getProtocolVersion 139
> > > > > > >     [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #1
> > > > > > >     [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #1
> > > > > > >     [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getRegionInfo 28
> > > > > > >     [exec] 15:33:31,942 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Found ROOT at 172.16.1.96:60020
> > > > > > >     [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #2
> > > > > > >     [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #2
> > > > > > >     [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getClosestRowBefore 8
> > > > > > >     [exec] 15:33:32,004 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cached location address: 172.16.1.95:60020, regioninfo: REGION
> > =>
> > > > > {NAME
> > > > > > =>
> > > > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED =>
> 1028785192,
> > > > TABLE
> > > > > > =>
> > > > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE =>
> > > '16384',
> > > > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> > > > > COMPRESSION
> > > > > > =>
> > > > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY =>
> > 'false',
> > > > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
> > > > COMPRESSION
> > > > > =>
> > > > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY =>
> > > > 'false',
> > > > > > > BLOCKCACHE => 'false'}]}}
> > > > > > >     [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > > > Connecting to /172.16.1.95:60020
> > > > > > >     [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user:
> starting,
> > > > > having
> > > > > > > connections 2
> > > > > > >     [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #3
> > > > > > >     [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> value
> > #3
> > > > > > >     [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getProtocolVersion 14
> > > > > > >     [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #4
> > > > > > >     [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> value
> > #4
> > > > > > >     [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getClosestRowBefore 157
> > > > > > >     [exec] 15:33:32,179 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cached location address: 172.16.1.96:60020, regioninfo: REGION
> > =>
> > > > > {NAME
> > > > > > =>
> > > > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY =>
> '1262239352230',
> > > > > ENCODED
> > > > > > > =>
> > > > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME =>
> > > 'search',
> > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > BLOCKSIZE
> > > > > =>
> > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
> > > > 'user',
> > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > BLOCKSIZE
> > > > > =>
> > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > > > > >     [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > > > > > ,HTable$ClientScanner]
> > > > > > > Creating scanner over Guts starting at key ''
> > > > > > >     [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > > > > > ,HTable$ClientScanner]
> > > > > > > Advancing internal scanner to startKey at ''
> > > > > > >     [exec] 15:33:32,191 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cache hit for row <> in tableName Guts: location server
> > > > > > 172.16.1.96:60020,
> > > > > > > location region name Guts,,1262665364102
> > > > > > >     [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #5
> > > > > > >     [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #5
> > > > > > >     [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > openScanner 30
> > > > > > >     [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #6
> > > > > > >     [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #6
> > > > > > >     [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 30
> > > > > > >     [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #7
> > > > > > >     [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #7
> > > > > > >     [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 28
> > > > > > >     [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #8
> > > > > > >     [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #8
> > > > > > >     [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 27
> > > > > > >
> > > > > > > Then this scanner output seems to continue forever and it just
> > > hangs.
> > > > > >  I'm
> > > > > > > not really sure what the errors mean...
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <stack@duboce.net>
> wrote:
> > > > > > >
> > > > > > > > Is zookeeper jar on your CLASSPATH?
> > > > > > > >
> > > > > > > >  [exec] java.lang.NoClassDefFoundError:
> > > > org/apache/zookeeper/Watcher
> > > > > > > >
> > > > > > > > You code looks fine.
> > > > > > > >
> > > > > > > > St.Ack
> > > > > > > >
> > > > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > We're building an analytics server with HBase using Jetty.
>  I
> > > > have
> > > > > > > > > experimented with the Thrift API + PHP over the past few
> days
> > > and
> > > > > got
> > > > > > > it
> > > > > > > > > working, but needed the filter functionality which has not
> > been
> > > > > > > released
> > > > > > > > > yet.  So I decided to switch to the Java API and run it
> with
> > a
> > > > > Jetty
> > > > > > > > > server.
> > > > > > > > >
> > > > > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > > > > > > >
> > > > > > > > > Hbase is setup on the same machine, with all the
> > configuration
> > > > > > settings
> > > > > > > > > according to the "Getting Started" guide.  We are using
> Hbase
> > > > > version
> > > > > > > > > 0.20.1.
> > > > > > > > >
> > > > > > > > > Just doing a quick scanning test with this code:
> > > > > > > > >
> > > > > > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > > > > >        HTable table = new HTable(config, "Guts");
> > > > > > > > >        Scan s = new Scan();
> > > > > > > > >
> > > >  s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > > > > >        ResultScanner scanner = table.getScanner(s);
> > > > > > > > >        int count = 0;
> > > > > > > > >        int limit = 10;
> > > > > > > > >        try {
> > > > > > > > >                for (Result rr = scanner.next(); rr != null;
> > rr
> > > =
> > > > > > > > > scanner.next()) {
> > > > > > > > >                        if (count <= limit) {
> > > > > > > > >                        response.getOutputStream().write(
> > > > > rr.getRow()
> > > > > > );
> > > > > > > > >                        count++;
> > > > > > > > >                        }
> > > > > > > > >                }
> > > > > > > > >        } finally {
> > > > > > > > >                scanner.close();
> > > > > > > > >        }
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I get this error, which states (I think) that the HBase is
> > > > throwing
> > > > > a
> > > > > > > > > connection error:
> > > > > > > > >
> > > > > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
> > > > ,Configuration]
> > > > > > > > > java.io.IOException: config()
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > > >     [exec] at
> > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > >     [exec] at
> > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > >     [exec] at
> > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > >     [exec]
> > > > > > > > >     [exec] 2010-01-20 14:56:14.697::WARN:  /
> > > > > > > > >     [exec] java.lang.NoClassDefFoundError:
> > > > > > org/apache/zookeeper/Watcher
> > > > > > > > >     [exec] at java.lang.ClassLoader.defineClass1(Native
> > Method)
> > > > > > > > >     [exec] at
> > > > > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > >
> > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > > > > >     [exec] at
> > > > > > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > > > > >     [exec] at
> > > > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > > > > >     [exec] at
> > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > > > > >     [exec] at
> > > java.security.AccessController.doPrivileged(Native
> > > > > > > Method)
> > > > > > > > >     [exec] at
> > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > >     [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > >     [exec] at
> > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > >     [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > >     [exec] at
> > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > >     [exec] at
> > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > > > > >     [exec] at
> > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > > > > >     [exec] at
> > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > >     [exec] at
> > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > >     [exec] at
> > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > >     [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > >     [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > > > > > org.apache.zookeeper.Watcher
> > > > > > > > >     [exec] at
> > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > > > > >     [exec] at
> > > java.security.AccessController.doPrivileged(Native
> > > > > > > Method)
> > > > > > > > >     [exec] at
> > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > >     [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > >     [exec] at
> > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > >     [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > >     [exec] at
> > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > >     [exec] ... 35 more
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > After doing a mailing list search, it seemed that other
> > > > > configuration
> > > > > > > > > problems were fixed by upgrading to 0.20.2 which I have not
> > yet
> > > > > done.
> > > > > > >  Is
> > > > > > > > > this the problem or is there something simple I am
> > overlooking?
> > > >  I
> > > > > > have
> > > > > > > > > also
> > > > > > > > > added my hbase-site.xml and hbase-default.xml to my lib and
> > > conf
> > > > > > > > > directories
> > > > > > > > > to my working classpath.
> > > > > > > > >
> > > > > > > > > I am confused because I was able to connect via thrift, and
> I
> > > > also
> > > > > > have
> > > > > > > a
> > > > > > > > > BulkImporter MapReduce script to load the logging data into
> > > HBase
> > > > > > that
> > > > > > > > > works
> > > > > > > > > fine, but have been unable to locate my error in this case.
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message