hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billy Pearson" <billy_pear...@sbcglobal.net>
Subject Re: java.io.IOException: java.util.NoSuchElementException
Date Tue, 11 Nov 2008 15:04:19 GMT


could it be from the global memcache limit
I set my hbase.hregion.memcache.flush.size = 
hbase.regionserver.globalMemcacheLimit
So that memcache flushes are only as needed.
But now with the client cache it could it be exceeding that limit to fast 
and causing this error?

My version is current trunk and I am writing 8 threads to one region server 
with 8 regions.

Billy


----- Original Message ----- 
From: "Michael Stack" <stack-+c050i++PmesTnJN9+BGXg@public.gmane.org>
Newsgroups: gmane.comp.java.hadoop.hbase.user
To: <hbase-user-7ArZoLwFLBtd/SJB6HiN2Ni2O/JbrIOy@public.gmane.org>
Sent: Monday, November 10, 2008 11:33 PM
Subject: Re: java.io.IOException: java.util.NoSuchElementException


> Thats an odd one Billy.  We're in that bit of code because we need to 
> flush some regions fast because we're up at memory thresholds -- but we're 
> getting java.util.NoSuchElementException because there are no regions to 
> flush.  HBASE-990 in trunk addresses the immediate silly error of trying 
> to get a first element from a Set that has none, but do you have an idea 
> why there'd be memory pressure in the hbase heap though no seemingly no 
> regions online?
>
> Thanks,
> St.Ack
>
> Billy Pearson wrote:
>> The first post was from the reducer
>> This is from the region server
>>
>> 2008-11-10 18:14:53,157 INFO org.apache.hadoop.ipc.Server: IPC Server 
>> handler 69 on 60020, call batchUpdates([B@68e97c, 
>> [Lorg.apache.hadoop.hbase.io.BatchUpdate;@1b8e8d2) from 
>> 192.168.1.201:37077: error: java.io.IOException: 
>> java.util.NoSuchElementException
>> java.io.IOException: java.util.NoSuchElementException
>>        at java.util.TreeMap.key(TreeMap.java:1206)
>>        at java.util.TreeMap.firstKey(TreeMap.java:267)
>>        at 
>> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushSomeRegions(MemcacheFlusher.java:227)
>>        at 
>> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.reclaimMemcacheMemory(MemcacheFlusher.java:213)
>>        at 
>> org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdates(HRegionServer.java:1227)
>>        at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
>>        at 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>        at java.lang.reflect.Method.invoke(Method.java:597)
>>        at 
>> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:634)
>>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>>
>> "Billy Pearson" <sales-bilS+b3c8gufP+p43NWRKVaTQe2KTcn/@public.gmane.org> 
>> wrote in message news:gfaitc$1ms$1@ger.gmane.org...
>>> I started getting these when the server are under heavy load
>>>
>>> java.io.IOException: java.io.IOException: 
>>> java.util.NoSuchElementException
>>> at java.util.TreeMap.key(TreeMap.java:1206)
>>> at java.util.TreeMap.firstKey(TreeMap.java:267)
>>> at 
>>> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushSomeRegions(MemcacheFlusher.java:227)
>>> at 
>>> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.reclaimMemcacheMemory(MemcacheFlusher.java:213)
>>> at 
>>> org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdates(HRegionServer.java:1227)
>>> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
>>> at 
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:634)
>>> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>>>
>>>
>>>
>>>
>>
>>
>
> 



Mime
View raw message