hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From stack <st...@duboce.net>
Subject Re: org.apache.hadoop.hbase.UnknownScannerException
Date Thu, 06 Nov 2008 08:15:03 GMT
Looks like your map was fine but then it hung for three minutes: i.e. >
default scanner timout.

08/11/06 16:36:09 INFO mapred.JobClient:  map 50% reduce 16%
08/11/06 16:39:01 INFO mapred.JobClient: Task Id :
attempt_200811061631_0001_m_000001_0, Status : FAILED
org.apache.hadoop.hbase.UnknownScannerException:
org.apache.hadoop.hbase.UnknownScannerException: Name:


Anything in your Map that could hang that long?  Can you add logging?

After the 3 minute hang, if a Client goes back to the Server, it'll get the
USE.

St.Ack



On Wed, Nov 5, 2008 at 11:52 PM, Edward J. Yoon <edwardyoon@apache.org>wrote:

> After upgrade hadoop to 0.18.2 from 0.18.1, I received an
> UnknownScannerException. And, Map in/output bytes are only 288 bytes.
>
> Does anyone know about this?
>
> ----
> hadoop@vldb ~/hama-trunk $ bin/hama examples add 2 2
> 08/11/06 16:35:34 INFO hama.AbstractMatrix: Initializing the matrix
> storage.
> 08/11/06 16:35:39 INFO hama.AbstractMatrix: Create Matrix
> DenseMatrix_randsmsif
> 08/11/06 16:35:39 INFO hama.AbstractMatrix: Create the 2 * 2 random
> matrix : DenseMatrix_randsmsif
> 08/11/06 16:35:39 INFO hama.AbstractMatrix: Initializing the matrix
> storage.
> 08/11/06 16:35:45 INFO hama.AbstractMatrix: Create Matrix
> DenseMatrix_randcnzdg
> 08/11/06 16:35:45 INFO hama.AbstractMatrix: Create the 2 * 2 random
> matrix : DenseMatrix_randcnzdg
> 08/11/06 16:35:46 INFO hama.AbstractMatrix: Initializing the matrix
> storage.
> 08/11/06 16:35:52 INFO hama.AbstractMatrix: Create Matrix
> DenseMatrix_randvhcsa
> 08/11/06 16:35:52 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the
> same.
> 08/11/06 16:35:52 WARN mapred.JobClient: Use genericOptions for the
> option -libjars
> 08/11/06 16:35:54 WARN mapred.JobClient: No job jar file set.  User
> classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 08/11/06 16:35:54 INFO mapred.JobClient: Running job: job_200811061631_0001
> 08/11/06 16:35:55 INFO mapred.JobClient:  map 0% reduce 0%
> 08/11/06 16:35:59 INFO mapred.JobClient:  map 50% reduce 0%
> 08/11/06 16:36:09 INFO mapred.JobClient:  map 50% reduce 16%
> 08/11/06 16:39:01 INFO mapred.JobClient: Task Id :
> attempt_200811061631_0001_m_000001_0, Status : FAILED
> org.apache.hadoop.hbase.UnknownScannerException:
> org.apache.hadoop.hbase.UnknownScannerException: Name:
> -1687189961475873913
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077)
>        at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>
>        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>        at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>        at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>        at
> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155)
>        at
> org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:174)
>        at
> org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:56)
>        at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165)
>        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
>        at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
>
> 08/11/06 16:40:22 INFO mapred.JobClient: Task Id :
> attempt_200811061631_0001_m_000001_1, Status : FAILED
> org.apache.hadoop.hbase.UnknownScannerException:
> org.apache.hadoop.hbase.UnknownScannerException: Name:
> 745631933222911092
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077)
>        at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>
>        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>        at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>        at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>        at
> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155)
>        at
> org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:174)
>        at
> org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:56)
>        at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165)
>        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
>        at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
>
> 08/11/06 16:42:06 INFO mapred.JobClient: Task Id :
> attempt_200811061631_0001_m_000001_2, Status : FAILED
> org.apache.hadoop.hbase.UnknownScannerException:
> org.apache.hadoop.hbase.UnknownScannerException: Name:
> -8279337588883268282
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077)
>        at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>
>        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>        at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>        at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>        at
> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155)
>        at
> org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:174)
>        at
> org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:56)
>        at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165)
>        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
>        at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
>
> 08/11/06 16:42:08 INFO mapred.JobClient:  map 100% reduce 16%
> 08/11/06 16:42:17 INFO mapred.JobClient: Job complete:
> job_200811061631_0001
> 08/11/06 16:42:17 INFO mapred.JobClient: Counters: 13
> 08/11/06 16:42:17 INFO mapred.JobClient:   File Systems
> 08/11/06 16:42:17 INFO mapred.JobClient:     Local bytes read=310
> 08/11/06 16:42:17 INFO mapred.JobClient:     Local bytes written=706
> 08/11/06 16:42:17 INFO mapred.JobClient:   Job Counters
> 08/11/06 16:42:17 INFO mapred.JobClient:     Launched reduce tasks=1
> 08/11/06 16:42:17 INFO mapred.JobClient:     Launched map tasks=6
> 08/11/06 16:42:17 INFO mapred.JobClient:   Map-Reduce Framework
> 08/11/06 16:42:17 INFO mapred.JobClient:     Reduce input groups=2
> 08/11/06 16:42:17 INFO mapred.JobClient:     Combine output records=0
> 08/11/06 16:42:17 INFO mapred.JobClient:     Map input records=2
> 08/11/06 16:42:17 INFO mapred.JobClient:     Reduce output records=2
> 08/11/06 16:42:17 INFO mapred.JobClient:     Map output bytes=288
> 08/11/06 16:42:17 INFO mapred.JobClient:     Map input bytes=0
> 08/11/06 16:42:17 INFO mapred.JobClient:     Combine input records=0
> 08/11/06 16:42:17 INFO mapred.JobClient:     Map output records=4
> 08/11/06 16:42:17 INFO mapred.JobClient:     Reduce input records=4
> 08/11/06 16:42:21 INFO client.HBaseAdmin: Disabled DenseMatrix_randsmsif
> 08/11/06 16:42:21 INFO client.HBaseAdmin: Deleted DenseMatrix_randsmsif
> 08/11/06 16:42:28 INFO client.HBaseAdmin: Disabled DenseMatrix_randcnzdg
> 08/11/06 16:42:28 INFO client.HBaseAdmin: Deleted DenseMatrix_randcnzdg
> 08/11/06 16:42:34 INFO client.HBaseAdmin: Disabled DenseMatrix_randvhcsa
> 08/11/06 16:42:35 INFO client.HBaseAdmin: Deleted DenseMatrix_randvhcsa
>
>
> --
> Best Regards, Edward J. Yoon @ NHN, corp.
> edwardyoon@apache.org
> http://blog.udanax.org
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message