hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vidosh Sahu <vid...@girnarsoft.com>
Subject Regarding ScannerTimeout Exception
Date Sat, 16 Feb 2013 06:03:47 GMT
Hi,

I am using HBase 0.92.1-cdh4.1.1. There is mapper job which do a lot of
operation. This job is getting failed with the below operation. It looks
like the scanner operation is timed out. How to increase it using Cloudera
Manager Web Console. Can anyone  please help me out.

2013-02-16 05:30:45,978 [Thread-158] WARN
 org.apache.hadoop.mapred.LocalJobRunner - job_local_0005
org.apache.hadoop.hbase.client.ScannerTimeoutException: 614527ms passed
since the last invocation, timeout is currently set to 60000
        at
org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1302)
        at
org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:133)
        at
org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:142)
        at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:423)
        at
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
        at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: org.apache.hadoop.hbase.UnknownScannerException:
org.apache.hadoop.hbase.UnknownScannerException: Name: -5689607602334883791
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2110)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1345)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at
org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
        at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:84)
        at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:39)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionServerWithRetries(HConnectionManager.java:1325)
        at
org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1293)
        ... 8 more
2013-02-16 05:30:46,016 [communication thread] INFO
 org.apache.hadoop.mapred.LocalJobRunner -
2013-02-16 05:30:46,424 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient - Job complete: job_local_0005
2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient - Counters: 5
2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient -   FileSystemCounters
2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient -     FILE_BYTES_READ=3827305
2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient -     FILE_BYTES_WRITTEN=3967770
2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient -   Map-Reduce Framework
2013-02-16 05:30:46,432 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient -     Map input records=2000
2013-02-16 05:30:46,432 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient -     Spilled Records=0
2013-02-16 05:30:46,433 [pool-1-thread-1] INFO
 org.apache.hadoop.mapred.JobClient -     Map output records=1040


Thanks,
Vidosh

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message