Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Regarding ScannerTimeout Exception


Copy link to this message
-
Re: Regarding ScannerTimeout Exception
Stack 2013-02-16, 19:45
What Marcos says.

Also read this:
http://hbase.apache.org/book.html#hbase.client.scanner.caching and what is
happening on your server when you get a timeout?  Is it working hard?
 Swapping?  Processing other stuff?  Is there a process running beside it
contending for resources (e.g. mapreduce?).

St.Ack

On Fri, Feb 15, 2013 at 10:03 PM, Vidosh Sahu <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I am using HBase 0.92.1-cdh4.1.1. There is mapper job which do a lot of
> operation. This job is getting failed with the below operation. It looks
> like the scanner operation is timed out. How to increase it using Cloudera
> Manager Web Console. Can anyone  please help me out.
>
> 2013-02-16 05:30:45,978 [Thread-158] WARN
>  org.apache.hadoop.mapred.LocalJobRunner - job_local_0005
> org.apache.hadoop.hbase.client.ScannerTimeoutException: 614527ms passed
> since the last invocation, timeout is currently set to 60000
>         at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1302)
>         at
>
> org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:133)
>         at
>
> org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:142)
>         at
>
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:423)
>         at
> org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
>         at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: org.apache.hadoop.hbase.UnknownScannerException:
> org.apache.hadoop.hbase.UnknownScannerException: Name: -5689607602334883791
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2110)
>         at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
>         at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at
>
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>         at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1345)
>
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at
>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>         at
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>         at
>
> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
>         at
>
> org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:84)
>         at
>
> org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:39)
>         at
>
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionServerWithRetries(HConnectionManager.java:1325)
>         at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1293)
>         ... 8 more
> 2013-02-16 05:30:46,016 [communication thread] INFO
>  org.apache.hadoop.mapred.LocalJobRunner -
> 2013-02-16 05:30:46,424 [pool-1-thread-1] INFO
>  org.apache.hadoop.mapred.JobClient - Job complete: job_local_0005
> 2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
>  org.apache.hadoop.mapred.JobClient - Counters: 5
> 2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
>  org.apache.hadoop.mapred.JobClient -   FileSystemCounters
> 2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
>  org.apache.hadoop.mapred.JobClient -     FILE_BYTES_READ=3827305
> 2013-02-16 05:30:46,431 [pool-1-thread-1] INFO
>  org.apache.hadoop.mapred.JobClient -     FILE_BYTES_WRITTEN=3967770