Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Error about rs block seek


Copy link to this message
-
Re: Error about rs block seek
Bing Jiang 2013-05-13, 01:50
hi, Ted.

No data block encoding, our table config below:

User Table Description
CrawlInfo<http://10.100.12.33:8003/table.jsp?name=CrawlInfo> {NAME
=> 'CrawlInfo', DEFERRED_LOG_FLUSH => 'true', MAX_FILESIZE =>
'34359738368', FAMILIES => [{NAME => 'CrawlStats', BLOOMFILTER => 'ROWCOL',
CACHE_INDEX_ON_WRITE => 'true', TTL => '-1', CACHE_DATA_ON_WRITE => 'true',
CACHE_BLOOMS_ON_WRITE => 'true', VERSIONS => '1', BLOCKSIZE => '32768'}]}

2013/5/13 Bing Jiang <[EMAIL PROTECTED]>

> Hi, JM.
> Our jdk version is 1.6.0_38
>
>
> 2013/5/13 Jean-Marc Spaggiari <[EMAIL PROTECTED]>
>
>> Hi Bing,
>>
>> Which JDK are you using?
>>
>> Thanks,
>>
>> JM
>>
>> 2013/5/12 Bing Jiang <[EMAIL PROTECTED]>
>>
>> > Yes, we use hbase-0.94.3 , and  we change block.size from 64k to 32k.
>> >
>> >
>> > 2013/5/13 Ted Yu <[EMAIL PROTECTED]>
>> >
>> > > Can you tell us the version of hbase you are using ?
>> > > Did this problem happen recently ?
>> > >
>> > > Thanks
>> > >
>> > > On May 12, 2013, at 6:25 PM, Bing Jiang <[EMAIL PROTECTED]>
>> > wrote:
>> > >
>> > > > Hi, all.
>> > > > In our hbase cluster, there are many logs like below:
>> > > >
>> > > > 2013-05-13 00:00:04,161 ERROR
>> > > org.apache.hadoop.hbase.regionserver.HRegionServer:
>> > > > java.lang.IllegalArgumentException
>> > > >         at java.nio.Buffer.position(Buffer.java:216)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.blockSeek(HFileReaderV2.java:882)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.loadBlockAndSeekToKey(HFileReaderV2.java:753)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:487)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:501)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:226)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:145)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:131)
>> > > >         at
>> > > org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:2073)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.<init>(HRegion.java:3412)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.HRegion.instantiateRegionScanner(HRegion.java:1642)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1634)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1610)
>> > > >         at
>> > > org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:4230)
>> > > >         at
>> > > org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:4204)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.HRegionServer.get(HRegionServer.java:2025)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3461)
>> > > >         at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown
>> Source)
>> > > >         at
>> > >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> > > >         at java.lang.reflect.Method.invoke(Method.java:597)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>> > > >         at
>> > >
>> >
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
>> > > >
>> > > >
>> > > >
>> > > > and Table config:
>> > > >
>> > > >
>> > > > Can anyone tell me how I can find the reason about this?
>> > > >
>> > > > --
>> > > > Bing Jiang
>> > > > weibo: http://weibo.com/jiangbinglover
>> > > > BLOG: http://blog.sina.com.cn/jiangbinglover

Bing Jiang
Tel:(86)134-2619-1361
weibo: http://weibo.com/jiangbinglover
BLOG: http://blog.sina.com.cn/jiangbinglover
National Research Center for Intelligent Computing Systems
Institute of Computing technology
Graduate University of Chinese Academy of Science