Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Region autoSplit when not reach 'hbase.hregion.max.filesize' ?


Copy link to this message
-
Re: Region autoSplit when not reach 'hbase.hregion.max.filesize' ?
Just out of curiosity, describe the data?
Sorted?
The more we know, the easier it is to help... Also, can you recheck your math ?
Sent from my iPhone

On Jun 6, 2012, at 6:17 PM, "NNever" <[EMAIL PROTECTED]> wrote:

> It comes again. I truncate the table, and put about 10million datas into it
> last night.
> The table auto-split to 4, each has about 3Gb storefileUncompressedSize.
>
> I grep the log and out but nothing about the split.
>
> the logs are as below:
> 2012-06-06 19:31:15,402 WARN org.apache.hadoop.ipc.HBaseServer:
> (responseTooSlow):
> {"processingtimems":10296,"call":"next(1511657428305700194, 1), rpc
> version=1, client version=29, methodsFingerPrint=-1508511443","client":"
> 192.168.1.145:46456
> ","starttimems":1338982265104,"queuetimems":0,"class":"HRegionServer","responsesize":6,"method":"next"}
> 2012-06-06 19:31:15,606 WARN org.apache.hadoop.ipc.HBaseServer:
> (responseTooSlow):
> {"processingtimems":10842,"call":"next(-2954106234340837837, 1), rpc
> version=1, client version=29, methodsFingerPrint=-1508511443","client":"
> 192.168.1.145:46456
> ","starttimems":1338982264763,"queuetimems":1,"class":"HRegionServer","responsesize":6,"method":"next"}
> 2012-06-06 19:31:29,795 WARN org.apache.hadoop.ipc.HBaseServer:
> (responseTooSlow):
> {"processingtimems":10668,"call":"next(2455689470981850756, 1), rpc
> version=1, client version=29, methodsFingerPrint=-1508511443","client":"
> 192.168.1.145:46456
> ","starttimems":1338982279126,"queuetimems":0,"class":"HRegionServer","responsesize":6,"method":"next"}
> 2012-06-06 20:24:54,157 WARN org.apache.hadoop.ipc.HBaseServer:
> (responseTooSlow):
> {"processingtimems":2920400,"call":"multi(org.apache.hadoop.hbase.client.MultiAction@6b39de40),
> rpc version=1, client version=29, methodsFingerPrint=-1508511443","client":"
> 192.168.1.145:46456
> ","starttimems":1338982573756,"queuetimems":0,"class":"HRegionServer","responsesize":0,"method":"multi"}
> 2012-06-06 20:24:54,251 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server
> Responder, call multi(org.apache.hadoop.hbase.client.MultiAction@6b39de40),
> rpc version=1, client version=29, methodsFingerPrint=-1508511443 from
> 192.168.1.145:46456: output error
> 2012-06-06 20:24:54,294 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server
> handler 2159 on 60020 caught a ClosedChannelException, this means that the
> server was processing a request but the client went away. The error message
> was: null
> 2012-06-06 20:25:00,868 WARN org.apache.hadoop.ipc.HBaseServer:
> (responseTooSlow): {"processingtimems":2927114,"call":"multi(org.apache.hado
>
> You can see on 19:31:29 the log stop for about 1 hour, It may doing split
> there.(this is the regionserver.log)
> And in the regionServer.out I cannot find any information about split, Only
> lots of 'org.apache.hadoop.hbase.NotServingRegionException' when split. No
> log about start doing split and why do split.
>
> logs are too large to upload somewhere.
>
> I'll dig into it....It really confuse me...
>
> Thanks, yours
> NN
>
>
> 2012/6/6 NNever <[EMAIL PROTECTED]>
>
>> I'll. I changed the log level.
>> Putting datas and waiting for the strange split now   :).....
>>
>> Yours,
>> NN
>>
>> 2012/6/6 dong.yajun <[EMAIL PROTECTED]>
>>
>> Hi NNever
>>>
>>> If you find any issues, please let us known, thanks.
>>>
>>>
>>> On Wed, Jun 6, 2012 at 5:09 PM, NNever <[EMAIL PROTECTED]> wrote:
>>>
>>>> I'm sorry, the log4j now is WARN, not INFO
>>>>
>>>> 2012/6/6 NNever <[EMAIL PROTECTED]>
>>>>
>>>>> We currently run in INFO mode.
>>>>> It actully did the split, but I cannot find any logs about this split.
>>>>> I will change the log4j to DEBUG, if got any log valuable, I will
>>> paste
>>>>> here...
>>>>>
>>>>> Thanks Ram,
>>>>> NN
>>>>>
>>>>> 2012/6/6 Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
>>>>>
>>>>> You have any logs corresponding to this?
>>>>>>
>>>>>> Regards
>>>>>> Ram
>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: NNever [mailto:[EMAIL PROTECTED]]
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB