Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> reginoserver's log analysis?


Copy link to this message
-
Re: reginoserver's log analysis?
HI,
    what is the block size? how to set it ?  and shoud i increate it for
the memstore ?

    Thanks!
     beatls

On Thu, Jan 3, 2013 at 6:23 PM, Anoop Sam John <[EMAIL PROTECTED]> wrote:

> The writes to your table will be written 1st to in memory data structure
> (memstore). When this memstore reaches some defined size it will be flushed
> into the file system and the memory can be cleared.
>
> The flush operation may take some time as IO write is involved, During
> this time also the client may be writing data to the table. Well HBase
> allows to do so and the data there in memory for a region can be becoming
> more and more. So there will be a max amount of total data which can be
> there in memory. If that is crossed HBase will stop taking any writes from
> the client until the flush is over and the memory got cleared.  As per the
> log in your cluster the blocking memstore size is 256m.
>
> Hope you got the idea.
>
> -Anoop-
> ________________________________________
> From: hua beatls [[EMAIL PROTECTED]]
> Sent: Thursday, January 03, 2013 3:15 PM
> To: [EMAIL PROTECTED]
> Subject: reginoserver's log analysis?
>
> Hi,
>    below is the regionserver's log, what does  the red marked "blocking
> updates" mean ?
>     any indication from " memstore size 256.8m is >= than blocking 256.0m
> size"
>
>
>
> 42,651 INFO org.apache.hadoop.hbase.regionserver.HRegion: Blocking
> updatesfor 'IPC Server handler 1 on 60020' on region
>
> BT_NET_LOG_999,0000189020000000000000000000000000000000,1357201912899.efd6fd4581483aded26175300c48b7b7.:
> memstore size 256.8m is >= than blocking 256.0m size
>
> 2013-01-03 17:00:42,717 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: Blocking
> updates for 'IPC Server handler 27 on 60020' on region
>
> BT_NET_LOG_999,0000189020000000000000000000000000000000,1357201912899.efd6fd4581483aded26175300c48b7b7.:
> memstore size 256.8m is >= than blocking 256.0m size
>
> 2013-01-03 17:00:42,761 INFO org.apache.hadoop.hbase.regionserver.HRegion:
> Blocking updates for 'IPC Server handler 50 on 60020' on region
>
> BT_NET_LOG_999,0000189020000000000000000000000000000000,1357201912899.efd6fd4581483aded26175300c48b7b7.:
> memstore size 256.8m is >= than blocking 256.0m size
>
> 2013-01-03 17:00:42,875 INFO org.apache.hadoop.hbase.regionserver.HRegion:
> Blocking updates for 'IPC Server handler 55 on 60020' on region
>
> BT_NET_LOG_999,0000189020000000000000000000000000000000,1357201912899.efd6fd4581483aded26175300c48b7b7.:
> memstore size 256.8m is >= than blocking 256.0m size
>
>
> Thanks!
>
> beatls
>