Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Slow log splitting (Hbase 0.94.6)


+
Eran Kutner 2013-06-18, 12:11
Copy link to this message
-
Re: Slow log splitting (Hbase 0.94.6)
What Hadoop version are you using ?

Can you check NameNode log to see if lease recovery took long time ?

Cheers

On Jun 18, 2013, at 5:11 AM, Eran Kutner <[EMAIL PROTECTED]> wrote:

> Hi,
> We had a brute force cluster shutdown event that was followed by log
> recovery when the cluster went back online.
> The cluster took hours to split the logs and recover the regions, all of
> which might have made sense since we have quite a lot of regions (around
> 13K) but the weird thing is that there was no obvious bottleneck during the
> recovery process. CPU was almost idle on all the nodes, IO was on 5-20%
> utilization, memory was OK, network wasn't overloaded, but still it was
> slow.
> Any idea what can be slowing it down?
>
> Thanks.
>
> -eran
+
Eran Kutner 2013-06-18, 16:43
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB