Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> flushing + compactions after config change


+
Viral Bajaria 2013-06-27, 07:40
+
Anoop John 2013-06-27, 07:51
+
Viral Bajaria 2013-06-27, 08:18
Copy link to this message
-
答复: flushing + compactions after config change
If  reached memstore global up-limit,  you'll find "Blocking updates on" in your files(see MemStoreFlusher.reclaimMemStoreMemory);
If  it's caused by too many log files, you'll find "Too many hlogs: logs="(see HLog.cleanOldLogs)
Hope it's helpful for you:)

Best,
Liang
________________________________________
发件人: Viral Bajaria [[EMAIL PROTECTED]]
发送时间: 2013年6月27日 16:18
收件人: [EMAIL PROTECTED]
主题: Re: flushing + compactions after config change

Thanks for the quick response Anoop.

The current memstore reserved (IIRC) would be 0.35 of total heap right ?

The RS total heap is 10231MB, used is at 5000MB. Total number of regions is
217 and there are approx 150 regions with 2 families, ~60 with 1 family and
remaining with 3 families.

How to check if the flushes are due to too many WAL files ? Does it get
logged ?

Thanks,
Viral

On Thu, Jun 27, 2013 at 12:51 AM, Anoop John <[EMAIL PROTECTED]> wrote:

> You mean there is enough memstore reserved heap in the RS, so that there
> wont be premature flushes because of global heap pressure?  What is the RS
> max mem and how many regions and CFs in each?  Can you check whether the
> flushes happening because of too many WAL files?
>
> -Anoop-
>
+
Viral Bajaria 2013-06-27, 08:29
+
Anoop John 2013-06-27, 09:03
+
Azuryy Yu 2013-06-27, 09:22
+
Viral Bajaria 2013-06-27, 09:47
+
Azuryy Yu 2013-06-27, 09:48
+
Viral Bajaria 2013-06-27, 10:08
+
谢良 2013-06-27, 10:36
+
Azuryy Yu 2013-06-27, 14:53
+
Viral Bajaria 2013-06-27, 21:06
+
Jean-Daniel Cryans 2013-06-27, 21:40
+
Viral Bajaria 2013-06-27, 23:27
+
Jean-Daniel Cryans 2013-06-28, 16:31
+
Viral Bajaria 2013-06-28, 21:39
+
Jean-Daniel Cryans 2013-06-28, 23:53
+
Himanshu Vashishtha 2013-07-01, 06:08
+
Azuryy Yu 2013-06-28, 01:09
+
Viral Bajaria 2013-06-28, 01:22
+
Anoop John 2013-06-28, 12:08
+
谢良 2013-06-27, 08:53