Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Compaction time

samar.opensource 2013-03-04, 06:44
Copy link to this message
Re: Compaction time
Viral Bajaria 2013-03-04, 06:56
How often do you run those jobs ? Do they run periodically or are they
running all the time ?

If you have a predictable periodic behavior, you could disable automatic
compaction and trigger it manually using a cron job (not the recommended
approach, AFAIK). Or you could set the compaction to trigger at a set time
of the day when you know your jobs are not running.


On Sun, Mar 3, 2013 at 10:44 PM, samar.opensource <

> Hi,
>    We are running some high load jobs which are mostly writes. During
> these jobs, compaction is triggered which takes sometime as longs as 40mins
> to complete. This causes blocking (as others wait for compaction in the
> queue). Please suggest how much compaction time is reasonable for
> compacting 2Gb store files . And best way to avoid long blocking
> compactions.
> Using Cloudera hbase vesion 3u3.
> Regards,
> Samar
samar.opensource 2013-03-04, 07:57
Jean-Marc Spaggiari 2013-03-04, 12:50
samar.opensource 2013-03-04, 13:40