Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - Major compaction issues in hbase


+
yanivG 2014-02-02, 21:26
+
Ted Yu 2014-02-02, 21:43
+
Jean-Marc Spaggiari 2014-02-02, 21:46
+
yanivG 2014-02-03, 17:31
Copy link to this message
-
Re: Major compaction issues in hbase
Kevin O'dell 2014-02-02, 21:50
Hi Y,

  That may help, but a coulple quick questions:

Are you doing any bulk loads?

What is your avg flush size through out the day?

After a day before how many storefiles have you built up?

I would look at your memory sizing along with scheduling daily compactions.
On Sun, Feb 2, 2014 at 4:14 PM, yanivG <[EMAIL PROTECTED]> wrote:

> Hi,
> I am using hbase 0.94.6 version. We are developing a java application and
> using it as our storage for a high load web application.
> The average ration is about 500 requests per second.
> From time to time I see high latency (more then 300 ms!!!) when trying to
> store data object within hbase (using Put).
>
> We disabled major compaction and set it to run manually once a week.
> By examining the logs during those high latency , I see that major
> compaction was executed.
> I saw a post
> (https://groups.google.com/forum/#!topic/nosql-databases/YwE894gq1qM)
> which
> explains it.
> The question is how can I avoid this? Should I ran the major compaction
> once
> a day in low load hours? will it eliminate the sporadic major compaction?
> Thanks,
> Y
>
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Major-compaction-issues-in-hbase-tp4055592.html
> Sent from the HBase Developer mailing list archive at Nabble.com.
>

--
Kevin O'Dell
Systems Engineer, Cloudera

 
+
Vladimir Rodionov 2014-02-02, 21:56
+
yanivG 2014-02-03, 17:32
+
Nick Dimiduk 2014-02-03, 19:41