Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> How to check if a major_compact is done?


+
yun peng 2012-11-08, 06:08
+
ramkrishna vasudevan 2012-11-08, 06:33
+
PG 2012-11-08, 08:08
+
Jean-Marc Spaggiari 2012-11-08, 11:43
+
Jerry Lam 2012-11-08, 15:43
+
yun peng 2012-11-08, 18:31
Copy link to this message
-
Re: How to check if a major_compact is done?
Hi,

https://github.com/aravind/hbase_compact may have what you need (thanks
Jeremy)

Otis
--
Search Analytics - http://sematext.com/search-analytics/index.html
Performance Monitoring - http://sematext.com/spm/index.html
On Thu, Nov 8, 2012 at 1:31 PM, yun peng <[EMAIL PROTECTED]> wrote:

> Yes, JMX exposes compaction time. My cluster has JMX enabled, and I can
> view certain statistics from remote jconsole.
>
> However, I dont find any reference talking about how to write a Java
> program to collect a specific statistics, like compaction time available in
> region server status. Does anyone here have experience in writing low-level
> code to collect JMX data, instead of using jconsole or other high-level
> tools...
>
> PS: I have found some sample code
> here<
> http://hadoop.apache.org/docs/current/api/org/apache/hadoop/metrics/package-summary.html
> >,
> yet the API is deprecated.
> Regards,
> Yun
> On Thu, Nov 8, 2012 at 6:43 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]
> > wrote:
>
> > Please someone correct me if I'm wrong, but I think there is some
> > information exposed to JMX which give you the duration (and size) of
> > the last compaction.
> >
> > JM
> >
> > 2012/11/8, PG <[EMAIL PROTECTED]>:
> > > Hi, thanks for the comments. One thing is,,,, shouldn't web UI comes
> from
> > > the hbase API, or can I issue function call to get the progress of
> > > compaction?.
> > > Hun
> > >
> > > On Nov 8, 2012, at 1:33 AM, ramkrishna vasudevan
> > > <[EMAIL PROTECTED]> wrote:
> > >
> > >> There is no interface which says that the major compaction is
> completed.
> > >> But you can see that major compaction is in progress from the web UI.
> > >> Sorry if am wrong here.
> > >>
> > >> Regards
> > >> Ram
> > >>
> > >> On Thu, Nov 8, 2012 at 11:38 AM, yun peng <[EMAIL PROTECTED]>
> > wrote:
> > >>
> > >>> Hi, All,
> > >>> I want to measure the duration of a major compaction in HBase. Since
> > the
> > >>> function call majorCompact is asynchronous, I may need to manually
> > check
> > >>> when the major compaction is done. Does Hbase (as of version 0.92.4)
> > >>> provide an interface to determine completion of major compaction?
> > >>> Thanks.
> > >>> Yun
> > >>>
> > >
> >
>
+
Jeremy Carroll 2012-11-08, 19:22
+
Jeremy Carroll 2012-11-08, 19:19
+
Jeremy Carroll 2012-11-08, 19:21
+
Mikael Sitruk 2012-11-08, 19:36
+
yun peng 2012-11-08, 20:58
+
yun peng 2012-11-08, 21:08
+
yun peng 2012-11-17, 01:03
+
Otis Gospodnetic 2012-11-08, 16:27