Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Too many "Compaction Complete" messages


+
Tom Brown 2013-09-04, 02:13
+
Frank Chow 2013-09-04, 12:21
+
Tom Brown 2013-09-04, 15:36
Copy link to this message
-
Re: Too many "Compaction Complete" messages
Here "d" should be the column family being compacted.
Do you have 3-5 column families of the same region being compacted?
On Wed, Sep 4, 2013 at 8:36 AM, Tom Brown <[EMAIL PROTECTED]> wrote:

> Is it normal to receive 3-5 distinct "Compaction Complete" statuses for the
> same region each second? For any individual region, it continuously
> generates "Compacting d in {theregion}... Compaction Complete" statuses for
> minutes or hours.
>
> In that status message, what is "d"?
>
> --Tom
>
>
> On Wed, Sep 4, 2013 at 6:21 AM, Frank Chow <[EMAIL PROTECTED]>
> wrote:
>
> > Hi Tom,
> > Below parameters may help to reduce the compaction number:
> >
> >   <property>
> >     <name>hbase.hstore.compactionThreshold</name>
> >     <value>3</value>
> >     <description>
> >     If more than this number of HStoreFiles in any one HStore
> >     (one HStoreFile is written per flush of memstore) then a compaction
> >     is run to rewrite all HStoreFiles files as one.  Larger numbers
> >     put off compaction but when it runs, it takes longer to complete.
> >     </description>
> >   </property>
> >
> > Make the value larger, if there are too many small files in the region
> > dir, this may help a lot.
> >
> >
> >
> >
> >
> >
> >
> >
> > Frank Chow
>
+
Tom Brown 2013-09-04, 17:27
+
Tom Brown 2013-09-21, 15:49
+
Tom Brown 2013-09-25, 15:08
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB