Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Too many "Compaction Complete" messages


+
Tom Brown 2013-09-04, 02:13
+
Frank Chow 2013-09-04, 12:21
+
Tom Brown 2013-09-04, 15:36
Copy link to this message
-
Re: Too many "Compaction Complete" messages
Here "d" should be the column family being compacted.
Do you have 3-5 column families of the same region being compacted?
On Wed, Sep 4, 2013 at 8:36 AM, Tom Brown <[EMAIL PROTECTED]> wrote:

> Is it normal to receive 3-5 distinct "Compaction Complete" statuses for the
> same region each second? For any individual region, it continuously
> generates "Compacting d in {theregion}... Compaction Complete" statuses for
> minutes or hours.
>
> In that status message, what is "d"?
>
> --Tom
>
>
> On Wed, Sep 4, 2013 at 6:21 AM, Frank Chow <[EMAIL PROTECTED]>
> wrote:
>
> > Hi Tom,
> > Below parameters may help to reduce the compaction number:
> >
> >   <property>
> >     <name>hbase.hstore.compactionThreshold</name>
> >     <value>3</value>
> >     <description>
> >     If more than this number of HStoreFiles in any one HStore
> >     (one HStoreFile is written per flush of memstore) then a compaction
> >     is run to rewrite all HStoreFiles files as one.  Larger numbers
> >     put off compaction but when it runs, it takes longer to complete.
> >     </description>
> >   </property>
> >
> > Make the value larger, if there are too many small files in the region
> > dir, this may help a lot.
> >
> >
> >
> >
> >
> >
> >
> >
> > Frank Chow
>
+
Tom Brown 2013-09-04, 17:27
+
Tom Brown 2013-09-21, 15:49
+
Tom Brown 2013-09-25, 15:08