Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: compactions.   Results from 41 to 50 from 920 (0.454s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
[expand - 8 more] - Did major compaction really happen? - HBase - [mail # user]
...In order to turn off major compaction, I set MAJOR_COMPACTION_PERIOD to 0. However, I checked region server log, saw major compaction “happened"  quite often:   2013-12-17 01:44:45,085 INFO...
... org.apache.hadoop.hbase.regionserver.Store: Completed major compaction of 4 file(s) in cf1 of my_table,75,1387269666255.a6b0df058bf97f2f0efe1ed75f445a2c. into b23af74c66d8477b963750feed19ef23...
[+ show more]
   Author: branky, 2013-12-20, 04:49
[expand - 21 more] - Errors after major compaction - HBase - [mail # user]
... reduced the TTL on the table and initiated major compaction. This should have reduced the table size to about 20% of its original size. Today, I'm getting errors of inaccessible files on HDFS...
..._674664  I assume the file loss is somehow related to this change and the major compaction that followed because the same scan that is failing now was working fine yesterday and that is the only...
   Author: Eran Kutner, 2011-06-30, 10:58
[expand - 1 more] - HBase major_,compaction - HBase - [mail # user]
...  of regions even after I major_compact all tables. I t seems that major_com pact didn'tcompact any region.    What can I do to compact the regions and have fewer regions, and how can I  check...
... if the table is already compacted?    I'm using Hbase 0.90.2.    Thanks,    Miguel    ...
   Author: Miguel Costa, 2011-05-25, 20:13
[expand - 5 more] - major compaction best practice - HBase - [mail # user]
... compaction best practices:  1) Have we to run it automatically or manually 2) How ofter it should run 3) Where can I read about compaction process and does it have potential problem that I should...
   Author: Oleg Ruchovets, 2011-05-16, 10:42
[expand - 6 more] - Re: Major compaction time - HBase - [mail # user]
...You are running w/ the defaults where major compaction runs every day?  It depends on how your data is changing but at the extreme, a major compaction is a rewrite of the total data set...
....  We'll usually suggest that folks turn off the auto-major compaction and instead run it manually at time of low loading -- evening or w/e dependent on traffic -- or that they manage it in some...
[+ show more]
   Author: Stack, 2011-03-09, 18:25
[expand - 13 more] - Major compactions and OS cache - HBase - [mail # user]
... house keeping on a regular basis. These so called compactions rewrite  files as new data is added over time. All files in HDFS once written are  immutable (for all sorts of reasons). Because...
... of  that, data is written into  new files and as their number grows HBase compacts them into another set of  new, consolidated files. And here is  the kicker: HDFS is smart enough to put  the data...
[+ show more]
   Author: Otis Gospodnetic, 2011-02-16, 12:30
[expand - 6 more] - Re: Non-sensical? Compaction Metrics Hbase UI - HBase - [mail # user]
...nice, just took a look at this path in my system. I see the growth but that would only apply to major_compactions where all files are picked up and compacted because minor compactions won...
...'t be trackable this way without knowing which files were selected by the compaction algorithm. is there a method for getting progress on these? On Mon, Aug 11, 2014 at 3:14 PM, Bryan Beaudreault...
   Author: Geovanie Marquez, 2014-08-11, 20:32
[expand - 1 more] - Configs for Hbase compaction switch... - HBase - [mail # user]
...I want to run some experiments with the major compactions turned off..  There are two parameters that I can see both of which have to be modified t o turn major compactions off (am I right...
... here?). hbase.hstore.compactionThreshold and hbase.hregion.majorcompaction...  But the config file's comments say that setting compactionThreshold to a hi gh value may lead to memory issues...
[+ show more]
   Author: Vidhyashankar Venkatarama..., 2010-05-25, 14:06
[expand - 1 more] - Region spiting, compaction and merging - HBase - [mail # user]
... to run manually major compaction to get rid of invalidated data (from around 500MB to 0MB and few in memStore according to UI). As far as can see in the logs there were no major compactions since...
... compaction at some particular period - i.e 5 a.m, so it doesn't generate unnecessary load during hot periods like in the evening where there is a strong demand for performance? Or maybe I am...
   Author: Michał Podsiadłowski, 2010-03-31, 10:28
[expand - 6 more] - Too many "Compaction Complete" messages - HBase - [mail # user]
... 2GB to 4GB, to avoid increasing the region count.  There were no reported problems or errors when I started back up, but ever since then I have had hundreds of "Compacting d in {sometable...
...}...... Compaction Complete" messages filling up my region server task status. It has been doing this with no appreciable change in pace for 5 days now.  When I look at the regionserver web UI, I see...
[+ show more]
   Author: Tom Brown, 2013-09-04, 02:13
Sort:
project
HBase (920)
Cassandra (253)
Accumulo (121)
Hive (41)
Kafka (30)
Hadoop (21)
Spark (18)
Avro (17)
MapReduce (9)
HDFS (8)
Pig (8)
Impala (7)
Phoenix (4)
Zookeeper (3)
Drill (2)
Flume (2)
Sqoop (2)
type
mail # user (917)
issue (483)
mail # dev (268)
javadoc (72)
source code (65)
wiki (5)
date
last 7 days (2)
last 30 days (5)
last 90 days (25)
last 6 months (62)
last 9 months (920)
author
Jean-Daniel Cryans (57)
Stack (55)
Ted Yu (38)
Jean-Marc Spaggiari (31)
lars hofhansl (22)
Ryan Rawson (15)
Andrew Purtell (12)
Doug Meil (12)
Michael Segel (11)
Vidhyashankar Venkatarama...(10)
Bryan Beaudreault (9)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Buttler, David (7)
Harsh J (7)
Jack Levin (7)
Jinsong Hu (7)
Matt Corgan (7)
Amit Sela (6)
Dmitriy Lyubimov (6)
Esteban Gutierrez (6)
Jonathan Gray (6)
Lars George (6)
Otis Gospodnetic (6)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB