Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: compactions.   Results from 41 to 50 from 940 (0.511s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
[expand - 4 more] - big compaction queue size - HBase - [mail # user]
... value size up to 4MB per object).  I check the log of regionserver, it seems like the compaction queue size is about 1700, and every the compaction action takes about 1 minute, and more over...
..., most of the compaction are triggered to a major one.  My question are,  1. Would this cause the performance degradation? It seems like "GET" action in the interval that two minutes before...
[+ show more]
   Author: Xu-Feng Mao, 2011-09-06, 08:15
[expand - 21 more] - Errors after major compaction - HBase - [mail # user]
... reduced the TTL on the table and initiated major compaction. This should have reduced the table size to about 20% of its original size. Today, I'm getting errors of inaccessible files on HDFS...
..._674664  I assume the file loss is somehow related to this change and the major compaction that followed because the same scan that is failing now was working fine yesterday and that is the only...
   Author: Eran Kutner, 2011-06-30, 10:58
[expand - 1 more] - HBase major_,compaction - HBase - [mail # user]
...  of regions even after I major_compact all tables. I t seems that major_com pact didn'tcompact any region.    What can I do to compact the regions and have fewer regions, and how can I  check...
... if the table is already compacted?    I'm using Hbase 0.90.2.    Thanks,    Miguel    ...
   Author: Miguel Costa, 2011-05-25, 20:13
[expand - 5 more] - major compaction best practice - HBase - [mail # user]
... compaction best practices:  1) Have we to run it automatically or manually 2) How ofter it should run 3) Where can I read about compaction process and does it have potential problem that I should...
   Author: Oleg Ruchovets, 2011-05-16, 10:42
[expand - 1 more] - HConstants.MAJOR_COMPACTION_PERIOD - HBase - [mail # user]
...Hi, Where should I set it?  HConstants.MAJOR_COMPACTION_PERIOD Yaniv View this message in context: http://apache-hbase.679495.n3.nabble.com/HConstants-MAJOR-COMPACTION-PERIOD-tp4055960...
   Author: yanivG, 2014-02-13, 16:09
Re: number of store files and compaction - HBase - [mail # user]
...bq. will hbase.hstore.blockingStoreFiles still take effect? Yes. bq. does it trigger a minor compaction or major one Minor compaction, unless all store files are selected where...
... the compaction becomes major. On Fri, Feb 7, 2014 at 8:05 AM, Yu, Libo  wrote:   ...
   Author: Ted Yu, 2014-02-07, 16:57
[expand - 6 more] - Re: Major compaction time - HBase - [mail # user]
...You are running w/ the defaults where major compaction runs every day?  It depends on how your data is changing but at the extreme, a major compaction is a rewrite of the total data set...
....  We'll usually suggest that folks turn off the auto-major compaction and instead run it manually at time of low loading -- evening or w/e dependent on traffic -- or that they manage it in some...
[+ show more]
   Author: Stack, 2011-03-09, 18:25
[expand - 13 more] - Major compactions and OS cache - HBase - [mail # user]
... house keeping on a regular basis. These so called compactions rewrite  files as new data is added over time. All files in HDFS once written are  immutable (for all sorts of reasons). Because...
... of  that, data is written into  new files and as their number grows HBase compacts them into another set of  new, consolidated files. And here is  the kicker: HDFS is smart enough to put  the data...
[+ show more]
   Author: Otis Gospodnetic, 2011-02-16, 12:30
[expand - 1 more] - Configs for Hbase compaction switch... - HBase - [mail # user]
...I want to run some experiments with the major compactions turned off..  There are two parameters that I can see both of which have to be modified t o turn major compactions off (am I right...
... here?). hbase.hstore.compactionThreshold and hbase.hregion.majorcompaction...  But the config file's comments say that setting compactionThreshold to a hi gh value may lead to memory issues...
[+ show more]
   Author: Vidhyashankar Venkatarama..., 2010-05-25, 14:06
[expand - 8 more] - Did major compaction really happen? - HBase - [mail # user]
...In order to turn off major compaction, I set MAJOR_COMPACTION_PERIOD to 0. However, I checked region server log, saw major compaction “happened"  quite often:   2013-12-17 01:44:45,085 INFO...
... org.apache.hadoop.hbase.regionserver.Store: Completed major compaction of 4 file(s) in cf1 of my_table,75,1387269666255.a6b0df058bf97f2f0efe1ed75f445a2c. into b23af74c66d8477b963750feed19ef23...
[+ show more]
   Author: branky, 2013-12-20, 04:49
Sort:
project
HBase (940)
Cassandra (320)
Accumulo (125)
Hive (45)
Kafka (39)
Spark (28)
Hadoop (21)
Avro (17)
Impala (10)
MapReduce (9)
HDFS (8)
Pig (8)
Phoenix (7)
Zookeeper (3)
Drill (2)
Flume (2)
Sqoop (2)
Storm (2)
Mesos (1)
Tez (1)
type
mail # user (937)
issue (509)
mail # dev (277)
javadoc (72)
source code (65)
wiki (5)
date
last 7 days (2)
last 30 days (11)
last 90 days (24)
last 6 months (48)
last 9 months (940)
author
Stack (58)
Jean-Daniel Cryans (57)
Ted Yu (41)
Jean-Marc Spaggiari (32)
lars hofhansl (22)
Ryan Rawson (15)
Andrew Purtell (12)
Doug Meil (12)
Michael Segel (11)
Vidhyashankar Venkatarama...(10)
Bryan Beaudreault (9)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Buttler, David (7)
Harsh J (7)
Jack Levin (7)
Jinsong Hu (7)
Matt Corgan (7)
Otis Gospodnetic (7)
Amit Sela (6)
Dmitriy Lyubimov (6)
Esteban Gutierrez (6)
Jonathan Gray (6)
Lars George (6)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB