Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: compactions.   Results from 31 to 40 from 872 (0.176s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
Did major compaction really happen? - HBase - [mail # user]
...In order to turn off major compaction, I set MAJOR_COMPACTION_PERIOD to 0. However, I checked region server log, saw major compaction “happened"  quite often:   2013-12-17 01:44:45,085 INFO...
... org.apache.hadoop.hbase.regionserver.Store: Completed major compaction of 4 file(s) in cf1 of my_table,75,1387269666255.a6b0df058bf97f2f0efe1ed75f445a2c. into b23af74c66d8477b963750feed19ef23...
[+ show more]
   Author: branky, 2013-12-20, 04:49
Smart Managed Major Compactions - HBase - [mail # user]
...Hello all,   Before I start, I'm running cdh3u2, so 0.90.4.  I am looking into managing major compactions ourselves, but there doesn't appear to be any mechanisms I can hook in to determine...
... which tables need compacting.  Ideally each time my cron job runs it would compact the table with the next longest time since compaction, but I can't find a way to access this metric...
[+ show more]
   Author: Bryan Beaudreault, 2012-07-18, 17:26
Restrictions during compactions - HBase - [mail # user]
...Hello,  I'm a newbie and wondering whether or not there is any restriction during HBase minor/major compactions. I read the online document but could not find any explicit mention about...
... restrictions. What I'm mostly worrying about is whether read/write operations are blocked during compactions.  The description about 'hbase.hstore.blockingWaitTime':  The time an HRegion will block...
[+ show more]
   Author: Takahiko Kawasaki, 2012-05-23, 13:15
Schedule major compaction programmatically - HBase - [mail # user]
...I would like to schedule major compaction on a region programmatically. I found the API call below which can properly achieve my goal.  HBaseAdmin.majorCompact(String table...
...OrRegionName)  It turns out to be an asynchronous call and there seems no call back parameter that can be specified. How can I validate the compaction result (e.g., success or failure) ?  Thanks Chen ...
   Author: Chen Song, 2012-05-17, 18:11
Re: the occasion of the major compact? - HBase - [mail # user]
...I've had a similar question... perhaps the client promotes a compaction to "major" if:  a) the threshold for compaction is reached ( hbase.hstore.compactionThreshold ) or (and?) b...
...) the maximum number of files to process in a "minor" compaction is high enough to result in all files being processed into one ( hbase.hstore.compaction.max )   Can someone confirm if this is correct...
[+ show more]
   Author: Neil Yalowitz, 2012-01-26, 18:16
heavy writing and compaction storms - HBase - [mail # user]
...Hi all,  What strategies do HBase 0.90 users employ to deal with or avoid the so-called "compaction storm"?  I'm referring to the issue referred to in 2.8.2.7 here:  http...
..., creates a level increase of Storefiles on all regions.  When a compaction threshold is reached for one region, it is usually reached for many regions... causing many, many regions to request...
[+ show more]
   Author: Neil Yalowitz, 2012-01-12, 17:56
major compaction and regionserver failure... - HBase - [mail # user]
...    I was wondering if someone could tell me what happens if a regionserver  fails during major compaction.  Are the entries that were in the compaction  queue for the failed regionserver...
... migrated along with the regions to anoth er server or are those requests for major compaction effectively lost for t hat run of major compaction?  I guess what I'm really asking is do I still  get...
[+ show more]
   Author: Andy Sautins, 2011-12-10, 18:37
why  major_compaction does more performance consumption than  minor_compaction ? - HBase - [mail # user]
...hello everyone! Differenct between them: 1、minor_compact will select best storeFiles to compact。 2、major_compact will select all storeFiles to compact and do some clean work。 Region...
...Server holds only one compactSplitThread ,and only one compact task run ! 3、The compaction task just scans all the storefiles and then merge one, so I hold the opinon that major compact only cost...
   Author: Fx_Bull, 2014-06-20, 09:11
big compaction queue size - HBase - [mail # user]
... value size up to 4MB per object).  I check the log of regionserver, it seems like the compaction queue size is about 1700, and every the compaction action takes about 1 minute, and more over...
..., most of the compaction are triggered to a major one.  My question are,  1. Would this cause the performance degradation? It seems like "GET" action in the interval that two minutes before...
[+ show more]
   Author: Xu-Feng Mao, 2011-09-06, 08:15
Re: Region statistics created during major compaction - HBase - [mail # user]
...Interesting idea. How would the ranges of rows be determined per region ? This reminds me of stripe compaction feature which is in 0.98 See HBASE-7667 Cheers On Apr 30, 2014, at 3...
   Author: Ted Yu, 2014-04-30, 10:26
Sort:
project
HBase (872)
Cassandra (141)
Accumulo (116)
Hive (39)
Hadoop (20)
Kafka (19)
Avro (17)
MapReduce (9)
HDFS (8)
Pig (8)
Spark (4)
Impala (3)
Zookeeper (3)
Flume (2)
Sqoop (2)
Drill (1)
type
mail # user (870)
issue (429)
mail # dev (256)
javadoc (70)
source code (67)
wiki (6)
date
last 7 days (5)
last 30 days (12)
last 90 days (30)
last 6 months (76)
last 9 months (872)
author
Jean-Daniel Cryans (58)
Stack (55)
Ted Yu (31)
Jean-Marc Spaggiari (28)
lars hofhansl (20)
Ryan Rawson (15)
Andrew Purtell (12)
Doug Meil (12)
Michael Segel (11)
Vidhyashankar Venkatarama...(10)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Bryan Beaudreault (7)
Buttler, David (7)
Harsh J (7)
Jack Levin (7)
Jinsong Hu (7)
Matt Corgan (7)
Amit Sela (6)
Dmitriy Lyubimov (6)
Jonathan Gray (6)
Lars George (6)
Otis Gospodnetic (6)
Varun Sharma (6)