Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: compactions.   Results from 61 to 70 from 840 (0.118s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
Compactions in busy system(s) - HBase - [mail # user]
...  Hi all,  I'm not sure if I've understood well the purpose of major compaction and  how to handle it in a busy system. It is important to run major compaction when we have a lot of deleted...
...  data, as it removes the "marked as deleted" flags. There are also the "flush" and "minor compaction" operations associated  with the writing on disk. I understand that in minor compaction many...
[+ show more]
   Author: Iulia Zidaru, 2011-04-05, 10:45
Major Compaction Causes Cluster Failure - HBase - [mail # user]
...Hi all -  A couple of nights ago I enabled cron jobs to run major compactions against a few of the tables that I use in HBase.  This has caused multiple worker machines on the cluster...
... to fail.  Based on the compaction or losing the worker nodes, many of the regions are stuck in transition with a state of PENDING_CLOSE.  I believe resetting HBase master will solve that, which...
[+ show more]
   Author: Scott Whitecross, 2010-09-17, 16:14
On source code of File Section mechanism in minor compaction - HBase - [mail # user]
...Hi, All I am asking the source code showing the file selection mechanism for minor compaction in HBase. I am aware that HBase minor compaction selects file based on size and generation time...
   Author: yun peng, 2013-04-11, 14:52
Effect of turning major compactions off.. - HBase - [mail # user]
...Are there any side effects to turning major compactions off, other than jus t a hit in the read performance?  I was trying to merge a 120 Gig update (modify/insert/delete operations...
...) in to a 2 TB fully compacted Hbase table with 5 region servers using a map red uce job.. Each RS was serving around 2000 regions (256 MB max size)... Majo r compactions were turned off before...
[+ show more]
   Author: Vidhyashankar Venkatarama..., 2010-05-26, 16:07
Reducing impact of compactions on read performance - HBase - [mail # user]
... of the time the bulk update has no impact on overall HBase performance.  A few times during the day, usually during peak load times, the bulk update seems to result in a (minor?) compaction which has...
... a huge impact on random read performance.  Read throughput drops from ~4000 reads/sec down to ~1000 reads/sec.  I'm wondering what strategies we can use to reduce the impact of compactions...
[+ show more]
   Author: James Baldassari, 2010-05-18, 05:47
major_compact progress report ? - HBase - [mail # user]
...Hello,  I'm trying to apply major_compact on some of my tables to enable GZ  compression on the fly.  when I do:  $ major_compact 'table"  I don't see any info and I know how to follow...
... the progress of the  compaction. Is it instantaneous (I guess not)? Is there a log file  where I can see the progress of the operation?  When I count the number of regions of my table, it is still...
[+ show more]
   Author: Vincent Barat, 2010-02-08, 16:23
compaction does not reduce the number of regions - HBase - [mail # user]
...Hi guys,  We have a table which stored previously uncompressed data which we changed to store GZ-compressed data. We performed a compaction on that table which shrank its size three...
...-fold. However, I noticed that compaction reduced the size of the region, but did not reduce the number of regions.  My questions is: 1. How does the scan performance (and also random read performance...
   Author: Boris Aleksandrovsky, 2010-02-11, 17:59
Re: Getting the scan type at preCompact - HBase - [mail # user]
...Asaf: I guess you're suggesting that we pass ScanType into preCompact() similar to what we pass into preCompactScannerOpen():                .preCompactScannerOpen(store, scanners...
...,                    majorCompaction ? ScanType.MAJOR_COMPACT : ScanType. MINOR_COMPACT, earliestPutTs); Mind filing a JIRA ?  Thanks  On Tue, Jan 29, 2013 at 10:21 AM, Asaf Mesika  wrote:  ...
   Author: Ted Yu, 2013-01-29, 18:33
Best way to compact a region after a move? - HBase - [mail # user]
...Hi,  When I'm balancing manually the regions on my cluster, and I want to make sure they are local, so I want to major_compact them each time I'm moving them.  On the balanceCluster method...
..., we are returning a list of region to move. Which mean they are not yet moved, so I can't compact them there.  Is there a place where I shoud hook to compact those regions?  So far, the only...
[+ show more]
   Author: Jean-Marc Spaggiari, 2012-12-30, 16:25
HBase client locks application during major compactions - HBase - [mail # user]
... figured out that it was caused by/happening during major compactions.  We have automated major compactions disabled and are running them manually on each table sequentially each day starting at 4...
... at the logs in HBase show that the compactions are occurring and this warning repeatedly while the compactions are occurring,  WARN org.apache.hadoop.ipc.HBaseServer: IPC Server Responder, call get...
   Author: Baugher,Bryan, 2012-12-28, 17:40
HBase (840)
Accumulo (102)
Cassandra (55)
Hive (37)
Hadoop (19)
Avro (17)
Kafka (12)
MapReduce (9)
HDFS (8)
Pig (8)
Flume (2)
Zookeeper (2)
Drill (1)
Impala (1)
Sqoop (1)
mail # user (838)
issue (374)
mail # dev (242)
javadoc (70)
source code (67)
wiki (6)
last 7 days (1)
last 30 days (17)
last 90 days (45)
last 6 months (81)
last 9 months (840)
Jean-Daniel Cryans (58)
Stack (54)
Ted Yu (26)
Jean-Marc Spaggiari (25)
lars hofhansl (19)
Ryan Rawson (15)
Andrew Purtell (12)
Doug Meil (12)
Michael Segel (11)
Vidhyashankar Venkatarama...(10)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Bryan Beaudreault (7)
Buttler, David (7)