Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: compactions.   Results from 61 to 70 from 872 (0.242s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
major compaction time constantly growing - HBase - [mail # user]
... has 2G ram     We have 4map/2reducer per machine  We write from m/r job to hbase (2 jobs a day).    1) We running major compaction manually once a day    2) We increases regions size...
... to prevent automatic split    3) We didn't use WAL (WAL is false).  We started running major compaction 3 month before on dayly basis. Major compaction execution time from the very begining was ~1...
[+ show more]
   Author: Oleg Ruchovets, 2011-09-21, 18:31
Is there a way to increase the compaction queue size? - HBase - [mail # user]
...Hi, all, I have a hbase region server of 10 regions and find the compaction queue size is always 10 at maximum. After I finished inserting 1 billion records, there are still hundreds...
... of HFiles in each region and no further minor compaction is queuing.  My settings, hbase.hstore.blockingStoreFiles=Integer.MAX_VALUE hbase.hstore.compactionThreshold=3 hbase.hstore.max.filesize=100G...
[+ show more]
   Author: Sheng Chen, 2011-07-07, 05:55
Closed regions during major compact - HBase - [mail # user]
... a major compact of the table after this failure, the m ajor compact failed and throws a Region XXX not online.  But, we do not see any errors unless we attempt the major compact.   Anyone have...
   Author: highpointe, 2011-06-15, 19:59
Re: Major Compaction in 0.90.6 - HBase - [mail # user]
...Inline.  J-D   On Mon, Aug 19, 2013 at 2:48 AM, Monish r  wrote:   Yes, look at CompactSplitThread    It doesn't in 0.90.6 but CompactSplitThread lists those for 0.92+  hbase.regionserver.thread.compaction...
....large hbase.regionserver.thread.compaction.small    Determining if something is major-compacted is definitely not at the table-level.  In 0.90.6, MajorCompactionChecker will ask HRegion.isMajorCompaction...
[+ show more]
   Author: Jean-Daniel Cryans, 2013-08-19, 18:22
Compactions in busy system(s) - HBase - [mail # user]
...  Hi all,  I'm not sure if I've understood well the purpose of major compaction and  how to handle it in a busy system. It is important to run major compaction when we have a lot of deleted...
...  data, as it removes the "marked as deleted" flags. There are also the "flush" and "minor compaction" operations associated  with the writing on disk. I understand that in minor compaction many...
[+ show more]
   Author: Iulia Zidaru, 2011-04-05, 10:45
【region compaction check key-bound or not】 - HBase - [mail # user]
...Hi,all  If Region process splits, it will make a reference.After executing child region makes a compaction that absorbs all the reference. And I have a question that how to make differences...
... when executes scanner. As we know that Compaction uses the scanner as well, so whether to set the startKey and endKey of child region's bound, in order to guarantee that the storefile in child...
   Author: Bing Jiang, 2013-07-10, 11:25
Re: how can i do compaction manually? - HBase - [mail # user]
...major_compact command can also compact selected region.  Take a look at the sample at the beginning of: ./src/main/ruby/shell/commands/major_compact.rb  Cheers  On Mon, Jul 1, 2013 at 10...
   Author: Ted Yu, 2013-07-01, 03:00
Major Compaction Causes Cluster Failure - HBase - [mail # user]
...Hi all -  A couple of nights ago I enabled cron jobs to run major compactions against a few of the tables that I use in HBase.  This has caused multiple worker machines on the cluster...
... to fail.  Based on the compaction or losing the worker nodes, many of the regions are stuck in transition with a state of PENDING_CLOSE.  I believe resetting HBase master will solve that, which...
[+ show more]
   Author: Scott Whitecross, 2010-09-17, 16:14
Effect of turning major compactions off.. - HBase - [mail # user]
...Are there any side effects to turning major compactions off, other than jus t a hit in the read performance?  I was trying to merge a 120 Gig update (modify/insert/delete operations...
...) in to a 2 TB fully compacted Hbase table with 5 region servers using a map red uce job.. Each RS was serving around 2000 regions (256 MB max size)... Majo r compactions were turned off before...
[+ show more]
   Author: Vidhyashankar Venkatarama..., 2010-05-26, 16:07
Reducing impact of compactions on read performance - HBase - [mail # user]
... of the time the bulk update has no impact on overall HBase performance.  A few times during the day, usually during peak load times, the bulk update seems to result in a (minor?) compaction which has...
... a huge impact on random read performance.  Read throughput drops from ~4000 reads/sec down to ~1000 reads/sec.  I'm wondering what strategies we can use to reduce the impact of compactions...
[+ show more]
   Author: James Baldassari, 2010-05-18, 05:47
HBase (872)
Cassandra (141)
Accumulo (116)
Hive (39)
Hadoop (20)
Kafka (19)
Avro (17)
MapReduce (9)
HDFS (8)
Pig (8)
Spark (5)
Impala (3)
Zookeeper (3)
Flume (2)
Sqoop (2)
Drill (1)
mail # user (870)
issue (429)
mail # dev (256)
javadoc (70)
source code (67)
wiki (6)
last 7 days (4)
last 30 days (12)
last 90 days (26)
last 6 months (74)
last 9 months (872)
Jean-Daniel Cryans (58)
Stack (55)
Ted Yu (31)
Jean-Marc Spaggiari (28)
lars hofhansl (20)
Ryan Rawson (15)
Andrew Purtell (12)
Doug Meil (12)
Michael Segel (11)
Vidhyashankar Venkatarama...(10)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Bryan Beaudreault (7)
Buttler, David (7)
Harsh J (7)
Jack Levin (7)
Jinsong Hu (7)
Matt Corgan (7)
Amit Sela (6)
Dmitriy Lyubimov (6)
Jonathan Gray (6)
Lars George (6)
Otis Gospodnetic (6)
Varun Sharma (6)