Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: compactions.   Results from 91 to 100 from 948 (0.204s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
[expand - 11 more] - Filtering/Collection columns during Major Compaction - HBase - [mail # user]
...Hi,  My understanding of major compaction is that it rewrites one store file and does a merge of the memstore, store files on disk and cleans out delete tombstones and puts prior to them...
... the major compaction which can be run daily too. I see, from the code that a major compaction essentially invokes a Scan over the region - so if the Scan is invoked with the appropriate filter (say...
   Author: Varun Sharma, 2012-12-10, 13:58
Minor compactions and impact of number of HFiles within a Store - HBase - [mail # user]
...Hi there,  I was about to tune major/minor compaction behavior and I'm wondering what are the exact (negative) aspects of handling lots (let say between 3 and 20) HFiles within a single...
... could it be critical ? - Do the minor compactions help reducing major compaction time ? (e.g. for a same data volume, is it faster to merge 3 files rather than 20 files ?) - Considering I have...
[+ show more]
   Author: Adrien Mogenet, 2012-12-08, 19:19
[expand - 14 more] - Re: How to check if a major_compact is done? - HBase - [mail # user]
...Hi, as I recently find out, by spinning on  getStorefiles = task.getStores() may not be a robust method to check if a compaction is done. For instance, if the interval for checking is set...
... too large and there are compaction and flushes intertwined together, then in the end,  getStorefiles() may not be equal to task.getStores() even when compaction is done.  Currently, I have...
   Author: yun peng, 2012-11-17, 01:03
[expand - 1 more] - Parent region data not deleted after compact - HBase - [mail # user]
... regions.In my opion, they are parent region directories that forget to clean. I'm try to do major_compact on this table now,but i don't know if this can solve the problem. Anyone can help to clear...
   Author: Eason Lee, 2012-04-05, 08:14
[expand - 2 more] - Can I major compact a specific column family? - HBase - [mail # user]
...Reading through the code, it seems, compaction flow is not designed to allow per column family compaction. I am not able to understand why? Please comment.  -Shrijeet ...
   Author: Shrijeet Paliwal, 2011-06-27, 22:41
double assignment WAS: Errors after major compaction - HBase - [mail # user]
...2011-06-29 16:39:54,326 DEBUG org.apache.hadoop.hbase. master.handler.OpenedRegionHandler: Opened region gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843...
   Author: Ted Yu, 2011-07-07, 10:41
[expand - 2 more] - Paid OSS task for performing manual major compactions - HBase - [mail # user]
...Mozilla recently had to turn off automatic scheduled major compactions  because if they happen during our peak load time, they cause an IO delay  that can destabilize our client...
... applications.  We need to put a replacement system in place as soon as possible that  can initiate the major compaction and ensure that it successfully  completed (See HBASE-2770). It would be nice...
   Author: Daniel Einspanjer, 2010-10-05, 18:11
[expand - 13 more] - Re: Additional disk space required for Hbase compactions.. - HBase - [mail # user]
...Thank you Jonathan for raising the Jira and attaching a patch  I was looking for more info on how major compactions and minor  compactions work and google found me this page:  http...
...://wiki.apache.org/hadoop/Hbase/HbaseArchitecture  After reading the wiki page and Google Bigtable paper, it seems to me  that there is a difference between Google 'minor compactions' andHbase  'minor compactions'.  In google, a minor compaction...
[+ show more]
   Author: TuX RaceR, 2010-05-18, 08:06
[expand - 8 more] - RE: [HBase 0.92.1] Too many stores files to compact, compaction moving slowly - HBase - [mail # user]
...Hi Shrijeet Regarding your last question about the region growing bigger The following points could be one reason  When you said your compactions are slower and also you were trying...
... to split some very big store files, every split would have created some set of reference files. By the time as more writes are happening more store files are flushed.  In the compaction algo...
[+ show more]
   Author: Ramkrishna.S.Vasudevan, 2012-05-14, 04:29
[expand - 6 more] - Re: RegionServer crash without any errors (compaction?) - HBase - [mail # user]
...Did you look at your GC logs? Probably the compaction process is running your region server out of memory. Can you provide more details on your setup? Max heap size? Max Region HFile size...
...?   Regards, Dhaval   ________________________________  From: John  To: [EMAIL PROTECTED]  Sent: Thursday, 7 November 2013 10:51 AM Subject: RegionServer crash without any errors (compaction...
[+ show more]
   Author: Dhaval Shah, 2013-11-07, 15:59
HBase (948)
Cassandra (339)
Accumulo (126)
Hive (51)
Kafka (45)
Spark (30)
Hadoop (21)
Avro (17)
Impala (10)
Phoenix (10)
MapReduce (9)
HDFS (8)
Pig (8)
Zookeeper (3)
Drill (2)
Flume (2)
Sqoop (2)
Storm (2)
Mesos (1)
Tez (1)
mail # user (945)
issue (513)
mail # dev (285)
javadoc (72)
source code (65)
wiki (5)
last 7 days (1)
last 30 days (10)
last 90 days (28)
last 6 months (53)
last 9 months (948)
Stack (58)
Jean-Daniel Cryans (57)
Ted Yu (41)
Jean-Marc Spaggiari (32)
lars hofhansl (22)
Ryan Rawson (15)
Andrew Purtell (12)
Doug Meil (12)
Michael Segel (12)
Vidhyashankar Venkatarama...(10)
Bryan Beaudreault (9)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Buttler, David (7)
Harsh J (7)
Jack Levin (7)
Jinsong Hu (7)
Matt Corgan (7)
Otis Gospodnetic (7)
Amit Sela (6)
Dmitriy Lyubimov (6)
Esteban Gutierrez (6)
Jonathan Gray (6)
Lars George (6)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB