Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: compactions.   Results from 1 to 7 from 7 (0.357s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
Major vs Minor compactions - HBase - [mail # user]
...Hi,  I am working on some compaction coprocessors for a column family with versions set to 1. I am using the preCompact hook to wrap a scanner around the compaction scanner.  I wanted...
... to know what to expect from the minor compaction output. Can I assume the following: 1) Versions for each cell will be 1 2) Delete markers will be retained 3) Corresponding versions older than...
   Author: Varun Sharma, 2013-05-29, 20:27
[expand - 5 more] - Filtering/Collection columns during Major Compaction - HBase - [mail # user]
...Hi,  My understanding of major compaction is that it rewrites one store file and does a merge of the memstore, store files on disk and cleans out delete tombstones and puts prior to them...
... the major compaction which can be run daily too. I see, from the code that a major compaction essentially invokes a Scan over the region - so if the Scan is invoked with the appropriate filter (say...
   Author: Varun Sharma, 2012-12-10, 13:58
[expand - 2 more] - Re: Hbase heap size - HBase - [mail # user]
...I meant controlling compaction activity by emitting fewer hfiles but of larger size.  On Fri, Jan 18, 2013 at 12:28 PM, Adrien Mogenet wrote:  ...
   Author: Varun Sharma, 2013-01-18, 20:43
Key Value collision - HBase - [mail # user]
..._VERSIONS == 1, how is the tie broken during reads and during minor compactions, is it arbitrary ?  Thanks Varun ...
   Author: Varun Sharma, 2013-05-16, 18:49
Re: Slow Get Performance (or how many disk I/O does it take for one non-cached read?) - HBase - [mail # user]
... caching off/on so I guess off is > fine. > > Yes, I always do a major_compact before testing. > > I think this probably concludes my question - I will try to upgrade to a > newer hbase version...
   Author: Varun Sharma, 2014-02-02, 19:03
Re: 答复: GC pause issues - HBase - [mail # user]
... noted today was that the pauses are spaced @10 seconds until a minor compaction kicks in - and then then the pauses happen every 3-4 seconds. I found this to be highly correlated on a region...
... server. These minor compactions are not huge - they are typically compacting 3 files - upto 200M in total size. They are lasting for 20-30 seconds. Once they are over the GC pauses recover back...
   Author: Varun Sharma, 2013-01-25, 17:55
[expand - 1 more] - Re: Get on a row with multiple columns - HBase - [mail # user]
... did 99th probably because of having to traverse delete markers. I attribute this to profusion of delete markers in the cluster. Major compactions slowed down by almost 50 percent probably...
   Author: Varun Sharma, 2013-02-09, 06:05
Sort:
project
HBase (7)
type
mail # user (7)
mail # dev (1)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (7)
author
Jean-Daniel Cryans (57)
Stack (55)
Ted Yu (38)
Jean-Marc Spaggiari (31)
lars hofhansl (22)
Ryan Rawson (15)
Andrew Purtell (12)
Doug Meil (12)
Michael Segel (11)
Vidhyashankar Venkatarama...(10)
Bryan Beaudreault (9)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Buttler, David (7)
Harsh J (7)
Jack Levin (7)
Jinsong Hu (7)
Matt Corgan (7)
Amit Sela (6)
Dmitriy Lyubimov (6)
Jonathan Gray (6)
Lars George (6)
Otis Gospodnetic (6)
Varun Sharma (6)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB