| clear query|facets|time |
Search criteria: .
Results from 101 to 110 from
160 (0.229s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: prefix compression implementation - HBase - [mail # dev]
|
|
...Ryan - i answered your question on another thread yesterday. Will use this thread to continue conversation on the KeyValue interface. I don't think the name is all that important...
|
|
|
Author: Matt Corgan,
2011-09-19, 22:26
|
|
|
Re: HBase as a large, auto-partitioned, sorted, *in-memory* database (was: Re: prefix compression implementation) - HBase - [mail # dev]
|
|
...I think there's 2 major issues right now, both related to the data and index block formats. First problem is the amount of duplicate information in the uncompressed block format. ...
|
|
|
Author: Matt Corgan,
2011-09-19, 01:43
|
|
|
Re: prefix compression implementation - HBase - [mail # dev]
|
|
...Ryan - thanks for the feedback. The situation I'm thinking of where it's useful to parse DirectBB without copying to heap is when you are serving small random values out of the block c...
|
|
|
Author: Matt Corgan,
2011-09-17, 02:29
|
|
|
Re: prefix compression implementation - HBase - [mail # dev]
|
|
...I'm a little confused over the direction of the DBBs in general, hence the lack of clarity in my code. I see value in doing fine-grained parsing of the DBB if you're going to have a la...
|
|
|
Author: Matt Corgan,
2011-09-17, 01:47
|
|
|
Re: prefix compression implementation - HBase - [mail # dev]
|
|
...Jacek, Thanks for helping out with this. I implemented most of the DeltaEncoder and DeltaEncoderSeeker. I haven't taken the time to generate a good set of test data for any...
|
|
|
Author: Matt Corgan,
2011-09-17, 00:48
|
|
|
prefix compression implementation - HBase - [mail # dev]
|
|
...Hi devs, I put a "developer preview" of a prefix compression algorithm on github. It still needs some details worked out, a full set of iterators, about 200 optimizations, and a ...
|
|
|
Author: Matt Corgan,
2011-09-13, 07:44
|
|
|
CPU cache effectiveness - HBase - [mail # dev]
|
|
...I mentioned a bunch of stuff in that prefix compression email about cache lines, prefetching, trie node sizes, etc... The gist of it all is that memory has become relatively slow to th...
|
|
|
Author: Matt Corgan,
2011-06-04, 23:25
|
|
|
Re: prefix compression - HBase - [mail # dev]
|
|
...Ah - I see. It's generating multiple duplicate timestamps per millisecond, so there are fewer than 50mm unique strings. Duplicates just require incrementing a counter. Agre...
|
|
|
Author: Matt Corgan,
2011-06-04, 04:57
|
|
|
Re: prefix compression - HBase - [mail # dev]
|
|
...Jason - are you feeding it that whole string for each date? Input data is 17 bytes per record * 50mm records = 850MB, and that reduces to 984 bytes? Is it possible to compress by...
|
|
|
Author: Matt Corgan,
2011-06-04, 03:56
|
|
|
Re: prefix compression - HBase - [mail # dev]
|
|
...Thanks for the feedback Stack. Some inline responses: On Thu, Jun 2, 2011 at 9:48 PM, Stack wrote: params: rowKeyFormat, colQualifierFormat, and timestampFormat ...
|
|
|
Author: Matt Corgan,
2011-06-04, 02:03
|
|
|
|
