| clear query|facets|time |
Search criteria: .
Results from 91 to 100 from
321 (0.127s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Using global reverse lookup tables - Hadoop - [mail # user]
|
|
...On Fri, Apr 15, 2011 at 11:45 AM, W.P. McNeill wrote: likely to be much better. One helpful tweak would be to put a Bloom filter in front of the MapFile to avoid probing i...
|
|
|
Author: Ted Dunning,
2011-04-15, 21:43
|
|
|
Re: Dynamic Data Sets - Hadoop - [mail # user]
|
|
...Hbase is very good at this kind of thing. Depending on your aggregation needs OpenTSDB might be interesting since they store and query against large amounts of time ordered data simila...
|
|
|
Author: Ted Dunning,
2011-04-14, 03:12
|
|
|
Re: Memory mapped resources - Hadoop - [mail # user]
|
|
...Benson is actually a pretty sophisticated guy who knows a lot about mmap. I engaged with him yesterday on this since I know him from Apache. On Tue, Apr 12, 2011 at 7:16 PM, M. C...
|
|
|
Author: Ted Dunning,
2011-04-13, 04:09
|
|
|
Re: Memory mapped resources - Hadoop - [mail # user]
|
|
...Actually, it doesn't become trivial. It just becomes total fail or total win instead of almost always being partial win. It doesn't meet Benson's need. On Tue, Apr 12, 2011...
|
|
|
Author: Ted Dunning,
2011-04-12, 19:05
|
|
|
Re: Memory mapped resources - Hadoop - [mail # user]
|
|
...Blocks live where they land when first created. They can be moved due to node failure or rebalancing, but it is typically pretty expensive to do this. It certainly is slower than...
|
|
|
Author: Ted Dunning,
2011-04-12, 15:35
|
|
|
Re: Memory mapped resources - Hadoop - [mail # user]
|
|
...Well, no. You could mmap all the blocks that are local to the node your program is on. The others you will have to read more conventionally. If all blocks are guaranteed lo...
|
|
|
Author: Ted Dunning,
2011-04-12, 15:08
|
|
|
Re: Memory mapped resources - Hadoop - [mail # user]
|
|
...Kevin, You present a good discussion of architectural alternatives here. But my comment really had more to do with whether a particular HDFS patch would provide what the original...
|
|
|
Author: Ted Dunning,
2011-04-12, 15:07
|
|
|
Re: Memory mapped resources - Hadoop - [mail # user]
|
|
...Yes. But only one such block. That is what I meant by chunk. That is fine if you want that chunk but if you want to mmap the entire file, it isn't real useful. On Mon, Apr ...
|
|
|
Author: Ted Dunning,
2011-04-12, 04:09
|
|
|
Re: Memory mapped resources - Hadoop - [mail # user]
|
|
...Also, it only provides access to a local chunk of a file which isn't very useful. On Mon, Apr 11, 2011 at 5:32 PM, Edward Capriolo wrote: ...
|
|
|
Author: Ted Dunning,
2011-04-12, 01:30
|
|
|
Re: Using global reverse lookup tables - Hadoop - [mail # user]
|
|
...Depending on the function that you want to use, it sounds like you want to use a self join to compute transposed cooccurrence. That is, it sounds like you want to find all the sets tha...
|
|
|
Author: Ted Dunning,
2011-04-11, 17:03
|
|
|
|
