| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
32 (0.076s).
|
|
|
Loading phrases to help you
refine your search...
|
|
RE: Hadoop internals consultant wanted - MapReduce - [mail # dev]
|
|
...Sorry, will do. Can you recommend one for Hadoop consulting? John From: Stephen Boesch [mailto:[EMAIL PROTECTED]] Sent: Friday, May 24, 2013 1:52 PM To: [EMAIL PROTECTED] ...
|
|
|
Author: John Lilley,
2013-05-24, 19:54
|
|
|
RE: splittable vs seekable compressed formats - MapReduce - [mail # user]
|
|
...More specifically, seeking to a known location in the uncompressed data. So not just seeking to “the nearest record boundary”, but seeking to “position 100000000 in the uncompressed da...
|
|
|
Author: John Lilley,
2013-05-24, 19:50
|
|
|
Hadoop internals consultant wanted - MapReduce - [mail # dev]
|
|
...We are developing a YARN ApplicationMaster-based Hadoop application, and need a consultant experienced in Hadoop internals development and YARN specifically to help us bootstrap. Speci...
|
|
|
Author: John Lilley,
2013-05-24, 19:27
|
|
|
HTTP file server, map output, and other files - MapReduce - [mail # user]
|
|
...Thanks to previous kind answers and more reading in the elephant book, I now understand that mapper tasks place partitioned results into local files that are served up to reducers via HTTP: ...
|
|
|
Author: John Lilley,
2013-05-23, 21:44
|
|
|
SequenceFile sync marker uniqueness - MapReduce - [mail # user]
|
|
...How does SequenceFile guarantee that the sync marker does not appear in the data? John ...
|
|
|
Author: John Lilley,
2013-05-23, 18:04
|
|
|
RE: HDFS data and non-aligned splits - MapReduce - [mail # user]
|
|
...Related to this, I see in the elephant book under "Which compression format should I use": "Use a container file format such as Sequence File..." Does Sequence File attempt to align compress...
|
|
|
Author: John Lilley,
2013-05-23, 17:59
|
|
|
HDFS data and non-aligned splits - MapReduce - [mail # user]
|
|
...What happens when MR produces data splits, and those splits don't align on block boundaries? I've read that MR will attempt to make data splits near block boundaries to improve data lo...
|
|
|
Author: John Lilley,
2013-05-23, 17:53
|
|
|
splittable vs seekable compressed formats - MapReduce - [mail # user]
|
|
...I've read about splittable compressed formats in Hadoop. Are any of these formats also "seekable" (in other words, be able to seek to an absolute location in the uncompressed data). Jo...
|
|
|
Author: John Lilley,
2013-05-23, 17:31
|
|
|
RE: YARN in 2.0 and 0.23 - MapReduce - [mail # user]
|
|
...We don't necessarily have the freedom to choose; we are an application provider and we desire compatibility for as many versions as possible so as to fit into existing Hadoop installations. ...
|
|
|
Author: John Lilley,
2013-05-23, 00:51
|
|
|
RE: Shuffle phase - MapReduce - [mail # user]
|
|
...I was reading the elephant book trying to understand which process actually serves up the HTTP transfer on the mapper side. Is it the each map task? Or is there some persistent t...
|
|
|
Author: John Lilley,
2013-05-22, 14:58
|
|
|
|
