| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
26 (0.132s).
|
|
|
Loading phrases to help you
refine your search...
|
|
RE: YARN in 2.0 and 0.23 - MapReduce - [mail # user]
|
|
...We don't necessarily have the freedom to choose; we are an application provider and we desire compatibility for as many versions as possible so as to fit into existing Hadoop installations. ...
|
|
|
Author: John Lilley,
2013-05-23, 00:51
|
|
|
RE: Shuffle phase - MapReduce - [mail # user]
|
|
...I was reading the elephant book trying to understand which process actually serves up the HTTP transfer on the mapper side. Is it the each map task? Or is there some persistent t...
|
|
|
Author: John Lilley,
2013-05-22, 14:58
|
|
|
RE: Shuffle phase replication factor - MapReduce - [mail # user]
|
|
...Ummmm, is that also the limit for the number of simultaneous connections? In general, one does not need a 1:1 map between threads and connections. If this is the connection limit, does...
|
|
|
Author: John Lilley,
2013-05-22, 14:57
|
|
|
RE: Shuffle phase replication factor - MapReduce - [mail # user]
|
|
...This brings up another nagging question I've had for some time. Between HDFS and shuffle, there seems to be the potential for "every node connecting to every other node" via TCP. ...
|
|
|
Author: John Lilley,
2013-05-22, 14:46
|
|
|
YARN in 2.0 and 0.23 - MapReduce - [mail # user]
|
|
...We intend to use the YARN APIs fairly soon. Are there notable differences in YARNs classes, interfaces or semantics between 0.23 and 2.0? It seems to be supported on both version...
|
|
|
Author: John Lilley,
2013-05-22, 14:38
|
|
|
RE: MapReduce shuffle algorithm - MapReduce - [mail # user]
|
|
...Thanks! I will read the elephant book more thoroughly. john From: Bertrand Dechoux [mailto:[EMAIL PROTECTED]] Sent: Tuesday, May 21, 2013 1:22 PM To: [EMAIL PROTECTED] Subject: R...
|
|
|
Author: John Lilley,
2013-05-22, 14:34
|
|
|
RE: Shuffle phase replication factor - MapReduce - [mail # user]
|
|
...Oh I see. Does this mean there is another service and TCP listen port for this purpose? Thanks for your indulgence... I would really like to read more about this without bothering the ...
|
|
|
Author: John Lilley,
2013-05-22, 14:33
|
|
|
Shuffle phase replication factor - MapReduce - [mail # user]
|
|
...When MapReduce enters "shuffle" to partition the tuples, I am assuming that it writes intermediate data to HDFS. What replication factor is used for those temporary files? john ...
|
|
|
Author: John Lilley,
2013-05-21, 18:57
|
|
|
HDFS append overhead - MapReduce - [mail # user]
|
|
...I am trying to determine if it is feasible for multiple nodes to alternate appends to a shared file in HDFS. Can someone tell me, what is the overhead of an open/append/close cycle? If multi...
|
|
|
Author: John Lilley,
2013-05-21, 18:52
|
|
|
MapReduce shuffle algorithm - MapReduce - [mail # user]
|
|
...I am very interested in a deep understanding of the MapReduce "Shuffle" phase algorithm and implementation. Are there whitepapers I could read for an explanation? Or another mail...
|
|
|
Author: John Lilley,
2013-05-21, 16:58
|
|
|
|
