Home
|
About
|
Sematext
search-lucene.com
search-hadoop.com
Search
clear
query
|
facets
|
time
Search criteria:
. Results from
1
to
5
from
5
(3.297s).
Loading phrases to help you
refine your search...
Re: Shuffling over the network for local map data.
-
MapReduce
- [mail # dev]
...Hi Al, As Luke mentioned the change I made is very useful for small clusters with lots of cores. I'm working on very ideal case ie 1 machine cluster with 48 cores So I really do not kn...
Author:
Suresh Kumar
, 2013-01-22, 23:03
Re: Shuffling over the network for local map data.
-
MapReduce
- [mail # dev]
...Hi Luke, I checked the /etc/hosts and it is configured correctly. Looks like the slow shuffle read speeds we were getting are due to slow disk IO. I will go through the change MA...
Author:
Suresh Kumar
, 2013-01-22, 22:22
Re: Shuffling over the network for local map data.
-
MapReduce
- [mail # dev]
...I have a patch that tries to use file links instead of making a copy of the data that is already available locally. I tested it on the a single machine cluster configuration running 48 mappe...
Author:
Suresh Kumar
, 2013-01-22, 19:02
Re: Shuffling over the network for local map data.
-
MapReduce
- [mail # dev]
...Hi Steve, My assumption is that unless it is reading from http://127.0.0.1/ or http://localhost/ , it reads over the network. If I'm wrong please correct me. The http tracker add...
Author:
Suresh Kumar
, 2013-01-22, 17:36
Shuffling over the network for local map data.
-
MapReduce
- [mail # dev]
...Hello, I noticed that the shuffle phase is reading data over http even when data is available locally. The version of hadoop I'm using is 1.0.3. Is there a reason it is implemented thi...
Author:
Suresh Kumar
, 2013-01-22, 03:22
1
Sort:
time-biased relevance
relevancy
newest on top
oldest on top
project
MapReduce (5)
type
mail # dev (5)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (5)
last 9 months (5)
author
Harsh J (1038)
Arun C Murthy (500)
Vinod Kumar Vavilapalli (351)
Todd Lipcon (282)
Amar Kamat (184)
Thomas Graves (175)
Mohammad Tariq (174)
Owen O'Malley (162)
Hemanth Yamijala (155)
Amareshwari Sriramadasu (153)
Pedro Costa (153)
Ted Yu (148)
Robert Evans (147)
Tom White (138)
Aaron Kimball (131)
Suresh Kumar
All projects made searchable here are trademarks of the Apache Software Foundation. Service operated by
Sematext