| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
75 (3.131s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Question about Name Spaces… - MapReduce - [mail # user]
|
|
...Harsh, IMHO, I don't see the need of doing any sort of links over name spaces or containers. If you want to have data that spans containers, you copy the data to the container, ...
|
|
|
Author: Michael Segel,
2013-05-16, 12:47
|
|
|
Hardlinkes (See HDFS-3370) wuz Re: Question about Name Spaces… - MapReduce - [mail # user]
|
|
...Ok, that's what I thought. So here's my real question... I'm looking at HDFS-3370 (see: https://issues.apache.org/jira/browse/HDFS-3370 ) There is some talk about one of th...
|
|
|
Author: Michael Segel,
2013-05-15, 16:57
|
|
|
Re: Question about Name Spaces… - MapReduce - [mail # user]
|
|
...Well... On the one hand, I'm trying to understand why one would break a cluster in to multiple name spaces. (Obviously this gets back to managing very large clusters.) On...
|
|
|
Author: Michael Segel,
2013-05-15, 14:38
|
|
|
Question about Name Spaces… - MapReduce - [mail # user]
|
|
...Quick question... So when we have a cluster which has multiple namespaces (multiple name nodes) , why would you have a file in two different namespaces? ...
|
|
|
Author: Michael Segel,
2013-05-15, 14:17
|
|
|
Re: Benefits of Hadoop Distributed Cache - MapReduce - [mail # user]
|
|
...Not sure what you mean... If you want to put up a small file to be used by each Task in your job (mapper or reducer)... you could put it up on HDFS. Or if you're launching your ...
|
|
|
Author: Michael Segel,
2013-05-07, 22:48
|
|
|
Re: Hardware Selection for Hadoop - MapReduce - [mail # user]
|
|
...I wouldn't. You end up with a 'Frankencluster' which could become problematic down the road. Ever try to debug a port failure on a switch? (It does happen and its a bitch.) &nbs...
|
|
|
Author: Michael Segel,
2013-05-07, 12:53
|
|
|
Re: Hardware Selection for Hadoop - MapReduce - [mail # user]
|
|
...I wouldn't go the route of multiple nics unless you are using MapR. MapR allows you to do port bonding or rather use both ports simultaneously. When you port bond. 1+1 != 2...
|
|
|
Author: Michael Segel,
2013-05-07, 12:45
|
|
|
Re: OutOfMemory during Plain Java MapReduce - MapReduce - [mail # user]
|
|
..."A potential problem could be, that a reduce is going to write files >600MB and our mapred.child.java.opts is set to ~380MB." Isn't the minimum heap normally 512MB? Why not j...
|
|
|
Author: Michael Segel,
2013-03-08, 14:39
|
|
|
Re: Is there a way to keep all intermediate files there after the MapReduce Job run? - MapReduce - [mail # user]
|
|
...Your job.xml file is kept for a set period of time. I believe the others are automatically removed. You can easily access the job.xml file from the JT webpage. On Mar 1, 2...
|
|
|
Author: Michael Segel,
2013-03-01, 13:23
|
|
|
Re: How does hadoop decide how many reducers to run? - MapReduce - [mail # user]
|
|
...Since you are using EMR, AWS pre configures the number of slots per node. So you are already getting the optimum number of slots that their 'machines' can handle. So when ...
|
|
|
Author: Michael Segel,
2013-01-12, 14:05
|
|
|
|
