| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
75 (0.109s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Question related to Number of Mapper - MapReduce - [mail # user]
|
|
...0 Custer didn't run. He got surrounded and then massacred. :-P (See Custer's last stand at Little Big Horn) Ok... plain text files 100 files 2 blocks each would by default attem...
|
|
|
Author: Michael Segel,
2012-11-07, 16:31
|
|
|
Re: One mapper/reducer runs on a single JVM - MapReduce - [mail # user]
|
|
...If you exceed the amount of physical memory available, memory pages will be written to disk in a temp space. The act of 'swapping' the memory pages from memory to disk and back again is know...
|
|
|
Author: Michael Segel,
2012-11-06, 16:27
|
|
|
Re: One mapper/reducer runs on a single JVM - MapReduce - [mail # user]
|
|
...Mappers and Reducers are separate JVM processes. And yes you need to take in to account the amount of memory the machine(s) when you configure the number of slots. If you are running ...
|
|
|
Author: Michael Segel,
2012-11-06, 04:46
|
|
|
Re: backup of hdfs data - MapReduce - [mail # user]
|
|
...You have other options. You could create a secondary cluster. You could also look in to Cleversafe and what they are doing with Hadoop. Here's the sad thing about backing up to...
|
|
|
Author: Michael Segel,
2012-11-06, 04:44
|
|
|
Re: Map Reduce slot - MapReduce - [mail # user]
|
|
..."However in production clustes the jvm size is marked final to prevent abuses that may lead to OOMs." Not necessarily. On Nov 1, 2012, at 6:43 AM, Bejoy Ks wro...
|
|
|
Author: Michael Segel,
2012-11-01, 12:44
|
|
|
Re: Insight on why distcp becomes slower when adding nodemanager - MapReduce - [mail # user]
|
|
...Not sure. Lots of things can effect your throughput. Networking is my first guess. Which is why I asked about the number of times you've run the same test to see if there i...
|
|
|
Author: Michael Segel,
2012-10-31, 19:23
|
|
|
Re: Insight on why distcp becomes slower when adding nodemanager - MapReduce - [mail # user]
|
|
...how many times did you test it? need to rule out aberrations. On Oct 29, 2012, at 11:30 AM, Harsh J wrote: think is yarn-nodemanager (a restart already hadoop-mapredu...
|
|
|
Author: Michael Segel,
2012-10-29, 19:04
|
|
|
Re: How do map tasks get assigned efficiently? - MapReduce - [mail # user]
|
|
...So... Data locality only works when you actually have data on the cluster itself. Otherwise how can the data be local. Assuming 3X replication, and you're not doing a cus...
|
|
|
Author: Michael Segel,
2012-10-24, 11:51
|
|
|
Re: Old vs New API - MapReduce - [mail # user]
|
|
...They were official, back around 2009, hence the first API was deprecated. The reason that they removed the deprecation was that the 'new' API didn't have all of the featur...
|
|
|
Author: Michael Segel,
2012-10-24, 11:46
|
|
|
Re: Java heap space error - MapReduce - [mail # user]
|
|
...Try upping the child to 1.5GB or more. On Oct 21, 2012, at 8:18 AM, Subash D'Souza wrote: last week the cluster was running until there was an error in the name node ...
|
|
|
Author: Michael Segel,
2012-10-21, 16:33
|
|
|
|
