| clear query|facets|time |
Search criteria: .
Results from 81 to 90 from
1038 (0.088s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: how to control (or understand) the memory usage in hdfs - MapReduce - [mail # user]
|
|
...I'm guessing your OutOfMemory then is due to "Unable to create native thread" message? Do you mind sharing your error logs with us? Cause if its that, then its a ulimit/system limits issue a...
|
|
|
Author: Harsh J,
2013-03-23, 10:35
|
|
|
Re: For a new installation: use the BackupNode or the CheckPointNode? - MapReduce - [mail # user]
|
|
...Neither CheckpointNode nor BackupNode exists in version 1.x. This was a documentation oversight that should be cleared in the docs now (or by next release I think). And on 2.x, neither...
|
|
|
Author: Harsh J,
2013-03-23, 10:33
|
|
|
Re: Dissecting MR output article - MapReduce - [mail # user]
|
|
...+1 for Hadoop: The Definitive Guide and other books. Sidenote: The 3rd Edition of Tom White's Hadoop: The Definitive Guide does have good details on MRv2 and YARN. On Sat, Mar 23...
|
|
|
Author: Harsh J,
2013-03-23, 05:58
|
|
|
Re: Cluster lost IP addresses - MapReduce - [mail # user]
|
|
...Hi Chris, Where exactly are you seeing issues with change of NN/DN IPs? I've never encountered trouble on IP changes (I keep moving across networks everyday and the HDFS plus MR I run ...
|
|
|
Author: Harsh J,
2013-03-23, 05:42
|
|
|
Re: how to control (or understand) the memory usage in hdfs - MapReduce - [mail # user]
|
|
...I run a 128 MB heap size DN for my simple purposes on my Mac and it runs well for what load I apply on it. A DN's primary, growing memory consumption comes from the # of blocks it carr...
|
|
|
Author: Harsh J,
2013-03-23, 05:14
|
|
|
Re: Cluster lost IP addresses - MapReduce - [mail # user]
|
|
...NameNode does not persist block locations; so this is still recoverable if the configs are changed to use the new set of hostnames to bind to/look up. On Sat, Mar 23, 2013 at 9:01 AM, ...
|
|
|
Author: Harsh J,
2013-03-23, 05:12
|
|
|
Re: Setup/Cleanup question - MapReduce - [mail # user]
|
|
...Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job Setup and 1 Job Cleanup tasks additionally run for each Job. On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai wrote:...
|
|
|
Author: Harsh J,
2013-03-23, 05:05
|
|
|
Re: Capacity Scheduler question - MapReduce - [mail # user]
|
|
...If you're looking to set a fixed # of maps per job and also control their parallel distributed execution (by numbers), a Scheduler cannot solve that for you but may assist in the process. &n...
|
|
|
Author: Harsh J,
2013-03-23, 01:35
|
|
|
Re: In the constructor of JobInProgress, why is it safe to call FileSyste.closeAllForUGI(). - MapReduce - [mail # dev]
|
|
...The current user (UserGroupInformation.getCurrentUser()) is the user active in the RPC call thats invoking these functions, and not the JT user exactly. However, given that the JIP con...
|
|
|
Author: Harsh J,
2013-03-22, 11:30
|
|
|
Re: Need your help with Hadoop - MapReduce - [mail # user]
|
|
...Hi, The settings property is "dfs.data.dir" (or "dfs.datanode.data.dir") and its present in the hdfs-site.xml file at each DataNode, under $HADOOP_HOME/conf/ directories usually. Look ...
|
|
|
Author: Harsh J,
2013-03-20, 04:00
|
|
|
|
