| clear query|facets|time |
Search criteria: .
Results from 81 to 90 from
1036 (0.35s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Dissecting MR output article - MapReduce - [mail # user]
|
|
...+1 for Hadoop: The Definitive Guide and other books. Sidenote: The 3rd Edition of Tom White's Hadoop: The Definitive Guide does have good details on MRv2 and YARN. On Sat, Mar 23...
|
|
|
Author: Harsh J,
2013-03-23, 05:58
|
|
|
Re: Cluster lost IP addresses - MapReduce - [mail # user]
|
|
...Hi Chris, Where exactly are you seeing issues with change of NN/DN IPs? I've never encountered trouble on IP changes (I keep moving across networks everyday and the HDFS plus MR I run ...
|
|
|
Author: Harsh J,
2013-03-23, 05:42
|
|
|
Re: how to control (or understand) the memory usage in hdfs - MapReduce - [mail # user]
|
|
...I run a 128 MB heap size DN for my simple purposes on my Mac and it runs well for what load I apply on it. A DN's primary, growing memory consumption comes from the # of blocks it carr...
|
|
|
Author: Harsh J,
2013-03-23, 05:14
|
|
|
Re: Cluster lost IP addresses - MapReduce - [mail # user]
|
|
...NameNode does not persist block locations; so this is still recoverable if the configs are changed to use the new set of hostnames to bind to/look up. On Sat, Mar 23, 2013 at 9:01 AM, ...
|
|
|
Author: Harsh J,
2013-03-23, 05:12
|
|
|
Re: Setup/Cleanup question - MapReduce - [mail # user]
|
|
...Assuming you speak of MRv1 (1.x/0.20.x versions), there is just 1 Job Setup and 1 Job Cleanup tasks additionally run for each Job. On Sat, Mar 23, 2013 at 9:10 AM, Sai Sai wrote:...
|
|
|
Author: Harsh J,
2013-03-23, 05:05
|
|
|
Re: Capacity Scheduler question - MapReduce - [mail # user]
|
|
...If you're looking to set a fixed # of maps per job and also control their parallel distributed execution (by numbers), a Scheduler cannot solve that for you but may assist in the process. &n...
|
|
|
Author: Harsh J,
2013-03-23, 01:35
|
|
|
Re: In the constructor of JobInProgress, why is it safe to call FileSyste.closeAllForUGI(). - MapReduce - [mail # dev]
|
|
...The current user (UserGroupInformation.getCurrentUser()) is the user active in the RPC call thats invoking these functions, and not the JT user exactly. However, given that the JIP con...
|
|
|
Author: Harsh J,
2013-03-22, 11:30
|
|
|
Re: Need your help with Hadoop - MapReduce - [mail # user]
|
|
...Hi, The settings property is "dfs.data.dir" (or "dfs.datanode.data.dir") and its present in the hdfs-site.xml file at each DataNode, under $HADOOP_HOME/conf/ directories usually. Look ...
|
|
|
Author: Harsh J,
2013-03-20, 04:00
|
|
|
Re: Why In-memory Mapoutput is necessary in ReduceCopier - MapReduce - [mail # dev]
|
|
...MR2 does not use HTTP (via Jetty) anymore for map output transfers and has moved over to using Netty. If you're focussing on development or improvement work on Apache Hadoop, I'd suggest rea...
|
|
|
Author: Harsh J,
2013-03-18, 05:40
|
|
|
Re: High level API's - MapReduce - [mail # user]
|
|
...There are quite a few non-Java front-ends to Hadoop APIs in popular languages already written by many involved in this community. I'm unable to find a listing of all these implementations (s...
|
|
|
Author: Harsh J,
2013-03-18, 01:56
|
|
|
|
