| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
10 (0.26s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: The minimum memory requirements to datanode and namenode? - HDFS - [mail # user]
|
|
...can you tell specs of node3. Even on a test/demo cluster, anything below 4 GB ram makes the node almost inaccessible as per my experience. On Sun, May 12, 2013 at 8:25 PM, sam l...
|
|
|
Author: Rishi Yadav,
2013-05-13, 04:50
|
|
|
Re: The minimum memory requirements to datanode and namenode? - HDFS - [mail # user]
|
|
...do you get any error when trying to connect to cluster, something like 'tried n times' or replicated 0 times. On Sun, May 12, 2013 at 7:28 PM, sam liu wrote: ...
|
|
|
Author: Rishi Yadav,
2013-05-13, 03:02
|
|
|
Re: M/R job to a cluster? - HDFS - [mail # user]
|
|
...check core-site.xml and see value of fs.default.name. if it has localhost you are running locally. On Fri, Apr 26, 2013 at 1:59 PM, wrote: ...
|
|
|
Author: Rishi Yadav,
2013-04-26, 21:06
|
|
|
Re: M/R Staticstics - HDFS - [mail # user]
|
|
...do you see "retired jobs" on job tracker page. There is also "job tracker history" on the bottom of page. something like this http://nn.zettabyte.com:50030/jobtracker.jsp Thanks ...
|
|
|
Author: Rishi Yadav,
2013-04-26, 15:37
|
|
|
Re: Errors about MRunit - HDFS - [mail # user]
|
|
...your problem is simple, you are mixing mapred (old api) and mapreduce(new api) libraries. MRUnit has implementation for both apis. Here's an example of WordCountTest with use of new ap...
|
|
|
Author: Rishi Yadav,
2013-04-20, 16:19
|
|
|
Re: Writing intermediate key,value pairs to file and read it again - HDFS - [mail # user]
|
|
...writing a map only job will do the trick for you. On Sat, Apr 20, 2013 at 8:43 AM, Vikas Jadhav wrote: ...
|
|
|
Author: Rishi Yadav,
2013-04-20, 16:03
|
|
|
Re: good way to debug map reduce code - HDFS - [mail # user]
|
|
...pseudo-distributed mode is the only way you can test your code as far as I know. This means that you are running a single node cluster. Are you using eclipse? Thanks and Regards,  ...
|
|
|
Author: Rishi Yadav,
2012-12-26, 06:48
|
|
|
Re: Map Shuffle Bytes - HDFS - [mail # user]
|
|
...Shuffled bytes go to reducers not mappers and the inbuilt counter for that is "Reduce Shuffle Bytes". I am not sure how you can implement user defined java counter here because this ph...
|
|
|
Author: Rishi Yadav,
2012-12-26, 06:30
|
|
|
Re: reducer tasks start time issue - HDFS - [mail # user]
|
|
...Hi Lin, Reduce task starts as soon as output is ready from Mappers. The reduce method does not get called until all Mappers are done. If that's not the case, all operations which are n...
|
|
|
Author: Rishi Yadav,
2012-12-22, 16:09
|
|
|
Re: Test failures on a released version - HDFS - [mail # user]
|
|
...Hi Mark, Your issue seems to be related to this jira item https://issues.apache.org/jira/browse/HDFS-3902 This issue has been fixed on 9/12 (courtesy Andy Isaacson). I woul...
|
|
|
Author: Rishi Yadav,
2012-12-21, 23:12
|
|
|
|