| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
20 (0.277s).
|
|
|
Loading phrases to help you
refine your search...
|
|
MRBench Maps strange behaviour - MapReduce - [mail # user]
|
|
...Hi All, I executed the "MRBench" program from "hadoop-test.jar" in my 12 node CDH3 cluster. After executing, I had some strange observations regarding the number of Maps it ran. ...
|
|
|
Author: Gaurav Dasgupta,
2012-08-28, 10:32
|
|
|
How to reduce total shuffle time - MapReduce - [mail # user]
|
|
...Hi, I have run some large and small jobs and calculated the Total Shuffle Time for the jobs. I can see that the Total Shuffle Time is almost half the Total Time which was taken by the ...
|
|
|
Author: Gaurav Dasgupta,
2012-08-28, 07:16
|
|
|
Suggestions/Info required regarding Hadoop Benchmarking - MapReduce - [mail # user]
|
|
...Hi Users, I have a 12 node CDH3 cluster where I am planning to run some benchmark tests. My main intension is to run the benchmarks first with the default Hadoop configuration and then...
|
|
|
Author: Gaurav Dasgupta,
2012-08-28, 07:01
|
|
|
Re: Info required regarding JobTracker Job Details/Metrics - MapReduce - [mail # user]
|
|
...Hi, Thanks for your replies. Any idea how do I calculate the "total shuffle time"? I can get and calculate the total time taken by all the Mappers and all the Reducers separatey, but t...
|
|
|
Author: Gaurav Dasgupta,
2012-08-23, 12:06
|
|
|
Re: Info required regarding JobTracker Job Details/Metrics - MapReduce - [mail # user]
|
|
...Sorry, the correct outcomes are for the single wordcount job are: 12/08/23 04:31:22 INFO mapred.JobClient: Job complete: job_201208230144_0002 12/08/23 04:31:22 INFO mapred.JobClient: ...
|
|
|
Author: Gaurav Dasgupta,
2012-08-23, 11:24
|
|
|
Info required regarding JobTracker Job Details/Metrics - MapReduce - [mail # user]
|
|
...Hi Users, I have run a wordount job on a Hadoop 0.20 cluster and the JobTracker Web UI gave me the following information after the successful completion of the job: *Job Counters...
|
|
|
Author: Gaurav Dasgupta,
2012-08-23, 10:58
|
|
|
Re: Number of Maps running more than expected - MapReduce - [mail # user]
|
|
...Hi I have got it. It was my mistake understanding the calculation. Thanks for the help. Regards, Gaurav Dasgupta On Fri, Aug 17, 2012 at 5:15 PM, Bejoy Ks wrote: &nbs...
|
|
|
Author: Gaurav Dasgupta,
2012-08-17, 12:52
|
|
|
Re: Number of Maps running more than expected - MapReduce - [mail # user]
|
|
...Hi Bejoy, The total number of Maps in the RandomTextWriter execution were 100 and hence the total number of input files for WordCount are 100. My dfs.block.size = 128MB and I have not ...
|
|
|
Author: Gaurav Dasgupta,
2012-08-17, 11:38
|
|
|
Re: Number of Maps running more than expected - MapReduce - [mail # user]
|
|
...Hi Anil, The speculative execution property is off from the begining. In addition to my previous mail, I would like to add some more points: I have checked the same while generat...
|
|
|
Author: Gaurav Dasgupta,
2012-08-17, 09:14
|
|
|
Number of Maps running more than expected - MapReduce - [mail # user]
|
|
...Hi users, I am working on a CDH3 cluster of 12 nodes (Task Trackers running on all the 12 nodes and 1 node running the Job Tracker). In order to perform a WordCount benchmark test, I d...
|
|
|
Author: Gaurav Dasgupta,
2012-08-16, 14:13
|
|
|
|
