Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: MAP PHASE,SHUFFLE SORT PHASE AND COPY PHASE , REDUCE PHASE


Copy link to this message
-
Re: MAP PHASE,SHUFFLE SORT PHASE AND COPY PHASE , REDUCE PHASE
Is this view what you want?

http://www.cs.duke.edu/starfish/screenshots/job-analysis-profile-graphs.png

Jie

On Fri, Sep 21, 2012 at 3:50 PM, Thiago Vieira <[EMAIL PROTECTED]> wrote:
> you can use Apache Rumen(
> http://hadoop.apache.org/docs/mapreduce/r0.22.0/rumen.html) for all this
> informations.
>
> --
> Thiago Vieira
>
>
> On Tue, Aug 28, 2012 at 4:40 PM, abhiTowson cal
> <[EMAIL PROTECTED]>wrote:
>
>> hi all,
>>
>> After completion of the job.
>>
>> How can we individually calculate total time spent on map
>> phase,shuffle sort phase,copy phase and reduce phase.
>>
>> So that it helps in tuning your job performance.
>>
>> Regards
>> Abhi
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB