Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Profiling the Mapper using hprof on Hadoop 0.20.205


Copy link to this message
-
RE: Profiling the Mapper using hprof on Hadoop 0.20.205
Yaron Gonen 2013-02-07, 04:47
I tried various range values.
I'm not even seeing the map method and the recordreader methods.
On Feb 7, 2013 3:58 AM, "java8964 java8964" <[EMAIL PROTECTED]> wrote:

>  What range you gave it for mapred.task.profile.maps? And you sure your
> mapper will invoke the methods you expect in the traces?
>
> Yong
>
> ------------------------------
> Date: Wed, 6 Feb 2013 23:50:08 +0200
> Subject: Profiling the Mapper using hprof on Hadoop 0.20.205
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
> Hi,
> I wish to profile my mapper, so I've set the properties
> mapred.task.profile and mapred.task.profile.maps in mapred-site.xml.
> At the end of the job I'm getting a profile.out file, however I think
> it's not the profile of the mapper... none of the methods I use in the
> mapper appear on any of the traces. Am I doing something wrong?
> I'm using a small cluster with 4 machines.
>
> Thanks,
> Yaron
>