Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Re: hprof profiler output location


Copy link to this message
-
Re: hprof profiler output location
Rahul Bhattacharjee 2013-06-18, 12:27
In the same directory from which the job has been triggered.

Thanks,
Rahul
On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <[EMAIL PROTECTED]>wrote:

>
> Hi All
>
>   I want to  profile a fraction of the tasks in a job,so I configured my
> job as [1].
>   However I could not get the hprof  profiler  output on the host on which
> I submitted my job.(I use MRv2  with YARN --CDH4.1.2---)
>
>
>   Where can I find the hprof  profiler  output?
>
> [1]
> job.setProfileEnabled(true);
>  job.setProfileParams(
> "-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
> "thread=y,verbose=n,file=%s");
>  job.setProfileTaskRange(true, "0-2");
> job.setProfileTaskRange(false,"");
>
>  or
>
> job.getConfiguration().setBoolean("mapreduce.task.profile", true);
> job.getConfiguration().set("mapreduce.task.profile.params",
> "-agentlib:hprof=cpu=samples," +
>  "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
>  job.getConfiguration().set("mapreduce.task.profile.reduces", "");
>
>
> Regards
>
> Thanks.
>
+
yypvsxf19870706 2013-06-18, 15:01