Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - hprof profiler output location


Copy link to this message
-
hprof profiler output location
YouPeng Yang 2013-06-16, 10:03
Hi All

  I want to  profile a fraction of the tasks in a job,so I configured my
job as [1].
  However I could not get the hprof  profiler  output on the host on which
I submitted my job.(I use MRv2  with YARN --CDH4.1.2---)
  Where can I find the hprof  profiler  output?

[1]
job.setProfileEnabled(true);
job.setProfileParams(
"-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
"thread=y,verbose=n,file=%s");
job.setProfileTaskRange(true, "0-2");
job.setProfileTaskRange(false,"");

or

job.getConfiguration().setBoolean("mapreduce.task.profile", true);
job.getConfiguration().set("mapreduce.task.profile.params",
"-agentlib:hprof=cpu=samples," +
"heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
job.getConfiguration().set("mapreduce.task.profile.reduces", "");
Regards

Thanks.