Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> hprof profiler output location


Copy link to this message
-
hprof profiler output location
Hi All

  I want to  profile a fraction of the tasks in a job,so I configured my
job as [1].
  However I could not get the hprof  profiler  output on the host on which
I submitted my job.(I use MRv2  with YARN --CDH4.1.2---)
  Where can I find the hprof  profiler  output?

[1]
job.setProfileEnabled(true);
job.setProfileParams(
"-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
"thread=y,verbose=n,file=%s");
job.setProfileTaskRange(true, "0-2");
job.setProfileTaskRange(false,"");

or

job.getConfiguration().setBoolean("mapreduce.task.profile", true);
job.getConfiguration().set("mapreduce.task.profile.params",
"-agentlib:hprof=cpu=samples," +
"heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
job.getConfiguration().set("mapreduce.task.profile.reduces", "");
Regards

Thanks.