Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> hprof profiler output location


Copy link to this message
-
hprof profiler output location
Hi All

  I want to  profile a fraction of the tasks in a job,so I configured my
job as [1].
  However I could not get the hprof  profiler  output on the host on which
I submitted my job.(I use MRv2  with YARN --CDH4.1.2---)
  Where can I find the hprof  profiler  output?

[1]
job.setProfileEnabled(true);
job.setProfileParams(
"-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
"thread=y,verbose=n,file=%s");
job.setProfileTaskRange(true, "0-2");
job.setProfileTaskRange(false,"");

or

job.getConfiguration().setBoolean("mapreduce.task.profile", true);
job.getConfiguration().set("mapreduce.task.profile.params",
"-agentlib:hprof=cpu=samples," +
"heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
job.getConfiguration().set("mapreduce.task.profile.reduces", "");
Regards

Thanks.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB