Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - How to use HPROF for rhadoop jobs ?


Copy link to this message
-
How to use HPROF for rhadoop jobs ?
rohit sarewar 2013-03-29, 15:37
Hi All

I can use HPROF in java map reduce jobs.
Configuration conf = getConf();

conf.setBoolean("mapred.task.profile", true);

conf.set("mapred.task.profile.params", "-agentlib:hprof=cpu=samples," +

"heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");

conf.set("mapred.task.profile.maps", "0-2");

conf.set("mapred.task.profile.reduces", ""); // no reduces

Job  job = new Job(conf, "Max temperature");

Can some one provide an example code which shows how HPROF is used in
rhadoop jobs.
Thanks

Rohit Sarewar