Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> How to use HPROF for rhadoop jobs ?


Copy link to this message
-
How to use HPROF for rhadoop jobs ?
Hi All

I can use HPROF in java map reduce jobs.
Configuration conf = getConf();

conf.setBoolean("mapred.task.profile", true);

conf.set("mapred.task.profile.params", "-agentlib:hprof=cpu=samples," +

"heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");

conf.set("mapred.task.profile.maps", "0-2");

conf.set("mapred.task.profile.reduces", ""); // no reduces

Job  job = new Job(conf, "Max temperature");

Can some one provide an example code which shows how HPROF is used in
rhadoop jobs.
Thanks

Rohit Sarewar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB