Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Tracking parts of a job taking the most time


Copy link to this message
-
Tracking parts of a job taking the most time
All,

I have a 400 line pig script which perfoems the calculations I need it to perform, however I need to figure out the amount of time that specific parts of the script take.

For example, initial load from a Hbase table - id like to know how much time the load takes before moving onto the next step.

Whats the easiest way to break this down?
thanks,
JM
+
Johnny Zhang 2013-06-05, 06:15
+
Ruslan Al-Fakikh 2013-06-05, 08:03
+
John Meek 2013-06-05, 10:29
+
Ruslan Al-Fakikh 2013-06-06, 10:57
+
Pradeep Gollakota 2013-06-06, 11:22
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB