Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> visibility into component job ID?


Copy link to this message
-
visibility into component job ID?
Is there an index or job ID available at the Pig level for each of the child
MR jobs that a single script can spawn?  It'd be great, for example, if I
could write:

SET job.name rolluptask-pig.job.index

Where pig.job.index is either an index value (1st child job, 2nd child job,
etc.) or the actual job ID.

Norbert
+
Dmitriy Ryaboy 2011-09-28, 21:04
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB