Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Job web interface


+
Benjamin Juhn 2012-04-06, 04:39
Copy link to this message
-
Re: Job web interface
Ben -- every non-local Pig run is converted into one or more Hadoop jobs,
so you can always use the jobtracker interface at http://namenode:50030 to
review job status and progress.  The CLI interface to this is via the
command "hadoop job", eg. "hadoop job -list".  Sometimes it's tricky to
match up Pig runs to Hadoop jobs (one-to-many), the "SET job.name"
directive helps a bit.

If you're looking for something higher-level, you might take a look at
LinkedIn's Azkaban, which provides primarily scheduling but also job
dependency visualization.

On Fri, Apr 6, 2012 at 12:39 AM, Benjamin Juhn <[EMAIL PROTECTED]> wrote:

> Does a job web interface exist somewhere out there?  Something to run
> jobs, pickup results, and maybe a cli?
>
> Thanks,
> Ben
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB