Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - production pig systems


Copy link to this message
-
production pig systems
Corbin Hoenes 2010-04-01, 02:55
Hello,

I'm looking for some feedback on how real world pig jobs are run in production, how are they managed and scheduled etc...?  We are currently using bash scripts and cron to fire jobs off and we wondering what real world experiences have revealed about how to build a robust system that uses scheduled jobs with dependencies on each other etc...

Thanks for any info,

Cheers!