Pig, mail # user - Re: Managing Large Pig Scripts - 2014-03-05, 15:56
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Plain View
Christopher Petrino 2014-03-05, 15:33
Dan DeCapria, CivicScienc... 2014-03-05, 15:55
Copy link to this message
Re: Managing Large Pig Scripts

You might consider breaking it into one or more reusable macros. What version of pig are you using?

For complicated scripts, especially if you didn't write them, you might want to take a look at lipstick, https://github.com/Netflix/Lipstick
It allows you to visualize the dag and clearly shows what logical operators map to map-reduce jobs. It could be a starting point for managing complexity at least.

On Mar 5, 2014, at 7:33 AM, Christopher Petrino <[EMAIL PROTECTED]> wrote:

Christopher Petrino 2014-03-05, 18:02
Russell Jurney 2014-03-05, 18:12
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB