Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> suggestion


Copy link to this message
-
suggestion
let's say my pig script generates 2 MR jobs.

it seems that currently pig parser won't try to parse the second part until
it finishes running the first MR.

by that time 1 hour may have passed and now pig says:

blahblah does not exists in the schema of myvar_name : { x:int ,
y:chararray.......}

so a lot of time is wasted, particularly in debugging.

is there a mode like pig -c
(like perl -c ) to check syntax errors?

Thanks
Yang
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB