Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> suggestion


Do you have an example?

2012/6/28 Yang <[EMAIL PROTECTED]>

> thanks
>
>
> it was simply "blahblah field does not existing in schema for my_var :
> {......} "
>
>
> On Thu, Jun 28, 2012 at 8:24 PM, Jonathan Coveney <[EMAIL PROTECTED]
> >wrote:
>
> > Pig SHOULD parse the whole script, AFAIK. There are certain errors that
> > will only surface at runtime, but in general, parsing errors should be
> > surfacing early. Do you happen to have an example?
> >
> > 2012/6/28 Yang <[EMAIL PROTECTED]>
> >
> > > let's say my pig script generates 2 MR jobs.
> > >
> > > it seems that currently pig parser won't try to parse the second part
> > until
> > > it finishes running the first MR.
> > >
> > > by that time 1 hour may have passed and now pig says:
> > >
> > > blahblah does not exists in the schema of myvar_name : { x:int ,
> > > y:chararray.......}
> > >
> > > so a lot of time is wasted, particularly in debugging.
> > >
> > > is there a mode like pig -c
> > > (like perl -c ) to check syntax errors?
> > >
> > > Thanks
> > > Yang
> > >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB