Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - suggestion


Copy link to this message
-
Re: suggestion
Jonathan Coveney 2012-06-29, 03:38
Do you have an example?

2012/6/28 Yang <[EMAIL PROTECTED]>

> thanks
>
>
> it was simply "blahblah field does not existing in schema for my_var :
> {......} "
>
>
> On Thu, Jun 28, 2012 at 8:24 PM, Jonathan Coveney <[EMAIL PROTECTED]
> >wrote:
>
> > Pig SHOULD parse the whole script, AFAIK. There are certain errors that
> > will only surface at runtime, but in general, parsing errors should be
> > surfacing early. Do you happen to have an example?
> >
> > 2012/6/28 Yang <[EMAIL PROTECTED]>
> >
> > > let's say my pig script generates 2 MR jobs.
> > >
> > > it seems that currently pig parser won't try to parse the second part
> > until
> > > it finishes running the first MR.
> > >
> > > by that time 1 hour may have passed and now pig says:
> > >
> > > blahblah does not exists in the schema of myvar_name : { x:int ,
> > > y:chararray.......}
> > >
> > > so a lot of time is wasted, particularly in debugging.
> > >
> > > is there a mode like pig -c
> > > (like perl -c ) to check syntax errors?
> > >
> > > Thanks
> > > Yang
> > >
> >
>