Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> suggestion


Copy link to this message
-
Re: suggestion
perfect, thanks

On Fri, Jun 29, 2012 at 10:11 AM, Jie Li <[EMAIL PROTECTED]> wrote:

> Pig does have a "-c" to check the syntax:
>
> pig -x local -c -f x.pig
>
> Jie
>
> On Fri, Jun 29, 2012 at 5:02 AM, Ruslan Al-Fakikh
> <[EMAIL PROTECTED]> wrote:
> > Hey Yang,
> >
> > For debugging you may want the local mode, try
> > pig -x local
> >
> > Also there are some useful commands like, DESCRIBE, ILLUSTRATE
> >
> > Ruslan
> >
> > On Fri, Jun 29, 2012 at 7:38 AM, Jonathan Coveney <[EMAIL PROTECTED]>
> wrote:
> >> Do you have an example?
> >>
> >> 2012/6/28 Yang <[EMAIL PROTECTED]>
> >>
> >>> thanks
> >>>
> >>>
> >>> it was simply "blahblah field does not existing in schema for my_var :
> >>> {......} "
> >>>
> >>>
> >>> On Thu, Jun 28, 2012 at 8:24 PM, Jonathan Coveney <[EMAIL PROTECTED]
> >>> >wrote:
> >>>
> >>> > Pig SHOULD parse the whole script, AFAIK. There are certain errors
> that
> >>> > will only surface at runtime, but in general, parsing errors should
> be
> >>> > surfacing early. Do you happen to have an example?
> >>> >
> >>> > 2012/6/28 Yang <[EMAIL PROTECTED]>
> >>> >
> >>> > > let's say my pig script generates 2 MR jobs.
> >>> > >
> >>> > > it seems that currently pig parser won't try to parse the second
> part
> >>> > until
> >>> > > it finishes running the first MR.
> >>> > >
> >>> > > by that time 1 hour may have passed and now pig says:
> >>> > >
> >>> > > blahblah does not exists in the schema of myvar_name : { x:int ,
> >>> > > y:chararray.......}
> >>> > >
> >>> > > so a lot of time is wasted, particularly in debugging.
> >>> > >
> >>> > > is there a mode like pig -c
> >>> > > (like perl -c ) to check syntax errors?
> >>> > >
> >>> > > Thanks
> >>> > > Yang
> >>> > >
> >>> >
> >>>
> >
> >
> >
> > --
> > Best Regards,
> > Ruslan Al-Fakikh
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB