Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - suggestion


Copy link to this message
-
Re: suggestion
Ruslan Al-Fakikh 2012-06-29, 12:02
Hey Yang,

For debugging you may want the local mode, try
pig -x local

Also there are some useful commands like, DESCRIBE, ILLUSTRATE

Ruslan

On Fri, Jun 29, 2012 at 7:38 AM, Jonathan Coveney <[EMAIL PROTECTED]> wrote:
> Do you have an example?
>
> 2012/6/28 Yang <[EMAIL PROTECTED]>
>
>> thanks
>>
>>
>> it was simply "blahblah field does not existing in schema for my_var :
>> {......} "
>>
>>
>> On Thu, Jun 28, 2012 at 8:24 PM, Jonathan Coveney <[EMAIL PROTECTED]
>> >wrote:
>>
>> > Pig SHOULD parse the whole script, AFAIK. There are certain errors that
>> > will only surface at runtime, but in general, parsing errors should be
>> > surfacing early. Do you happen to have an example?
>> >
>> > 2012/6/28 Yang <[EMAIL PROTECTED]>
>> >
>> > > let's say my pig script generates 2 MR jobs.
>> > >
>> > > it seems that currently pig parser won't try to parse the second part
>> > until
>> > > it finishes running the first MR.
>> > >
>> > > by that time 1 hour may have passed and now pig says:
>> > >
>> > > blahblah does not exists in the schema of myvar_name : { x:int ,
>> > > y:chararray.......}
>> > >
>> > > so a lot of time is wasted, particularly in debugging.
>> > >
>> > > is there a mode like pig -c
>> > > (like perl -c ) to check syntax errors?
>> > >
>> > > Thanks
>> > > Yang
>> > >
>> >
>>

--
Best Regards,
Ruslan Al-Fakikh