Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Validating tuple length


Copy link to this message
-
Re: Validating tuple length
FILTER SIZE(tuple) == 14 won't work for your use case?

On Thu, Aug 30, 2012 at 3:39 PM, Sam William <[EMAIL PROTECTED]> wrote:
> HI,
>   I was wondering if it is possible validate records by checking the tuple length.   I expect every record to have 14 fields, but some records might be corrupt. I want to filter those out  .  I tried checking ($13 is null),  but this includes records which has a null value in the 14th field. Is there a cleaner way to validate the tuple length ?
>
>
> Sam William
> [EMAIL PROTECTED]
>
>
>