Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Validating tuple length


Copy link to this message
-
Re: Validating tuple length
FILTER SIZE(tuple) == 14 won't work for your use case?

On Thu, Aug 30, 2012 at 3:39 PM, Sam William <[EMAIL PROTECTED]> wrote:
> HI,
>   I was wondering if it is possible validate records by checking the tuple length.   I expect every record to have 14 fields, but some records might be corrupt. I want to filter those out  .  I tried checking ($13 is null),  but this includes records which has a null value in the 14th field. Is there a cleaner way to validate the tuple length ?
>
>
> Sam William
> [EMAIL PROTECTED]
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB