Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> ignoring null entries


+
jamal sasha 2013-03-29, 20:01
Copy link to this message
-
Re: ignoring null entries
Hi Jamal,
         you can use filter by not null .
 A = LOAD 'data_1' USING PigStorage(',') as (id1:chararray,value1:chararray);
 B = FILTER A by id1 is not null;  
 dump B;

--
Harsha
On Friday, March 29, 2013 at 1:01 PM, jamal sasha wrote:

> Hi,
> I have data as :
> id1:string, value1:string
> Sometimes id is missing so the data looks like:
> foo,foobar
> ,foo1
> foobar,bar1
> ,
> ....
> I want to remove missing values
> So the output should be
> foo,foobar
> foobar,bar1
>
> How can I achieve this in pig (without using udf??)

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB