Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> ignoring null entries


Copy link to this message
-
Re: ignoring null entries
Hi Jamal,
         you can use filter by not null .
 A = LOAD 'data_1' USING PigStorage(',') as (id1:chararray,value1:chararray);
 B = FILTER A by id1 is not null;  
 dump B;

--
Harsha
On Friday, March 29, 2013 at 1:01 PM, jamal sasha wrote:

> Hi,
> I have data as :
> id1:string, value1:string
> Sometimes id is missing so the data looks like:
> foo,foobar
> ,foo1
> foobar,bar1
> ,
> ....
> I want to remove missing values
> So the output should be
> foo,foobar
> foobar,bar1
>
> How can I achieve this in pig (without using udf??)