Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> problem filtering null values with pig

Copy link to this message
problem filtering null values with pig
hey people
I'm having some troubles with a silly task, I can´t find a way to filter
null values from my rows. This is the result when I dump the object geoinfo:

DUMP geoinfo;

and here is the description

DESCRIBE geoinfo;
geoinfo: {geoLocation: bytearray}

What I'm trying to do is to filter null values like this:

geoinfo_no_nulls = FILTER geoinfo BY geoLocation is not null;

but the result remains the same. nothing is filtered.

I also tried something like this

geoinfo_no_nulls = FILTER geoinfo BY geoLocation != 'null';

 and I got an error

org.apache.pig.backend.executionengine.ExecException: ERROR 1071: Cannot
convert a map to a String

What am I doing wrong here?

env details,

Ubuntu 12.04.1 LTS,
pig 0.9.3 version 0.9.3-SNAPSHOT (rexported) compiled Oct 24 2012, 19:04:03
java version "1.6.0_24" OpenJDK Runtime Environment (IcedTea6 1.11.4)
OpenJDK 64-Bit Server VM (build 20.0-b12, mixed mode)
Cheolsoo Park 2012-10-31, 21:25
Arian Pasquali 2012-10-31, 21:50
Arian Pasquali 2012-10-31, 21:54
Cheolsoo Park 2012-10-31, 23:03
Arian Pasquali 2012-11-01, 19:47
Arian Pasquali 2012-11-17, 05:01