Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - newbie just not getting structure

Copy link to this message
newbie just not getting structure
Lauren Blau 2012-08-15, 11:44
I'm having problems with understanding storage structures. Here's what I

on the cluster I loaded some data and created a relation with one row.
I output the row using store relation into '/file' using PigStorage('|');
then I copied it my local workspace, copyToLocal /file ./file
then I tarred up the local file and scp'd it to my laptop.

on my laptop I untarred the file into data/file
then I ran these pig commands:

b = load 'data/file' using PigStorage('|') as (a:map[]); --because I'm
expecting a map
dump b;

return is successful but result is ().

then I ran
c = foreach b generate *;
dump c;

return is successful but result is ().

then I tried

d = load 'data/file' using PigStorage('|');
dump d;

is ([id#ID1,documentDate#1344461328851,source#93931,indexed#false,lastModifiedDate#1344461328851,contexts#{([id#CID1])}])

since that is a map, I'm not sure why dump b didn't return values. so then
I tried
e = foreach d generate $0#'id';
dump e;

and the return was ();

Does anyone see where I'm missing the point? And how do I grab those map