Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - how to address "nested structure" in PIG?


Copy link to this message
-
Re: how to address "nested structure" in PIG?
yonghu 2013-10-01, 09:26
I think you can do like this:

c = filter b by seqNum == 1 ;

regards!

Yong
On Tue, Oct 1, 2013 at 2:59 AM, Yang <[EMAIL PROTECTED]> wrote:

> I have a dataset written in Avro format,
> I read it using
>
> b = load 'myfile' using AvroStorage();
>
> describe b;
>
> it shows the following schema:  it seems that at the root level, there are
> only 2 fields: key and value, the value for "value" field is actually a
>  record too.
>
>
> b: {key: (guid: chararray,sessionSkey: long),value: (guid:
> chararray,sessionSkey: long,seqNum: int,sessionStartDt: long)}
>
>
> my question is, how can I address the seqNum field under "value", so that I
> could so filtering like this:
>
> c = filter b by value.seqNum == 1 ;
>
> ?
>
> thanks
> Yang
>