Hi I have a file in format
{(1,123,score) ,(1,124,score)}
{(2,356,score),(2,678,score)}
etc

I  am guessing the person who was working on this forgot to flatten this in
last step?
How do I read and flatten this ?

You may run something like:

a = load 'bag.dat' as (b1: bag {t1: tuple(id: int, points: int, type:
chararray)}, b2: bag {t: tuple(id: int, points: int, type:
chararray)});
dump a;

2012/10/23 jamal sasha <[EMAIL PROTECTED]>:
> Hi I have a file in format
> {(1,123,score) ,(1,124,score)}
> {(2,356,score),(2,678,score)}
> etc
>
> I  am guessing the person who was working on this forgot to flatten this in
> last step?
> How do I read and flatten this ?

What I rather wanted to write is

a = load 'group.txt' as (b1: bag {t1: tuple(id: int, points: int,
type: chararray)});
dump a;

because what you simply want to read is a bag with three-field tuple.

Best,
Adam

2012/10/23 Adam Kawa <[EMAIL PROTECTED]>:
> You may run something like:
>
> a = load 'bag.dat' as (b1: bag {t1: tuple(id: int, points: int, type:
> chararray)}, b2: bag {t: tuple(id: int, points: int, type:
> chararray)});
> dump a;
>
> 2012/10/23 jamal sasha <[EMAIL PROTECTED]>:
>> Hi I have a file in format
>> {(1,123,score) ,(1,124,score)}
>> {(2,356,score),(2,678,score)}
>> etc
>>
>> I  am guessing the person who was working on this forgot to flatten this in
>> last step?
>> How do I read and flatten this ?

This is a pig datatype issue. It took me a while to get used to the pig
types. See http://pig.apache.org/docs/r0.10.0/basic.html#Schemas

The relation below consists of two tuples of three values each: two
integers and a bytearray. You could read this as follows:

x = load 'file' as (t1:tuple(v1:int, v2:int, s), t2:tuple(v1:int, v2:int,
s));

Once read, you can flatten as necessary.

y = foreach x generate FLATTEN(t1), FLATTEN(t2);

--Dan

On Tue, Oct 23, 2012 at 8:24 AM, jamal sasha <[EMAIL PROTECTED]> wrote:

> Hi I have a file in format
> {(1,123,score) ,(1,124,score)}
> {(2,356,score),(2,678,score)}
> etc
>
> I  am guessing the person who was working on this forgot to flatten this in
> last step?
> How do I read and flatten this ?
>