Pig, mail # user - Is there a size limit on tuple or a field in tuple?

Is there a size limit on tuple or a field in tuple?

Dexin Wang 2013-02-07, 00:39

I'm writing a UDF of my own that would produce tuples, each tuple has a
string field that could be real large. I did a quick test and the current
size of the field is 146,447 characters and it doesn't seem to have any
problem. But my result could be larger than that.

Is there any size beyond which something would break?

Thanks.

Re: Is there a size limit on tuple or a field in tuple?

Jonathan Coveney 2013-02-07, 15:46

A tuple must fit in memory. That is the only bound.
2013/2/6 Dexin Wang <[EMAIL PROTECTED]>

> I'm writing a UDF of my own that would produce tuples, each tuple has a
> string field that could be real large. I did a quick test and the current
> size of the field is 146,447 characters and it doesn't seem to have any
> problem. But my result could be larger than that.
>
> Is there any size beyond which something would break?
>
> Thanks.
>