Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - how to get input schema in UDF


Copy link to this message
-
Re: how to get input schema in UDF
Robert Yerex 2012-08-13, 23:14
Chapter 10 in Alan Gates' excellent book "Programmin Pig" discusses this
issue.

Robert Yerex
Data Scientist
Civitas Leaning

On Mon, Aug 13, 2012 at 3:43 PM, Danfeng Li <[EMAIL PROTECTED]> wrote:

> I have a big, e.g. A: {(name: chararray,age: int)}, I wrote a udf which
> adds 1 more field in the tuple inside the bag. E.g. B: {(name:
> chararray,age: int, rank:int)}. Because the number of fields in the
> original bag is not fixed, e.g I can have one more field such as gender:int.
>
> In my udf, in order to generate the correct output schema, I need to get
> the input schema first. I tried to find some examples but couldn't, could
> someone show me how to do it?
>
> Thanks.
> Dan
>
>
--
Robert Yerex
Data Scientist
Civitas Learning
www.civitaslearning.com