Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Flatten a bag to a specific datatype

Jonathan Holloway 2011-06-22, 16:28
Copy link to this message
Re: Flatten a bag to a specific datatype

I think UDF BagToTuple should do it for you.
>From some old email thread, I find (I think you will have to change
getBagField to get etc)--

public class BagToTuple extends EvalFunc<Tuple>{
     public void exec(Tuple input, Tuple output) throws IOException{
         DataBag bag = input.getBagField(0);
         Iterator<Tuple> iter = bag.content();
         while (iter.hasNext()){


On Wed, Jun 22, 2011 at 9:28 AM, Jonathan Holloway <

> I'm having trouble trying to flatten a bag to a tuple of int's in Pig,
> e.g.
> {(12),(4),(7),(190)}
> to:
> (12,4,7,190)
> It seems like it should be trivial to do, but not quite sure how to do it.
>  Can this by done with inbuilt Pig
> commands or do i need a custom UDF or an exec?
> Many thanks,
> Jon.

"...:::Aniket:::... Quetzalco@tl"