Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Splitting by unique values in a relation


Copy link to this message
-
Re: Splitting by unique values in a relation
I thought about SPLIT too and as well about a nested FILTER within a
FOREACH but the OP can have any number of distinct ids on which he wants to
split (thus getting the same number of splits/relations.) Won't SPLIT
always give you 2 relations.

Regards,
Shahab
On Sun, Sep 15, 2013 at 7:36 PM, Ruslan Al-Fakikh <[EMAIL PROTECTED]>wrote:

> Hi!
>
> Have you tried the SPLIT operator?
> http://pig.apache.org/docs/r0.11.1/basic.html#SPLIT
> After splitting the relation into two separate relations you can STORE them
> into different locations.
>
> Best Regards,
> Ruslan Al-Fakikh
> https://www.odesk.com/users/~015b7b5f617eb89923
>
>
> On Sun, Sep 15, 2013 at 11:03 PM, praveenesh kumar <[EMAIL PROTECTED]
> >wrote:
>
> > Hi,
> >
> > I have a relation A with (customer_id, data).
> > I want to get the unique customer_ids, and spilt them into new
> > files/relations. What is the most efficient way to do that.
> >
> > I can get the distinct customer_ids in a relation. But not able to
> > understand how can can I use it in splitting the data by customer_id.
> >
> > Regards
> > Praveenesh
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB