Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Stripping Key


Copy link to this message
-
Re: Stripping Key
Mohit Anchlia 2012-03-09, 03:52
I have something like:

ABC    1,2,3,4

I think it's the tab delimited.with ABC being the key and 1,2,3,4 as values.

I need to ignore ABC and then load with PigStorage(',') to parse comma
separated into separate fields. Is there an easy way to do this?

On Thu, Mar 8, 2012 at 6:20 PM, Prashant Kommireddi <[EMAIL PROTECTED]>wrote:

> How are you loading it in Pig? Can you just ignore the first field (key)
> with positional reference? What is the key-value delimiter used in your MR
> job.
>
> On Thu, Mar 8, 2012 at 2:56 PM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > I am trying to process the output which has key in it from the map-reduce
> > job. Is there a way I can ignore the key when I load data from that file?
> > When I load data in the variable I don't want the key in that alias.
> >
>