Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Stripping Key


Copy link to this message
-
Re: Stripping Key
I have something like:

ABC    1,2,3,4

I think it's the tab delimited.with ABC being the key and 1,2,3,4 as values.

I need to ignore ABC and then load with PigStorage(',') to parse comma
separated into separate fields. Is there an easy way to do this?

On Thu, Mar 8, 2012 at 6:20 PM, Prashant Kommireddi <[EMAIL PROTECTED]>wrote:

> How are you loading it in Pig? Can you just ignore the first field (key)
> with positional reference? What is the key-value delimiter used in your MR
> job.
>
> On Thu, Mar 8, 2012 at 2:56 PM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > I am trying to process the output which has key in it from the map-reduce
> > job. Is there a way I can ignore the key when I load data from that file?
> > When I load data in the variable I don't want the key in that alias.
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB