Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> generate multiple output files?

Copy link to this message
Re: generate multiple output files?
Try MultiStorage:
On Wed, Jan 9, 2013 at 2:37 PM, Yang <[EMAIL PROTECTED]> wrote:

> let's say I have an input dataset, each row has 2 fields, the first field
> is a value among 100 possible values. I want to just split the input
> dataset into 100 outputs , based on the  value of the first field.
> is there a way to do that in pig? I see MultipleOutputs Format in Java API,
> but have not found anything similar in PIG
> Thanks!
> Yang