Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Store output in multiple directories


Copy link to this message
-
Re: Store output in multiple directories
You can use SPLIT to output to multiple places based on some logical
partitioning scheme of your data:
http://pig.apache.org/docs/r0.9.2/basic.html#SPLIT

On Tue, Mar 27, 2012 at 2:20 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

> Is there anyway I can tell pig to send output into multiple directories? If
> I have 10 files can send 5 files to dir1 and remaining 5 to dir2?
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB