Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Issue with Extracting Fields from text to csv file


Copy link to this message
-
Re: Issue with Extracting Fields from text to csv file
You can write your own custom store function and return an extension of
MultipleOutputFormat in your storage function.

How to write a custom storage function
http://pig.apache.org/docs/r0.8.1/udf.html#Store+Functions

How to use MultipleOutputFormat
http://hadoop.apache.org/docs/r2.2.0/api/org/apache/hadoop/mapred/lib/MultipleOutputFormat.html

Also checkout this custom storage function in piggybank
http://svn.apache.org/viewvc/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/MultiStorage.java?view=markup
On Mon, Apr 7, 2014 at 4:10 PM, Bharat Bagai <[EMAIL PROTECTED]>wrote:

Regards,
Abhishek Agarwal

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB