Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> line feeds

Copy link to this message
Re: line feeds
Hi Will,

You're right that PigStorage doesn't handle \n. PigStorage is really a
dummy reference implementation of Load/StoreFunc, so I'd not recommend to
use it in production. In particular, when you have complex data structures
and special characters in data, advanced file formats work far better. Will
the built-in ParquetLoader<http://pig.apache.org/docs/r0.12.0/api/org/apache/pig/builtin/ParquetLoader.html>/Storer
or AvroStorage<http://pig.apache.org/docs/r0.12.0/api/org/apache/pig/builtin/AvroStorage.html>work
for you?

On Wed, Mar 26, 2014 at 10:51 AM, William Oberman