Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> PigStorage problem for nested structures?


Copy link to this message
-
Re: PigStorage problem for nested structures?
The answer here is to use a more powerful storage format, which is a good
habit to get into with complicated structures.

2012/6/28 Yang <[EMAIL PROTECTED]>

> if I have a field that contains ",", and I add it to a tuple,
>
> then  then tuple becomes part of a row  in a relation.
>
> I STORE the relation using PigStorage.
> so each row is a nested tuple.
>
> then the "," in the content can not be distinguished from the separator
> used by pigStorage.
>
> what is the easiest way out of this?
> (preprocessing to escape "," ? another more powerful storage format? )
>
> thanks
> Yang
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB