Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Delimiters for nested structures


Copy link to this message
-
Re: Delimiters for nested structures
AFAIK, hive uses default delimiters nested data structures. There is no
workaround for this for now.
for (int i = 3; i < serdeParams.separators.length; i++) {

      serdeParams.separators[i] = (byte) (i + 1);

    }

Thanks,

Aniket

On Wed, Feb 8, 2012 at 10:15 PM, Hao Cheng <[EMAIL PROTECTED]> wrote:

> Hi,
>
> My data have some map of map structures with customized delimiters.
> As per Hive documents, by default, '\001' is the field separator; starting
> from '\002', every 2 consecutive characters are the delimiters of 1 level.
> My data do not follow this rule in term of delimiters. I mostly just need
> to handle map of map. I do not find a way in create table statement to
> redefine delimiters for more than 1 level nested structures. I try not to
> transform the data as it was produced by some other upstream process.
> Any ideas on how to do that in Hive? Thank you for your helps!
>
> Regards,
> Hao
>

--
"...:::Aniket:::... Quetzalco@tl"
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB