Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Parsing a Complex JSON String?


Copy link to this message
-
Re: Parsing a Complex JSON String?
Hi Eli,  
     Take a look at these  
https://github.com/mozilla-metrics/akela/tree/master/src/main/java/com/mozilla/pig/eval/json. We use it to parse a complex json objects.

Thanks,
Harsha
On Thursday, February 28, 2013 at 10:44 AM, Eli Finkelshteyn wrote:

>  
> Hi Folks,
>  
>  
> I want to parse a string of complex JSON in Pig. Specifically, I want Pig to understand my JSON array as a bag instead of as a single chararray. When using JsonLoader, I can do this easily by specifying the schema, as in this question (http://stackoverflow.com/questions/14094768/parsing-complex-json-with-pig). Is there any way to either have Pig figure out my schema for me, or to specify it when Pig is parsing a string? I've been using JsonStringToMap, but can't find a way to specify Schema, or to have it properly understand my JSON array is an array and not a single char array. I looked at the code in JsonStringToMap, and it looks like it always specifies the schema for me as just a map of chararrays, which won't work for anything but the simplest JSON of a form like {string: string…}. Any ideas?
>  
> Eli
>  
>  
>  
>  
> Attachments:  
> - smime.p7s
>