Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Parsing a Complex JSON String?


Copy link to this message
-
Re: Parsing a Complex JSON String?
The JsonLoader works, but problem is I'm not loading a JSON file, but just trying to parse a json string as part of a bigger data set. That's why I needed to use JsonStringToMap.

On Feb 28, 2013, at 1:34 PM, Dmitriy Ryaboy wrote:

> Does the EB json loader with
>
> elephantbird.jsonloader.nestedLoad = true
>
> Work?
>
>
>
> On Thu, Feb 28, 2013 at 10:44 AM, Eli Finkelshteyn <[EMAIL PROTECTED]>
> wrote:
>>
>> Hi Folks,
>>
>> I want to parse a string of complex JSON in Pig. Specifically, I want Pig
> to understand my JSON array as a bag instead of as a single chararray. When
> using JsonLoader, I can do this easily by specifying the schema, as in this
> question. Is there any way to either have Pig figure out my schema for me,
> or to specify it when Pig is parsing a string? I've been using
> JsonStringToMap, but can't find a way to specify Schema, or to have it
> properly understand my JSON array is an array and not a single char array.
> I looked at the code in JsonStringToMap, and it looks like it always
> specifies the schema for me as just a map of chararrays, which won't work
> for anything but the simplest JSON of a form like {string: string…}. Any
> ideas?
>>
>> Eli