Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # dev - Status of JSON load/store funcs


+
Jonathan Packer 2013-06-20, 22:04
Copy link to this message
-
Re: Status of JSON load/store funcs
Cheolsoo Park 2013-06-23, 02:49
You can upload a new patch to PIG-2641. I agree that we should improve the
built-in JsonLoader rather than adding a new one to piggybank. You might
want to ask Russell whether it is okay for you to take over his jira. I can
review/commit your patch whenever it's ready.
On Thu, Jun 20, 2013 at 3:04 PM, Jonathan Packer <[EMAIL PROTECTED]>wrote:

> Hi, a few months ago I had submitted a patch to update JsonLoader to handle
> arbitrary input json without an accompanying schema file (the were options
> to specify a schema string with intelligent handling of missing/extra
> fields, or to load everything as a map).
>
> Patch is the most recent one at
> https://issues.apache.org/jira/browse/PIG-1914
>
> That was against Piggybank. @rjurney said he wanted to merge it with some
> stuff he did, and switch it to be against the builtins. I see some
> JSON-related work at https://issues.apache.org/jira/browse/PIG-2641 and an
> unresolved bug https://issues.apache.org/jira/browse/PIG-2949 (which my
> JsonLoader would fix), but it looks like the JsonLoader in trunk still
> hasn't been updated in trunk.
>
> So what's the status on this? I think its important to have a robust loader
> for such a common format, and I'd be happy to provide a new patch against
> the builtin JsonLoader.
>