Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> JsonLoader fails the pig job in case of malformed json input


+
Demeter Sztanko 2013-08-08, 11:58
Copy link to this message
-
Re: JsonLoader fails the pig job in case of malformed json input
Definitely, please provide a patch.

Alan.

On Aug 8, 2013, at 4:58 AM, Demeter Sztanko wrote:

> Hi all,
>
> Suppose I have a text file that contains only one line:
> {"a", bad}
>
> This is obviously not a valid json.
>
> This input fails the this simple script:
> b = load 'bad.input' using JsonLoader('a0: chararray');
> dump b;
>
>
> Same script works fine for this line:
> {"a": "good"}
>
> I was expecting that it will just skip the line and go further.
>
> I could not find any bug report for this. Is anyone working on that?
> In case if not, would you mind if I submit a patch for it?
> A simple handling of exception seems to solve the problem.
>
> Thanks,
>
> Dimi.