Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> JsonLoader fails the pig job in case of malformed json input


+
Demeter Sztanko 2013-08-08, 11:58
Copy link to this message
-
Re: JsonLoader fails the pig job in case of malformed json input
Definitely, please provide a patch.

Alan.

On Aug 8, 2013, at 4:58 AM, Demeter Sztanko wrote:

> Hi all,
>
> Suppose I have a text file that contains only one line:
> {"a", bad}
>
> This is obviously not a valid json.
>
> This input fails the this simple script:
> b = load 'bad.input' using JsonLoader('a0: chararray');
> dump b;
>
>
> Same script works fine for this line:
> {"a": "good"}
>
> I was expecting that it will just skip the line and go further.
>
> I could not find any bug report for this. Is anyone working on that?
> In case if not, would you mind if I submit a patch for it?
> A simple handling of exception seems to solve the problem.
>
> Thanks,
>
> Dimi.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB