Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro, mail # user - Has anyone developed a utility to tell what is missing from a record?


Copy link to this message
-
Re: Has anyone developed a utility to tell what is missing from a record?
Jonathan Coveney 2013-04-04, 16:02
I'm also running into issues where the Python and Java implementations are
different (it seems like Java is less permissive than Python). Are these
cases bugs? It can be frustrating for something to work in one but not the
other.

Having the info from the parallel recursion would allow us to have much
better error messages. That would be great...
2013/4/4 Jeremy Kahn <[EMAIL PROTECTED]>

> I think this would be tremendously useful.
>
> I am working - in my copious spare time - on improving schema validation
> in the Python library, and I think I can see how to improve things there by
> extending the data/schema parallel recursion to keep track of position in
> each.
>
> Jeremy
> On Apr 4, 2013 6:58 AM, "Jonathan Coveney" <[EMAIL PROTECTED]> wrote:
>
>> I'm working on migrating an internally developed serialization format to
>> Avro. In the process, there have been many cases where I made a mistake
>> migrating the schema (I've automated it), and then avro cries that a record
>> I'm trying to serialize doesn't match the schema. Generally, the error it
>> gives doesn't help find the actual issue, and for a big enough record
>> finding the issue can be tedious.
>>
>> I've thought about making a tool which, given the schema and the record
>> would tell you what the issue is, but I'm wondering if this already exists?
>> I suppose the error message could also include this information...
>>
>> Thanks
>> Jon
>>
>