Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro >> mail # dev >> Python-Avro Codegen Proposal


+
Tal Levy 2013-06-03, 05:28
Copy link to this message
-
Re: Python-Avro Codegen Proposal
Hi Tal,

I'm interested in using Avro + Python. That would sound useful, any chance
I could have a play with what you've done?

Cheers,

Stefan
On Sun, Jun 2, 2013 at 10:28 PM, Tal Levy <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I recently started using Avro at my work and we found it difficult to keep
> track of what python dict matched to what schema. Instead of having
> random dicts being populated and then attempted to be serialized to avro, I
> thought
> it would be more readable and less error prone to codegen the python dict
> for developers. These classes are type checked field by field. Although it
> does not
> have the advantage of compiled type checking like in the java codegen, it
> is a
> friendly wrapper around python dicts representing avro records to be
> serialized.
>
> let me know what you think about this, I am still tweaking how it behaves.
> I understand it is a bit unpythonic to enforce types in this way, but the
> readability
> is worth it nonetheless.
>
> here is an example record:
> https://gist.github.com/talevy/5696236
>
> I extended the avro compiler/tools to provide both java and python codegen
> functionality.
> so if this sounds like something others would use, maybe it makes sense to
> include it
> into the main repo.
>
>
> Thanks,
> Tal
>
+
Philip Zeyliger 2013-06-04, 18:24
+
Tal Levy 2013-06-04, 20:54
+
Philip Zeyliger 2013-06-05, 00:16
+
Tal Levy 2013-06-05, 00:58