Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> Avro and Hadoop streaming

Copy link to this message
Re: Avro and Hadoop streaming
On Fri, Jun 3, 2011 at 1:43 AM, Doug Cutting <[EMAIL PROTECTED]> wrote:
> Miki,
> Have you looked at AvroAsTextInputFormat?
> http://avro.apache.org/docs/current/api/java/org/apache/avro/mapred/AvroAsTextInputFormat.html
> Also, release 1.5.2 will include AvroTextOutputFormat:
> https://issues.apache.org/jira/browse/AVRO-830
> Are these perhaps what you're looking for?

Also, if anyone is interested in getting Jackson POJO data binding
work seamlessly, there are tentative plans for introducing various
non-JSON reader/generator backends ("read/write X as if it was JSON");
Avro is one of prime candidates, possibly second most likely to be
written after CSV.
There are already backends for reading XML, Bson and Smile (binary
JSON) and expose it via Jackson's reader/generator to get full data
binding support; and obviously trivial transcoding (json<->xml for
example) capabilities between any two supported formats.

So if this is something of interest, feel free to come by jackson dev
mailing list to talk about it bit more.

-+ Tatu +-