Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Avro, mail # user - Avro and Hadoop streaming


+
Miki Tebeka 2011-06-02, 21:30
+
Doug Cutting 2011-06-03, 08:43
Copy link to this message
-
Re: Avro and Hadoop streaming
Tatu Saloranta 2011-06-03, 16:18
On Fri, Jun 3, 2011 at 1:43 AM, Doug Cutting <[EMAIL PROTECTED]> wrote:
> Miki,
>
> Have you looked at AvroAsTextInputFormat?
>
> http://avro.apache.org/docs/current/api/java/org/apache/avro/mapred/AvroAsTextInputFormat.html
>
> Also, release 1.5.2 will include AvroTextOutputFormat:
>
> https://issues.apache.org/jira/browse/AVRO-830
>
> Are these perhaps what you're looking for?

Also, if anyone is interested in getting Jackson POJO data binding
work seamlessly, there are tentative plans for introducing various
non-JSON reader/generator backends ("read/write X as if it was JSON");
Avro is one of prime candidates, possibly second most likely to be
written after CSV.
There are already backends for reading XML, Bson and Smile (binary
JSON) and expose it via Jackson's reader/generator to get full data
binding support; and obviously trivial transcoding (json<->xml for
example) capabilities between any two supported formats.

So if this is something of interest, feel free to come by jackson dev
mailing list to talk about it bit more.

-+ Tatu +-
+
Miki Tebeka 2011-06-15, 00:01
+
Harsh J 2011-06-15, 10:33
+
Miki Tebeka 2011-06-15, 16:26
+
Matt Pouttu-Clarke 2011-06-15, 16:30
+
Scott Carey 2011-06-15, 16:53
+
Miki Tebeka 2011-06-15, 17:36
+
Mona Gandhi 2011-07-12, 00:36
+
Miki Tebeka 2011-10-03, 23:21