Search Hadoop and all its sub project:

Switch to Threaded View
Subject: Re: Schema exclusion from Avro message
I'm planning to stream it via Kafka.

I think I've sorted it out. The Object Container Files is not an
essential part of the Avro. Instead of using
DataFileReader/DataFileWriter, I can use DatumReader/DatumWriter to
encode and decode the binary data and store the schema separately.

Wai Yip
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB