Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> Schema exclusion from Avro message


Copy link to this message
-
Re: Schema exclusion from Avro message
I'm planning to stream it via Kafka.

I think I've sorted it out. The Object Container Files is not an
essential part of the Avro. Instead of using
DataFileReader/DataFileWriter, I can use DatumReader/DatumWriter to
encode and decode the binary data and store the schema separately.

Wai Yip
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB