Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> Is it possible to append to an already existing avro file


Copy link to this message
-
Is it possible to append to an already existing avro file
Hi,

is it possible to append to an already existing avro file when it was written and closed before?

If I use
outputStream = fs.append(avroFilePath);

then later on I get: java.io.IOException: Invalid sync!

Probably because the schema is written twice and some other issues.

If I use outputStream = fs.create(avroFilePath); then the avro file gets overwritten.

Thanks,
Vyacheslav
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB