-Re: Is it possible to append to an already existing avro file
Vyacheslav Zholudev 2012-02-21, 15:29
Yep, I saw that method as well as the stackoverflow post. However, I'm interested how to append to a file on the arbitrary file system, not only on the local one.
I want to get an OutputStream based on the Path and the FileSystem implementation and then pass it for appending to avro methods.
Is that possible?
On Feb 21, 2012, at 5:29 AM, Harsh J wrote:
> Use the appendTo feature of the DataFileWriter. See
> For a quick setup example, read also:
> On Tue, Feb 21, 2012 at 3:15 AM, Vyacheslav Zholudev
> <[EMAIL PROTECTED]> wrote:
>> is it possible to append to an already existing avro file when it was
>> written and closed before?
>> If I use
>> outputStream = fs.append(avroFilePath);
>> then later on I get: java.io.IOException: Invalid sync!
>> Probably because the schema is written twice and some other issues.
>> If I use outputStream = fs.create(avroFilePath); then the avro file gets
> Harsh J
> Customer Ops. Engineer
> Cloudera | http://tiny.cloudera.com/about