Josh Spiegel 2013-07-10, 14:37
Doug Cutting 2013-07-10, 16:05
-Re: Is DataFileWriter#append(datum) reentrant?
Josh Spiegel 2013-07-10, 16:28
Sorry I missed that and thanks for the reply.
On Wed, Jul 10, 2013 at 9:05 AM, Doug Cutting <[EMAIL PROTECTED]> wrote:
> The documentation for AppendWriteException says, "When this is thrown,
> the file is unaltered and may continue to be appended to." So, yes,
> after you have caught this exception you may safely continue to append
> entries to the still-open file.
> On Wed, Jul 10, 2013 at 7:37 AM, Josh Spiegel <[EMAIL PROTECTED]> wrote:
> > Hi,
> > I am using AvroKeyRecordWriter, which wraps
> DataFileWriter#append(datum), to
> > create Avro. As I write data, sometimes an error will occur due to an
> > encoding problem (e.g. a non-nullable field isn't set in a record). I
> > like to be able to log the AppendWriteException and continue writing the
> > remaining records. Is this supported? In other words, is
> > AvroKeyRecordWriter#write() guaranteed to be reentrant with respect to
> > AppendWriteException?
> > If not, is there a way to validate a datum against the schema before
> > writing?
> > Thanks,
> > Josh