Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro >> mail # user >> 0 KB files getting created

Copy link to this message
Re: 0 KB files getting created
> Avro files i am creating have around 3 Million records in them, but i
> have seen situation where while writing my disk space fills up
> completely, i this case i don't get any errors from the library, and it
> continues without actually writing anything and either reporting, thus i
> am losing data in that file, and subsequent file are created of 0KB.

Oof, just checked the code and it looks like this is a bug — the file
writer code isn't returning an error condition if the underlying fwrite
call returns an error.  Can you open an JIRA issue for this?


Douglas Creager
RedJack, LLC