We have been able to resolve the "multi-gigabyte file" issue with the
patch here: https://issues.apache.org/jira/browse/FLUME-1654 Although,
this seems more like a temporary solution and we still see the
exceptions in the logs (when flush is called on the BucketWriter).

Thanks Again,

Abraham Fine | Software Engineer
BrightRoll, Inc. | Smart Video Advertising |www.brightroll.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB