Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Errors

Basically the channel is filling up. Have you increased the capacity
of the channel?

On Thu, Oct 11, 2012 at 1:08 PM, Cochran, David M (Contractor)
> This error insists on making an appearance at least daily on my test
> systems.
> Unable to put batch on required channel:
> org.apache.flume.channel.MemoryChannel@555c07d8
> Caused by: org.apache.flume.ChannelException: Space for commit to queue
> couldn't be acquired Sinks are likely not keeping up with sources, or the
> buffer size is too tight
> Changing the batch-size and batchSize around from default to 100's or a 1000
> doesn't seem to help
> increased the JAVA_OPTS="-Xms256m -Xmx512m"  still no change
> This shows up very intermittently, but daily, the logs being tailed are not
> very big, and are not growing very quickly, actually very slow in the grand
> scheme of things.
> Am I missing something to help balance things out here?
> Thanks
> Dave

Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/