Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Channel Exception


Copy link to this message
-
Channel Exception
Hello,
I am trying to send the events to the Avro Source through external RPC
client..
While sending the events, the following error is thrown

org.apache.flume.ChannelException: Space for commit to queue couldn't be
acquired Sinks are likely not keeping up with sources, or the buffer size
is too tight
 at
org.apache.flume.channel.MemoryChannel$MemoryTransaction.doCommit(MemoryChannel.java:85)
        at
org.apache.flume.channel.BasicTransactionSemantics.commit(BasicTransactionSemantics.java:151)
        at
org.apache.flume.channel.ChannelProcessor.processEvent(ChannelProcessor.java:252)
        at org.apache.flume.source.AvroSource.append(AvroSource.java:203)
        at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.avro.ipc.specific.SpecificResponder.respond(SpecificResponder.java:88)
        at org.apache.avro.ipc.Responder.respond(Responder.java:149)
        at
org.apache.avro.ipc.NettyServer$NettyServerAvroHandler.messageReceived(NettyServer.java:158)
        at
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:80)
        at
org.apache.avro.ipc.NettyServer$NettyServerAvroHandler.handleUpstream(NettyServer.java:143)

I have also changed the heap size to 1024m

And my host file is as follows:

host1.sources = avroSource
host1.channels = memoryChannel
host1.sinks = esper
#avroSource configuration
host1.sources.avroSource.type = avro
host1.sources.avroSource.bind = localhost
host1.sources.avroSource.port = 41414
host1.sources.avroSource.channels = memoryChannel
#Channels
host1.channels.memoryChannel.type = memory

#Sinks
host1.sinks.esper.type = com.gsshop.bigdata.poc.flume.EsperSink
host1.sinks.esper.channel = memoryChannel

What could be the reason for this error?

Regards,
SOm
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB