Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Channel Exception


Copy link to this message
-
Channel Exception
Hello,
I am trying to send the events to the Avro Source through external RPC
client..
While sending the events, the following error is thrown

org.apache.flume.ChannelException: Space for commit to queue couldn't be
acquired Sinks are likely not keeping up with sources, or the buffer size
is too tight
 at
org.apache.flume.channel.MemoryChannel$MemoryTransaction.doCommit(MemoryChannel.java:85)
        at
org.apache.flume.channel.BasicTransactionSemantics.commit(BasicTransactionSemantics.java:151)
        at
org.apache.flume.channel.ChannelProcessor.processEvent(ChannelProcessor.java:252)
        at org.apache.flume.source.AvroSource.append(AvroSource.java:203)
        at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.avro.ipc.specific.SpecificResponder.respond(SpecificResponder.java:88)
        at org.apache.avro.ipc.Responder.respond(Responder.java:149)
        at
org.apache.avro.ipc.NettyServer$NettyServerAvroHandler.messageReceived(NettyServer.java:158)
        at
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:80)
        at
org.apache.avro.ipc.NettyServer$NettyServerAvroHandler.handleUpstream(NettyServer.java:143)

I have also changed the heap size to 1024m

And my host file is as follows:

host1.sources = avroSource
host1.channels = memoryChannel
host1.sinks = esper
#avroSource configuration
host1.sources.avroSource.type = avro
host1.sources.avroSource.bind = localhost
host1.sources.avroSource.port = 41414
host1.sources.avroSource.channels = memoryChannel
#Channels
host1.channels.memoryChannel.type = memory

#Sinks
host1.sinks.esper.type = com.gsshop.bigdata.poc.flume.EsperSink
host1.sinks.esper.channel = memoryChannel

What could be the reason for this error?

Regards,
SOm