Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> GC overhead limit exceeded


Copy link to this message
-
GC overhead limit exceeded
I ran into the following error - I had to restart flume to recover.  Do I just need to adjust a GC setting of some sort or is there a larger issue here?

Source: thriftLegacy
Channel: memory (capacity: 1,000,000)
Sink: avro
Exception in thread "pool-4-thread-2" java.lang.OutOfMemoryError: GC overhead limit exceeded
        at java.util.concurrent.LinkedBlockingDeque.<init>(LinkedBlockingDeque.java:108)
        at org.apache.flume.channel.MemoryChannel$MemoryTransaction.<init>(MemoryChannel.java:49)
        at org.apache.flume.channel.MemoryChannel.createTransaction(MemoryChannel.java:264)
        at org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:118)
        at org.apache.flume.channel.ChannelProcessor.processEvent(ChannelProcessor.java:260)
        at org.apache.flume.source.thriftLegacy.ThriftLegacySource$ThriftFlumeEventServerImpl.append(ThriftLegacySource.java:96)
        at com.cloudera.flume.handlers.thrift.ThriftFlumeEventServer$Processor$append.process(ThriftFlumeEventServer.java:276)
        at com.cloudera.flume.handlers.thrift.ThriftFlumeEventServer$Processor.process(ThriftFlumeEventServer.java:256)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:176)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)
Exception in thread "SinkRunner-PollingRunner-LoadBalancingSinkProcessor" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "Avro NettyTransceiver I/O Worker 1" java.lang.OutOfMemoryError: GC overhead limit exceeded
Oct 10, 2012 5:51:39 PM org.jboss.netty.channel.socket.nio.AbstractNioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Oct 10, 2012 5:52:35 PM org.jboss.netty.channel.socket.nio.AbstractNioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-2" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "pool-4-thread-4" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-0" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-10" java.lang.OutOfMemoryError: GC overhead limit exceeded
Oct 10, 2012 5:52:39 PM org.jboss.netty.channel.socket.nio.AbstractNioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Oct 10, 2012 5:52:39 PM org.jboss.netty.channel.socket.nio.AbstractNioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-9" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-1" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-5" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-3" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-13" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-6" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-4" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-5" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "lifecycleSupervisor-1-8" java.lang.OutOfMemoryError: GC overhead limit exceeded
Oct 10, 2012 5:52:48 PM org.jboss.netty.channel.socket.nio.AbstractNioWorker
WARNING: Unexpected exception in the selector loop.
Thanks,

Roy
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB