Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> Duplicate on failover


Copy link to this message
-
Re: Duplicate on failover
Does anyone have any thoughts on this? Is it possibly related to any of the issues already being fixed on the FileChannel?

Ralph

On Aug 26, 2012, at 4:05 PM, Ralph Goers wrote:

> I have successfully embedded Flume into the Log4j 2 Appender. However, I have a unit test that has Flume fail over from one AvroSink to another.  When this happens under some circumstances I am getting the last message successfully delivered to the first source as the first message to the second source, which doesn't seem correct.  The unit test is athttps://svn.apache.org/repos/asf/logging/log4j/log4j2/trunk/flume-ng/src/test/java/org/apache/logging/log4j/flume/appender/FlumeEmbeddedAppenderTest.java. The odd thing is that I cannot get this to fail on my local machine - it only fails when Gump runs it, but it fail fairly consistently.
>
> The unit test has the AppenderSource connect to a FileChannel. Two AvroSinks are connected to the FileChannel via the Failover processor.
>
> Is this a known behavior?
>
> Ralph