Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # dev - Duplicate on failover


Copy link to this message
-
Re: Duplicate on failover
Ralph Goers 2012-08-27, 22:36
Does anyone have any thoughts on this? Is it possibly related to any of the issues already being fixed on the FileChannel?

Ralph

On Aug 26, 2012, at 4:05 PM, Ralph Goers wrote:

> I have successfully embedded Flume into the Log4j 2 Appender. However, I have a unit test that has Flume fail over from one AvroSink to another.  When this happens under some circumstances I am getting the last message successfully delivered to the first source as the first message to the second source, which doesn't seem correct.  The unit test is athttps://svn.apache.org/repos/asf/logging/log4j/log4j2/trunk/flume-ng/src/test/java/org/apache/logging/log4j/flume/appender/FlumeEmbeddedAppenderTest.java. The odd thing is that I cannot get this to fail on my local machine - it only fails when Gump runs it, but it fail fairly consistently.
>
> The unit test has the AppenderSource connect to a FileChannel. Two AvroSinks are connected to the FileChannel via the Failover processor.
>
> Is this a known behavior?
>
> Ralph