Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # dev - Duplicate on failover


+
Ralph Goers 2012-08-26, 23:05
Copy link to this message
-
Re: Duplicate on failover
Ralph Goers 2012-08-27, 22:36
Does anyone have any thoughts on this? Is it possibly related to any of the issues already being fixed on the FileChannel?

Ralph

On Aug 26, 2012, at 4:05 PM, Ralph Goers wrote:

> I have successfully embedded Flume into the Log4j 2 Appender. However, I have a unit test that has Flume fail over from one AvroSink to another.  When this happens under some circumstances I am getting the last message successfully delivered to the first source as the first message to the second source, which doesn't seem correct.  The unit test is athttps://svn.apache.org/repos/asf/logging/log4j/log4j2/trunk/flume-ng/src/test/java/org/apache/logging/log4j/flume/appender/FlumeEmbeddedAppenderTest.java. The odd thing is that I cannot get this to fail on my local machine - it only fails when Gump runs it, but it fail fairly consistently.
>
> The unit test has the AppenderSource connect to a FileChannel. Two AvroSinks are connected to the FileChannel via the Failover processor.
>
> Is this a known behavior?
>
> Ralph

+
Ralph Goers 2012-08-30, 14:50
+
Hari Shreedharan 2012-08-30, 16:22
+
Ralph Goers 2012-08-30, 16:44
+
Hari Shreedharan 2012-08-31, 07:15
+
Ralph Goers 2012-08-31, 16:38
+
Hari Shreedharan 2012-08-31, 17:35
+
Ralph Goers 2012-09-08, 17:01
+
Hari Shreedharan 2012-09-08, 17:36
+
Ralph Goers 2012-09-10, 02:06
+
Hari Shreedharan 2012-09-10, 03:22