Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> flume agent repeating the log events


+
Madhusudhan Reddy Munagal... 2013-02-28, 14:43
Copy link to this message
-
Re: flume agent repeating the log events
can you post a sample of the config.
On Thu, Feb 28, 2013 at 6:43 AM, Madhusudhan Reddy Munagala <
[EMAIL PROTECTED]> wrote:

>
> Any help will be appreciated...
>
> We have an issue where the flume agent is  repeating the log data. Below
> is the pattern we have observed.****
>
> ** **
>
> **1)      **Flume agent reads log events through tailDir  command  and
> everything  looks fine with time stamp with the latest log event from the
> log****
>
> **2)      **After sometime the agent start reading the beginning of the
> file.****
>
> **3)      **One thing we have observed that the latest log event size is
> 78KB when the agent  stops reading latest log event and went to beginning
> of the file****
>
> ** **
>
> Any idea why agent  stops reading latest event  and goes back to beginning
> of the file ?  Is this could be because of the size of the event being 78KB
> ?
>
>
> Madhu
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB