Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Files names identification in tail -F *.log


Copy link to this message
-
Files names identification in tail -F *.log
Hi,

I am using flume 1.4. Do we have a way to indentify file names at sink if we are using regex in file name patterns in tail command, like tail -F *flume*.log. The flume-conf is as follows:

agent.sources.1376976299847.batchSize = 1

agent.sources.1376976299847.channels = fileChannel

agent.sources.1376976299847.command = tail -F /var/log/flume-ng/*flume*

agent.sources.1376976299847.interceptors = logIntercept

agent.sources.1376976299847.interceptors.logIntercept.appId = 153299

agent.sources.1376976299847.interceptors.logIntercept.env = regex

agent.sources.1376976299847.interceptors.logIntercept.hostName = vm-e61b-fe34.nam.nsroot.net

agent.sources.1376976299847.interceptors.logIntercept.logFileName = *flume*

agent.sources.1376976299847.interceptors.logIntercept.logFilePath = /var/log/flume-ng/

agent.sources.1376976299847.interceptors.logIntercept.logType = flume log

agent.sources.1376976299847.interceptors.logIntercept.type = com.citi.sponge.flume.agent.source.LogInterceptor$Builder

agent.sources.1376976299847.shell = /bin/bash -c

agent.sources.1376976299847.type = exec

Regards,

Deepak
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB