Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # dev - Files names identification in tail -F *.log

Copy link to this message
Files names identification in tail -F *.log
Kumar, Deepak8 2013-09-19, 13:31

I am using flume 1.4. Do we have a way to indentify file names at sink if we are using regex in file name patterns in exec tail command, like tail -F *flume*.log. The flume-conf is as follows:

agent.sources.1376976299847.batchSize = 1

agent.sources.1376976299847.channels = fileChannel

agent.sources.1376976299847.command = tail -F /var/log/flume-ng/*flume*

agent.sources.1376976299847.interceptors = logIntercept

agent.sources.1376976299847.interceptors.logIntercept.appId = 153299

agent.sources.1376976299847.interceptors.logIntercept.env = regex

agent.sources.1376976299847.interceptors.logIntercept.hostName = vm-e61b-fe34.nam.nsroot.net

agent.sources.1376976299847.interceptors.logIntercept.logFileName = *flume*

agent.sources.1376976299847.interceptors.logIntercept.logFilePath = /var/log/flume-ng/

agent.sources.1376976299847.interceptors.logIntercept.logType = flume log

agent.sources.1376976299847.interceptors.logIntercept.type = com.citi.sponge.flume.agent.source.LogInterceptor$Builder

agent.sources.1376976299847.shell = /bin/bash -c

agent.sources.1376976299847.type = exec

How I would identify the individual file names?