Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> spooling directory source and variable replacement


Copy link to this message
-
spooling directory source and variable replacement
Hi All,

The application I'd like to grab log files from is rotating them into subdirectories by time stamp. For example,

/mnt/remote/application_name/yyyy/mm/dd/hh/[filename]-[timestamp].gz

Is there any way to configure the spooling directory source in flume with time variables such that it can find these files? Or is there a better way to do this?

Thanks
--
Frank Maritato
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB