Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - spooling directory source and variable replacement


Copy link to this message
-
spooling directory source and variable replacement
Frank Maritato 2013-06-03, 20:41
Hi All,

The application I'd like to grab log files from is rotating them into subdirectories by time stamp. For example,

/mnt/remote/application_name/yyyy/mm/dd/hh/[filename]-[timestamp].gz

Is there any way to configure the spooling directory source in flume with time variables such that it can find these files? Or is there a better way to do this?

Thanks
--
Frank Maritato