Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> High level technical overview of output bucketing for flume (old-gen) ?


Copy link to this message
-
High level technical overview of output bucketing for flume (old-gen) ?
Hi,

I am using flume (old gen) as an extension to an existant syslog system and
would like to use the timestamp of the syslog message as the timestamp of
the flume event.
I guess the timestamp is used for the '*Fine grained escape sequences date
and times*' but I don't have a clear understanding of it.
http://archive.cloudera.com/cdh/3/flume/UserGuide/#_output_bucketing

Could someone point me to where those sequences (like %d) are interpreted?
I would like to be sure I am not missing anything obvious.

Thanks in advance

Bertrand

PS : I know an unrelated recommandation would be to use flume-ng but this
is not the topic of this email.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB