Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> A backup sink


Hi,

I'm looking for a way to create a sink that will simply 'backup' the files
I'm sending through an Avro Source.
I have in the headers the file name, host name etc.
Is there a way to do store each line in a file according to these headers?

For example store events in a file called
orig_hostname.orig_filename.timestamp, e.g.:
myhost.messages.log.1.135678263178

Thanks
Anat
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB