Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - A backup sink


Copy link to this message
-
A backup sink
Anat Rozenzon 2013-08-11, 07:49
Hi,

I'm looking for a way to create a sink that will simply 'backup' the files
I'm sending through an Avro Source.
I have in the headers the file name, host name etc.
Is there a way to do store each line in a file according to these headers?

For example store events in a file called
orig_hostname.orig_filename.timestamp, e.g.:
myhost.messages.log.1.135678263178

Thanks
Anat