Flume, mail # user - Flume-ng vs Flume - 2014-02-19, 17:38
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Flume-ng vs Flume
Hi,
I have been trying to configure flume in a truely distributed mode using
master / agents configuration. I know it is possible to do so if I run my
agents as "flume node" daemon. But doing so I am restricted to pass various
properties in flume-site.xml like Source Command (tail -f...) etc.
So I switched to using flume-ng agent daemon because that gives me more
flexibility to pass various configuration properties. But using flume-ng, I
do not find a way to connect to master as there is no flume-site.xml
property that is shipped with flume-ng.
I would therefore like to know how can I accomplish my goal of setting up
flume as Master / Agent as well as be able to pass a line separated
flume.conf as we can do it in Flume-Ng.

Thanks
Upender

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB