Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Architecting Flume for failover


+
Noel Duffy 2013-02-19, 21:32
+
Yogi Nerella 2013-02-19, 23:39
+
Noel Duffy 2013-02-20, 00:05
+
Hari Shreedharan 2013-02-20, 00:30
+
Noel Duffy 2013-02-20, 01:03
+
Jeff Lord 2013-02-20, 01:16
+
Noel Duffy 2013-02-20, 01:35
+
Jeff Lord 2013-02-20, 01:45
+
Noel Duffy 2013-02-20, 01:59
+
Noel Duffy 2013-02-20, 04:18
+
Hari Shreedharan 2013-02-20, 04:37
Copy link to this message
-
Re: Architecting Flume for failover
Also, as Jeff said, sink-2 has a higher priority (the absolute value of the priority being higher, that sink is picked up).
--
Hari Shreedharan
On Tuesday, February 19, 2013 at 8:37 PM, Hari Shreedharan wrote:

> No, it does not mean that. To talk to different HDFS clusters you must specify the hdfs.path as hdfs://namenode:port/<path>. You don't need to specify the bind etc.
>
> Hope this helps.
>
> Hari
>
> --
> Hari Shreedharan
>
>
> On Tuesday, February 19, 2013 at 8:18 PM, Noel Duffy wrote:
>
> > Hari Shreedharan [mailto:[EMAIL PROTECTED]] wrote:
> >
> > > The "bind" configuration param does not really exist for HDFS Sink (it is only for the IPC sources).
> >
> > Does this mean that failover for sinks on different hosts cannot work for HDFS sinks at all? Does it require Avro sinks, which seem to have a hostname parameter?
>

+
Noel Duffy 2013-02-20, 06:07
+
Juhani Connolly 2013-02-20, 06:26
+
Noel Duffy 2013-02-20, 07:27
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB