Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Architecting Flume for failover


+
Noel Duffy 2013-02-19, 21:32
+
Yogi Nerella 2013-02-19, 23:39
+
Noel Duffy 2013-02-20, 00:05
+
Hari Shreedharan 2013-02-20, 00:30
+
Noel Duffy 2013-02-20, 01:03
+
Jeff Lord 2013-02-20, 01:16
+
Noel Duffy 2013-02-20, 01:35
+
Jeff Lord 2013-02-20, 01:45
+
Noel Duffy 2013-02-20, 01:59
+
Noel Duffy 2013-02-20, 04:18
+
Hari Shreedharan 2013-02-20, 04:37
Copy link to this message
-
Re: Architecting Flume for failover
Hari Shreedharan 2013-02-20, 04:38
Also, as Jeff said, sink-2 has a higher priority (the absolute value of the priority being higher, that sink is picked up).
--
Hari Shreedharan
On Tuesday, February 19, 2013 at 8:37 PM, Hari Shreedharan wrote:

> No, it does not mean that. To talk to different HDFS clusters you must specify the hdfs.path as hdfs://namenode:port/<path>. You don't need to specify the bind etc.
>
> Hope this helps.
>
> Hari
>
> --
> Hari Shreedharan
>
>
> On Tuesday, February 19, 2013 at 8:18 PM, Noel Duffy wrote:
>
> > Hari Shreedharan [mailto:[EMAIL PROTECTED]] wrote:
> >
> > > The "bind" configuration param does not really exist for HDFS Sink (it is only for the IPC sources).
> >
> > Does this mean that failover for sinks on different hosts cannot work for HDFS sinks at all? Does it require Avro sinks, which seem to have a hostname parameter?
>

+
Noel Duffy 2013-02-20, 06:07
+
Juhani Connolly 2013-02-20, 06:26
+
Noel Duffy 2013-02-20, 07:27