Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> Re: [jira] [Created] (FLUME-1479) Multiple Sinks can connect to single Channel


Copy link to this message
-
Re: [jira] [Created] (FLUME-1479) Multiple Sinks can connect to single Channel
JIRA is down again? I cannot connect to it and comment there.

I have a proposal in "Transactional Multiplex (fan out) Sink"):
https://issues.apache.org/jira/browse/FLUME-1435
Which contains the design of one channel to multiple sinks.

You can search the email since JIRA cannot be accessed.

I think this is more than a configuration issue. If simply enable several
sinks on the same channel, they will take it either in a round-robin mode
or in a unpredictable mode if the speed of sinks are different.

So it's better to have a even higher level transaction control instead of
the transaction in the process() of each sink, as I describe in FLUME-1435.

Regards,
Yongkun Wang
On 12/08/10 12:30, "Denny Ye (JIRA)" <[EMAIL PROTECTED]> wrote:

>Denny Ye created FLUME-1479:
>-------------------------------
>
>             Summary: Multiple Sinks can connect to single Channel
>                 Key: FLUME-1479
>                 URL: https://issues.apache.org/jira/browse/FLUME-1479
>             Project: Flume
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: v1.2.0
>            Reporter: Denny Ye
>            Assignee: Denny Ye
>             Fix For: v1.3.0
>
>
>If we has one Channel (mc) and two Sinks (hsa, hsb), then they may be
>connected with each other with configuration example
>{quote}
>agent.sinks.hsa.channel = mc
>agent.sinks.hsb.channel = mc
>{quote}
>It means that there have multiple Sinks can connect to single Channel.
>Normally, one Sink only can connect to unified Channel
>
>--
>This message is automatically generated by JIRA.
>If you think it was sent incorrectly, please contact your JIRA
>administrators:
>https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>        
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB