Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> Re: [jira] [Created] (FLUME-1479) Multiple Sinks can connect to single Channel


Copy link to this message
-
Re: [jira] [Created] (FLUME-1479) Multiple Sinks can connect to single Channel
JIRA is down again? I cannot connect to it and comment there.

I have a proposal in "Transactional Multiplex (fan out) Sink"):
https://issues.apache.org/jira/browse/FLUME-1435
Which contains the design of one channel to multiple sinks.

You can search the email since JIRA cannot be accessed.

I think this is more than a configuration issue. If simply enable several
sinks on the same channel, they will take it either in a round-robin mode
or in a unpredictable mode if the speed of sinks are different.

So it's better to have a even higher level transaction control instead of
the transaction in the process() of each sink, as I describe in FLUME-1435.

Regards,
Yongkun Wang
On 12/08/10 12:30, "Denny Ye (JIRA)" <[EMAIL PROTECTED]> wrote:

>Denny Ye created FLUME-1479:
>-------------------------------
>
>             Summary: Multiple Sinks can connect to single Channel
>                 Key: FLUME-1479
>                 URL: https://issues.apache.org/jira/browse/FLUME-1479
>             Project: Flume
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: v1.2.0
>            Reporter: Denny Ye
>            Assignee: Denny Ye
>             Fix For: v1.3.0
>
>
>If we has one Channel (mc) and two Sinks (hsa, hsb), then they may be
>connected with each other with configuration example
>{quote}
>agent.sinks.hsa.channel = mc
>agent.sinks.hsb.channel = mc
>{quote}
>It means that there have multiple Sinks can connect to single Channel.
>Normally, one Sink only can connect to unified Channel
>
>--
>This message is automatically generated by JIRA.
>If you think it was sent incorrectly, please contact your JIRA
>administrators:
>https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>        
>