Hi,

i want to use Flume to collect logs in my network (~20000 logs/sec).
But now I'm not really sure, what are the differences between Flume and a
MOM like ActiveMQ.

I would say the flume agent on the client side and the flume collector on
the server side build a reliable channel. So i have a reliability from the
moment i give the message to the agent on the client.

And the transfer to a MOM isn't reliable.

Is this the biggest advantage of flume? Do you know any other project like
flume? I have to make a comparison between different transport solutions.
So i could use a simple Socket, JMS, Flume, ...

Regards,
Simon

Hi Simon,

         You can have a look at this thread. Discusses something similar.

Regards,
    Mohammad Tariq

On Fri, Nov 2, 2012 at 3:44 PM, Simon Monecke <[EMAIL PROTECTED]>wrote:

> Hi,
>
> i want to use Flume to collect logs in my network (~20000 logs/sec).
> But now I'm not really sure, what are the differences between Flume and a
> MOM like ActiveMQ.
>
> I would say the flume agent on the client side and the flume collector on
> the server side build a reliable channel. So i have a reliability from the
> moment i give the message to the agent on the client.
>
> And the transfer to a MOM isn't reliable.
>
> Is this the biggest advantage of flume? Do you know any other project like
> flume? I have to make a comparison between different transport solutions.
> So i could use a simple Socket, JMS, Flume, ...
>
> Regards,
> Simon

Excuse me. Here is the link
https://groups.google.com/a/cloudera.org/forum/?fromgroups=#!topic/flume-user/vqadK-oeJAg
Regards,
    Mohammad Tariq

On Fri, Nov 2, 2012 at 5:16 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:

> Hi Simon,
>
>          You can have a look at this thread. Discusses something similar.
>
> Regards,
>     Mohammad Tariq
>
>
>
> On Fri, Nov 2, 2012 at 3:44 PM, Simon Monecke <[EMAIL PROTECTED]>wrote:
>
>> Hi,
>>
>> i want to use Flume to collect logs in my network (~20000 logs/sec).
>> But now I'm not really sure, what are the differences between Flume and a
>> MOM like ActiveMQ.
>>
>> I would say the flume agent on the client side and the flume collector on
>> the server side build a reliable channel. So i have a reliability from the
>> moment i give the message to the agent on the client.
>>
>> And the transfer to a MOM isn't reliable.
>>
>> Is this the biggest advantage of flume? Do you know any other project
>> like flume? I have to make a comparison between different transport
>> solutions. So i could use a simple Socket, JMS, Flume, ...
>>
>> Regards,
>> Simon
>
>
>

Might want to checkout logstash
On Nov 2, 2012 3:14 AM, "Simon Monecke" <[EMAIL PROTECTED]> wrote:

> Hi,
>
> i want to use Flume to collect logs in my network (~20000 logs/sec).
> But now I'm not really sure, what are the differences between Flume and a
> MOM like ActiveMQ.
>
> I would say the flume agent on the client side and the flume collector on
> the server side build a reliable channel. So i have a reliability from the
> moment i give the message to the agent on the client.
>
> And the transfer to a MOM isn't reliable.
>
> Is this the biggest advantage of flume? Do you know any other project like
> flume? I have to make a comparison between different transport solutions.
> So i could use a simple Socket, JMS, Flume, ...
>
> Regards,
> Simon