Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - about flume-ng agent


Copy link to this message
-
Re: about flume-ng agent
Will McQueen 2012-10-25, 20:38
Would the new HttpSource work for you?

On Oct 25, 2012, at 2:47 PM, Brock Noland <[EMAIL PROTECTED]> wrote:

> On Thu, Oct 25, 2012 at 1:16 PM, Paul Chavez
> <[EMAIL PROTECTED]> wrote:
>>
>> I am no expert either but the various syslog related RFC and RFC-type documentation I can find recommends that messeages be kept small in order to avoid fragmentation.
>
> Ahh OK.
>
>>
>> Testing with the syslogTCP source did not show any issues with fragmentation, but the tool we are using to send syslog messages over TCP (LogParser) does not separate messages with a carriage return so messages weren't parsed correctly by the flume source.
>
> Yes TCP/IP will deliver the events in ordert.
>
>> I would hope so but I am not in a position to make any guarantees on behalf of my employer.
>
> No worries, I understand!
>
> Brock
>
> --
> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/