Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - about flume-ng agent


Copy link to this message
-
Re: about flume-ng agent
Brock Noland 2012-10-25, 16:21
If you cannot use RPCclient (project is not in java), then writing the
events to syslog and then sending those events to a "collector" agent
running syslog source is probably the best option. A worse option
would be to use exec source with tail -F. This is "worse" because it
can easily lose large amounts of data.

Brock

On Thu, Oct 25, 2012 at 11:00 AM, lancexxx <[EMAIL PROTECTED]> wrote:
> oh, seemingly ,I see. sorry , I am new to flume.
> now I collect log from web server and want to use syslogudp source,
> which tool or  RPCclient  I should use to sent the data to the source of
> flume-ng agent
> on web server host ? maybe can you recommend to me a better source type like
> AVRO source,
> syslog source etc. because I do not realized the difference or advantage
> between them and
> I find no more information via the official guide。
> thanks very much!
> --
> lancexxx
>
> On 2012年10月25日Thursday at 下午10:37, Brock Noland wrote:
>
> Either the webserver must run a flume agent, the webserver must use
> the RPCClient (just a java object, not an agent) or the webserver can
> use the log4j appender.
>
> Brock
>
> On Wed, Oct 24, 2012 at 10:51 PM, lancexxx <[EMAIL PROTECTED]> wrote:
>
>
> hi
> I do not understand that every host of webserser must run a flume-ng agent
> if I collect weblog?
> if no ,well then the client(web server host) how to sent the log to the
> flume-ng agent host in the internet?
> --
> thanks!
> lancexxx
>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
>
>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/