Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Host Interceptor


Copy link to this message
-
Host Interceptor
Hi,

The host interceptor adds the host to the headers, not the body. You'd
need to create a new one to add it to the event.

Brock

On Tue, Dec 4, 2012 at 11:11 AM, Cochran, David <[EMAIL PROTECTED]> wrote:
> Okay, not a big issue I was able to script around it.
>
> But I have another question (of course right?)
>
> Using tail -F as a source, can an interceptor be used to prepend each
> line with the hostname of the box before sending it to the sink?
>
> Following the example in the UserGuide, i modified my conf, the
> flume.log doesn't report any errors when started..... everything
> appears to work fine...but on the sink copy of the log the lines are
> not modified....
>
> Here's a snippet of what I'm running for the source, likely I have
> something hosed.
>
> node_app01.sources = source21091 source21092
> node_app01.channels = channel21091 channel21092
> node_app01.sources.source21091.interceptors = a b
> node_app01.sources.source21091.interceptors.a.type > org.apache.flume.interceptor.HostInterceptor$Builder
> node_app01.sources.source21091.interceptors.a.preserveExisting = false
> node_app01.sources.source21091.interceptors.a.hostHeader = hostname
> node_app01.sources.source21091.interceptors.b.type > org.apache.flume.interceptor.TimestampInterceptor$Builder
>
>
>
> -Dave
>
> On 12/4/12, Brock Noland <[EMAIL PROTECTED]> wrote:
>> My guess is that you'll hit some kind of problem with that patch.
>>
>> Ted, what do you think?
>>
>> On Tue, Dec 4, 2012 at 10:26 AM, Cochran, David <[EMAIL PROTECTED]>
>> wrote:
>>> Doesn't look like the long awaited FLUME-1295 made it into this
>>> version....
>>>
>>> Any idea if the patch is stable enough to use anyhow on this latest
>>> build?
>>>
>>> Thanks,
>>> -Dave
>>>
>>>
>>>
>>>
>>>
>>> On Tue, Dec 4, 2012 at 10:13 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
>>>>
>>>> The Apache Flume team is pleased to announce the release of Flume
>>>> version
>>>> 1.3.0.
>>>>
>>>> Flume is a distributed, reliable, and available service for efficiently
>>>> collecting, aggregating, and moving large amounts of log data.
>>>>
>>>> This release can be downloaded from the Flume download page at:
>>>> http://flume.apache.org/download.html
>>>>
>>>> The change log and documentation are available on the 1.3.0 release
>>>> page:
>>>> http://flume.apache.org/releases/1.3.0.html
>>>>
>>>> Your help and feedback is more than welcome. For more information on how
>>>> to report problems and to get involved, visit the project website at
>>>> http://flume.apache.org/
>>>>
>>>> The Apache Flume Team
>>>
>>>
>>
>>
>>
>> --
>> Apache MRUnit - Unit testing MapReduce -
>> http://incubator.apache.org/mrunit/
>>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
+
DeCarlo, Thom 2012-12-06, 16:16
+
Brock Noland 2012-12-06, 16:49
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB