Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Host Interceptor


Copy link to this message
-
Host Interceptor
Brock Noland 2012-12-04, 17:15
Hi,

The host interceptor adds the host to the headers, not the body. You'd
need to create a new one to add it to the event.

Brock

On Tue, Dec 4, 2012 at 11:11 AM, Cochran, David <[EMAIL PROTECTED]> wrote:
> Okay, not a big issue I was able to script around it.
>
> But I have another question (of course right?)
>
> Using tail -F as a source, can an interceptor be used to prepend each
> line with the hostname of the box before sending it to the sink?
>
> Following the example in the UserGuide, i modified my conf, the
> flume.log doesn't report any errors when started..... everything
> appears to work fine...but on the sink copy of the log the lines are
> not modified....
>
> Here's a snippet of what I'm running for the source, likely I have
> something hosed.
>
> node_app01.sources = source21091 source21092
> node_app01.channels = channel21091 channel21092
> node_app01.sources.source21091.interceptors = a b
> node_app01.sources.source21091.interceptors.a.type > org.apache.flume.interceptor.HostInterceptor$Builder
> node_app01.sources.source21091.interceptors.a.preserveExisting = false
> node_app01.sources.source21091.interceptors.a.hostHeader = hostname
> node_app01.sources.source21091.interceptors.b.type > org.apache.flume.interceptor.TimestampInterceptor$Builder
>
>
>
> -Dave
>
> On 12/4/12, Brock Noland <[EMAIL PROTECTED]> wrote:
>> My guess is that you'll hit some kind of problem with that patch.
>>
>> Ted, what do you think?
>>
>> On Tue, Dec 4, 2012 at 10:26 AM, Cochran, David <[EMAIL PROTECTED]>
>> wrote:
>>> Doesn't look like the long awaited FLUME-1295 made it into this
>>> version....
>>>
>>> Any idea if the patch is stable enough to use anyhow on this latest
>>> build?
>>>
>>> Thanks,
>>> -Dave
>>>
>>>
>>>
>>>
>>>
>>> On Tue, Dec 4, 2012 at 10:13 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
>>>>
>>>> The Apache Flume team is pleased to announce the release of Flume
>>>> version
>>>> 1.3.0.
>>>>
>>>> Flume is a distributed, reliable, and available service for efficiently
>>>> collecting, aggregating, and moving large amounts of log data.
>>>>
>>>> This release can be downloaded from the Flume download page at:
>>>> http://flume.apache.org/download.html
>>>>
>>>> The change log and documentation are available on the 1.3.0 release
>>>> page:
>>>> http://flume.apache.org/releases/1.3.0.html
>>>>
>>>> Your help and feedback is more than welcome. For more information on how
>>>> to report problems and to get involved, visit the project website at
>>>> http://flume.apache.org/
>>>>
>>>> The Apache Flume Team
>>>
>>>
>>
>>
>>
>> --
>> Apache MRUnit - Unit testing MapReduce -
>> http://incubator.apache.org/mrunit/
>>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
+
DeCarlo, Thom 2012-12-06, 16:16
+
Brock Noland 2012-12-06, 16:49