Hi,

The host interceptor adds the host to the headers, not the body. You'd
need to create a new one to add it to the event.

Brock

On Tue, Dec 4, 2012 at 11:11 AM, Cochran, David <[EMAIL PROTECTED]> wrote:
> Okay, not a big issue I was able to script around it.
>
> But I have another question (of course right?)
>
> Using tail -F as a source, can an interceptor be used to prepend each
> line with the hostname of the box before sending it to the sink?
>
> Following the example in the UserGuide, i modified my conf, the
> flume.log doesn't report any errors when started..... everything
> appears to work fine...but on the sink copy of the log the lines are
> not modified....
>
> Here's a snippet of what I'm running for the source, likely I have
> something hosed.
>
> node_app01.sources = source21091 source21092
> node_app01.channels = channel21091 channel21092
> node_app01.sources.source21091.interceptors = a b
> node_app01.sources.source21091.interceptors.a.type > org.apache.flume.interceptor.HostInterceptor$Builder
> node_app01.sources.source21091.interceptors.a.preserveExisting = false
> node_app01.sources.source21091.interceptors.a.hostHeader = hostname
> node_app01.sources.source21091.interceptors.b.type > org.apache.flume.interceptor.TimestampInterceptor$Builder
>
>
>
> -Dave
>
> On 12/4/12, Brock Noland <[EMAIL PROTECTED]> wrote:
>> My guess is that you'll hit some kind of problem with that patch.
>>
>> Ted, what do you think?
>>
>> On Tue, Dec 4, 2012 at 10:26 AM, Cochran, David <[EMAIL PROTECTED]>
>> wrote:
>>> Doesn't look like the long awaited FLUME-1295 made it into this
>>> version....
>>>
>>> Any idea if the patch is stable enough to use anyhow on this latest
>>> build?
>>>
>>> Thanks,
>>> -Dave
>>>
>>>
>>>
>>>
>>>
>>> On Tue, Dec 4, 2012 at 10:13 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
>>>>
>>>> The Apache Flume team is pleased to announce the release of Flume
>>>> version
>>>> 1.3.0.
>>>>
>>>> Flume is a distributed, reliable, and available service for efficiently
>>>> collecting, aggregating, and moving large amounts of log data.
>>>>
>>>> This release can be downloaded from the Flume download page at:
>>>> http://flume.apache.org/download.html
>>>>
>>>> The change log and documentation are available on the 1.3.0 release
>>>> page:
>>>> http://flume.apache.org/releases/1.3.0.html
>>>>
>>>> Your help and feedback is more than welcome. For more information on how
>>>> to report problems and to get involved, visit the project website at
>>>> http://flume.apache.org/
>>>>
>>>> The Apache Flume Team
>>>
>>>
>>
>>
>>
>> --
>> Apache MRUnit - Unit testing MapReduce -
>> http://incubator.apache.org/mrunit/
>>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Instead of changing the body text in an interceptor, I made a modified BodyTextEventSerializer.java called HeaderAndBodyTextEventSerialzer.java. The only difference, other than the class name, was two lines in the write() function:

  @Override
  public void write(Event e) throws IOException {
    String eString = e.getHeaders() + " ";
    out.write(eString.getBytes());
    out.write(e.getBody());
    if (appendNewline) {
      out.write('\n');
    }
  }

The configuration file then adds the serializer to the sink specification:
agent1.sinks.fileSink-1.sink.serializer = org.apache.flume.serialization.HeaderAndBodyTextEventSerializer$Builder

I should probably move my changes to my own local class, but this works for now.
--
Thom DeCarlo

On Tue, 04 Dec 2012 17:15:06 GMT, Brock Noland <[EMAIL PROTECTED]> wrote:
> Hi,
>
> The host interceptor adds the host to the headers, not the body. You'd
> need to create a new one to add it to the event.
>
> Brock

Yes, I actually feel like that would be a good Serializer to have
upstream. I created a JIRA for it:
https://issues.apache.org/jira/browse/FLUME-1770

Brock

On Thu, Dec 6, 2012 at 10:16 AM, DeCarlo, Thom <[EMAIL PROTECTED]> wrote:
> Instead of changing the body text in an interceptor, I made a modified BodyTextEventSerializer.java called HeaderAndBodyTextEventSerialzer.java. The only difference, other than the class name, was two lines in the write() function:
>
>   @Override
>   public void write(Event e) throws IOException {
>     String eString = e.getHeaders() + " ";
>     out.write(eString.getBytes());
>     out.write(e.getBody());
>     if (appendNewline) {
>       out.write('\n');
>     }
>   }
>
> The configuration file then adds the serializer to the sink specification:
> agent1.sinks.fileSink-1.sink.serializer = org.apache.flume.serialization.HeaderAndBodyTextEventSerializer$Builder
>
> I should probably move my changes to my own local class, but this works for now.
> --
> Thom DeCarlo
>
> On Tue, 04 Dec 2012 17:15:06 GMT, Brock Noland <[EMAIL PROTECTED]> wrote:
>> Hi,
>>
>> The host interceptor adds the host to the headers, not the body. You'd
>> need to create a new one to add it to the event.
>>
>> Brock

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/