Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Re: [ANNOUNCE] Apache Flume 1.3.0 released


Copy link to this message
-
Re: [ANNOUNCE] Apache Flume 1.3.0 released
Okay, not a big issue I was able to script around it.

But I have another question (of course right?)

Using tail -F as a source, can an interceptor be used to prepend each
line with the hostname of the box before sending it to the sink?

Following the example in the UserGuide, i modified my conf, the
flume.log doesn't report any errors when started..... everything
appears to work fine...but on the sink copy of the log the lines are
not modified....

Here's a snippet of what I'm running for the source, likely I have
something hosed.

node_app01.sources = source21091 source21092
node_app01.channels = channel21091 channel21092
node_app01.sources.source21091.interceptors = a b
node_app01.sources.source21091.interceptors.a.type org.apache.flume.interceptor.HostInterceptor$Builder
node_app01.sources.source21091.interceptors.a.preserveExisting = false
node_app01.sources.source21091.interceptors.a.hostHeader = hostname
node_app01.sources.source21091.interceptors.b.type org.apache.flume.interceptor.TimestampInterceptor$Builder

-Dave

On 12/4/12, Brock Noland <[EMAIL PROTECTED]> wrote:
> My guess is that you'll hit some kind of problem with that patch.
>
> Ted, what do you think?
>
> On Tue, Dec 4, 2012 at 10:26 AM, Cochran, David <[EMAIL PROTECTED]>
> wrote:
>> Doesn't look like the long awaited FLUME-1295 made it into this
>> version....
>>
>> Any idea if the patch is stable enough to use anyhow on this latest
>> build?
>>
>> Thanks,
>> -Dave
>>
>>
>>
>>
>>
>> On Tue, Dec 4, 2012 at 10:13 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
>>>
>>> The Apache Flume team is pleased to announce the release of Flume
>>> version
>>> 1.3.0.
>>>
>>> Flume is a distributed, reliable, and available service for efficiently
>>> collecting, aggregating, and moving large amounts of log data.
>>>
>>> This release can be downloaded from the Flume download page at:
>>> http://flume.apache.org/download.html
>>>
>>> The change log and documentation are available on the 1.3.0 release
>>> page:
>>> http://flume.apache.org/releases/1.3.0.html
>>>
>>> Your help and feedback is more than welcome. For more information on how
>>> to report problems and to get involved, visit the project website at
>>> http://flume.apache.org/
>>>
>>> The Apache Flume Team
>>
>>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB