Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 11 to 20 from 47 (0.198s).
Loading phrases to help you
refine your search...
RE: File Channel Contents - Flume - [mail # user]
...The 'ChannelSize' metric will give you the number of events currently in the channel. It's one of the main metrics we alert on (well ChannelFillPercentage, actually).  Snippet from one ...
   Author: Paul Chavez, 2014-01-02, 22:31
RE: File Channel Best Practice - Flume - [mail # user]
...We co-locate our flume agents on our data nodes in order to have access to many 'spindles' for the file channels. We have a small cluster (10 nodes) so these are also our task tracker nodes ...
   Author: Paul Chavez, 2013-12-17, 17:43
RE: Recording Windows System Events - Flume - [mail # user]
...No, you would need to have some kind of script or application run to read the events and send them to flume. A script that is scheduled to run every 5 minutes and save the events since the l...
   Author: Paul Chavez, 2013-11-19, 22:04
RE: Dynamic Key=Value Parsing with an Interceptor? - Flume - [mail # user]
...I think there may be two 'out of box' ways to do this kind of thing. First would be using the regex extract interceptor with multiple serializers keying on various fields. However that's not...
   Author: Paul Chavez, 2013-11-11, 23:09
[expand - 1 more] - RE: logs jams in flume collector - Flume - [mail # user]
...You can also add another HDFS sink on the collector. Make sure to give it a different file prefix and bind it to the same channel as the existing sink. You won't need a sink group for this a...
   Author: Paul Chavez, 2013-11-05, 04:59
[expand - 2 more] - RE: Flume not moving data to HDFS or local - Flume - [mail # user]
...Here's a piece of my app server configuration. It's for IIS logs and has an interceptor to pull a timestamp out of the event data. It's backed by a fileChannel and I drop files into the spoo...
   Author: Paul Chavez, 2013-11-01, 03:10
RE: Why does a Flume source need to recognize the format of the message? - Flume - [mail # user]
...You want to use a 'selector' not an 'interceptor'. What your config is currently doing is stamping every event with a header 'category' containing the value 'dataset4'.  Remove the inte...
   Author: Paul Chavez, 2013-10-23, 21:28
RE: flume agent with HDFS sink, syslog source and memory channel - stuck on hdfs IOException - Flume - [mail # user]
...I can't speak for Suhas, but I face a similar issue in production. For me it occurs when someone queries a .tmp file from Hive or Pig. This causes the HDFS sink to lose the ability to close ...
   Author: Paul Chavez, 2013-10-15, 18:23
RE: How to read multiples files getting continuously updated - Flume - [mail # user]
...That is exactly what I do for a similar scenario. In my case it's one big log file that gets written to all day on each server, so I developed a script that runs once a minute to grab the ne...
   Author: Paul Chavez, 2013-10-10, 16:04
RE: Splitting the event flow in Flume - Flume - [mail # user]
...Option 3 is possible with two agents.  Agent1:  Rabbitmq -> source1 -> replicating channel selector -> -> channel1 -> avro sink1 -> agent2.avrosource1 -> chann...
   Author: Paul Chavez, 2013-10-02, 16:58
Sort:
project
Flume (47)
type
mail # user (47)
date
last 7 days (0)
last 30 days (1)
last 90 days (3)
last 6 months (7)
last 9 months (47)
author
Jonathan Hsieh (365)
Hari Shreedharan (355)
Disabled imported user (213)
Mike Percy (202)
Brock Noland (163)
E. Sammer (112)
Roshan Naik (109)
Arvind Prabhakar (88)
Will McQueen (87)
Alexander Alten-Lorenz (61)
Bruce Mitchener (48)
Juhani Connolly (47)
Denny Ye (44)
Ashish (40)
Jeff Lord (39)
Israel Ekpo (31)
Ashish Paliwal (30)
Mubarak Seyed (30)
Jarek Jarcec Cecho (29)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Otis Gospodnetic (20)
Patrick Hunt (19)
Patrick Wendell (19)
Dani Abel Rayan (17)
Paul Chavez
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB