Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 11 to 20 from 45 (0.207s).
Loading phrases to help you
refine your search...
RE: Dynamic Key=Value Parsing with an Interceptor? - Flume - [mail # user]
...I think there may be two 'out of box' ways to do this kind of thing. First would be using the regex extract interceptor with multiple serializers keying on various fields. However that's not...
   Author: Paul Chavez, 2013-11-11, 23:09
[expand - 1 more] - RE: logs jams in flume collector - Flume - [mail # user]
...You can also add another HDFS sink on the collector. Make sure to give it a different file prefix and bind it to the same channel as the existing sink. You won't need a sink group for this a...
   Author: Paul Chavez, 2013-11-05, 04:59
[expand - 2 more] - RE: Flume not moving data to HDFS or local - Flume - [mail # user]
...Here's a piece of my app server configuration. It's for IIS logs and has an interceptor to pull a timestamp out of the event data. It's backed by a fileChannel and I drop files into the spoo...
   Author: Paul Chavez, 2013-11-01, 03:10
RE: Why does a Flume source need to recognize the format of the message? - Flume - [mail # user]
...You want to use a 'selector' not an 'interceptor'. What your config is currently doing is stamping every event with a header 'category' containing the value 'dataset4'.  Remove the inte...
   Author: Paul Chavez, 2013-10-23, 21:28
RE: flume agent with HDFS sink, syslog source and memory channel - stuck on hdfs IOException - Flume - [mail # user]
...I can't speak for Suhas, but I face a similar issue in production. For me it occurs when someone queries a .tmp file from Hive or Pig. This causes the HDFS sink to lose the ability to close ...
   Author: Paul Chavez, 2013-10-15, 18:23
RE: How to read multiples files getting continuously updated - Flume - [mail # user]
...That is exactly what I do for a similar scenario. In my case it's one big log file that gets written to all day on each server, so I developed a script that runs once a minute to grab the ne...
   Author: Paul Chavez, 2013-10-10, 16:04
RE: Splitting the event flow in Flume - Flume - [mail # user]
...Option 3 is possible with two agents.  Agent1:  Rabbitmq -> source1 -> replicating channel selector -> -> channel1 -> avro sink1 -> agent2.avrosource1 -> chann...
   Author: Paul Chavez, 2013-10-02, 16:58
RE: unsubscribe - Flume - [mail # user]
...Mark, this is the user list. You need to send that to: [EMAIL PROTECTED]   From: Mark Fuini [mailto:[EMAIL PROTECTED]] Sent: Friday, September 27, 2013 11:02 AM To: [EMAIL PROTECTED] Su...
   Author: Paul Chavez, 2013-09-27, 18:14
[expand - 1 more] - RE: Unable to put batch on required channel - Flume - [mail # user]
...Thanks for the update. I remember I had a similar situation now, except that I had the transactionCapacity lower than the batch size for the sink. I guess having them exactly the same is not...
   Author: Paul Chavez, 2013-09-27, 17:43
[expand - 1 more] - RE: flume 1.4.0 avro source/sink with hdfs sink configuration - no hdfs files created - Flume - [mail # user]
...I think you can do this on one node, but you will need to run two instances of flume, each with a different agent name.  Paul  From: Suhas Satish [mailto:[EMAIL PROTECTED]] Sent: T...
   Author: Paul Chavez, 2013-09-12, 18:07
Flume (45)
mail # user (44)
mail # dev (1)
last 7 days (1)
last 30 days (1)
last 90 days (4)
last 6 months (5)
last 9 months (45)
Hari Shreedharan (418)
Jonathan Hsieh (365)
Mike Percy (278)
Brock Noland (229)
Disabled imported user (213)
E. Sammer (112)
Roshan Naik (106)
Will McQueen (91)
Alexander Alten-Lorenz (90)
Arvind Prabhakar (84)
Juhani Connolly (54)
Bruce Mitchener (48)
Denny Ye (44)
Jeff Lord (39)
Israel Ekpo (36)
Ashish (33)
Mubarak Seyed (32)
Ashish Paliwal (30)
Jarek Jarcec Cecho (30)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Edward Sargisson (19)
Otis Gospodnetic (19)
Patrick Hunt (19)
Patrick Wendell (19)
Paul Chavez