Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 21 to 30 from 45 (0.137s).
Loading phrases to help you
refine your search...
RE: Delete first line of a file - Flume - [mail # user]
...Seems like the use case the Regex Filter Interceptor was developed for. That's my first inclination, at least.  Thanks, Paul Chavez  From: ZORAIDA HIDALGO SANCHEZ [mailto:[EMAIL PR...
   Author: Paul Chavez, 2013-09-12, 16:58
[expand - 2 more] - RE: sleep() in script doesn't work when called by exec Source - Flume - [mail # user]
...I would start by logging performance metrics from your flume agent which will let you determine which component is falling behind. It's likely a sink though, so the first thing you can do is...
   Author: Paul Chavez, 2013-08-23, 21:26
RE: Problem Events - Flume - [mail # user]
...There's no way to deal with a bad event once it's in the channel, but you can mitigate future issues by having a timestamp interceptor bound to the source feeding the channel. There is a par...
   Author: Paul Chavez, 2013-08-01, 17:33
RE: Error: Flume to HDFS Sink - Flume - [mail # user]
...You've specified a channel named NullChannel in the agent1.channels properties, but you don't define it anywhere in the configuration. You've done the same with the NullSink.  You'll ne...
   Author: Paul Chavez, 2013-07-17, 21:03
RE: deserializer.maxLineLength - Flume - [mail # user]
...If you're referring to the spooling file source, I am using the following in a production config:  bufferMaxLineLength = 5000  I'm pretty sure I picked this out from reading the co...
   Author: Paul Chavez, 2013-07-09, 00:07
RE: Flume events rolling file too regularly - Flume - [mail # user]
...There are three file roll defaults on the HDFS sink, rollInterval, rollSize and rollCount. Their defaults are 30s, 1024B and 10 ecents, respectively. You need to set each one as desired or d...
   Author: Paul Chavez, 2013-06-17, 16:16
RE: HDFS custom escape sequence - Flume - [mail # user]
...Yes, any header works using that same notation. I use it to allow us to bucket many event 'types' with a single channel.  for example, a path with custom headers and Hive ready partitio...
   Author: Paul Chavez, 2013-06-10, 22:05
RE: Get Flume 'bad' event out of channel. - Flume - [mail # user]
...Josh,  I'm assuming by 'bad' event you mean one that does not have the required headers for tokenized paths. If that's the case there are two potential ways to solve this.  One way...
   Author: Paul Chavez, 2013-06-05, 16:34
RE: best way to put UDP JSON data into Hadoop - Flume - [mail # user]
...I can't speak to the UDP transport mechanism, but we do use JSON events with Hive and it works quite well.   In our case we have an application that takes an internal object, serializes...
   Author: Paul Chavez, 2013-05-30, 20:43
RE: HDFSEventSink Memory Leak Workarounds - Flume - [mail # user]
...This thread reminded me to check my configs since I use a low idleTimeout and bucket events by hour. Turned out I still had the default rollInterval set so I disabled that and updated my con...
   Author: Paul Chavez, 2013-05-22, 15:58
Flume (45)
mail # user (44)
mail # dev (1)
last 7 days (1)
last 30 days (1)
last 90 days (4)
last 6 months (5)
last 9 months (45)
Hari Shreedharan (418)
Jonathan Hsieh (365)
Mike Percy (278)
Brock Noland (229)
Disabled imported user (213)
E. Sammer (112)
Roshan Naik (106)
Will McQueen (91)
Alexander Alten-Lorenz (90)
Arvind Prabhakar (84)
Juhani Connolly (54)
Bruce Mitchener (48)
Denny Ye (44)
Jeff Lord (39)
Israel Ekpo (36)
Ashish (33)
Mubarak Seyed (32)
Ashish Paliwal (30)
Jarek Jarcec Cecho (30)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Edward Sargisson (19)
Otis Gospodnetic (19)
Patrick Hunt (19)
Patrick Wendell (19)
Paul Chavez