Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 11 (0.12s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: HDFS Sink Memory Leak - Flume - [mail # user]
...David,  It was a mix. Our test pipeline is what would euphemistically be called "low-velocity" when it comes to data. When we experimented with rollInterval, we found a lot of lingering...
   Author: DSuiter RDX, 2013-11-11, 18:29
Collecting WINDOWS event viewer logs? - Flume - [mail # user]
...Hi all,  I've been using the rsyslog TCP forwarding feature to collect syslogs with syslogTCP source from a linux server, and it is working well.  We are now attempting to get a si...
   Author: DSuiter RDX, 2013-11-06, 16:16
Preserving origin syslog information - Flume - [mail # user]
...Hi, just a general behavioral question.  We have a syslogTCP source catching remotely generated syslog events. They got to an Avro sink, which delivers them to an Avro source, then into...
   Author: DSuiter RDX, 2013-10-30, 15:11
Re: Use flume to copy data in local directory (hadoop server) into hdfs - Flume - [mail # user]
...Luu,  You might want to set up some redundant/load-balancing channels and sinks, so if one sink is tied up, the operation can be attempted on another sink. I am not very experienced wit...
   Author: DSuiter RDX, 2013-10-24, 17:57
[expand - 2 more] - Re: Problem setting the rollInterval for HDFS sink - Flume - [mail # user]
...I get that sometimes, but usually when the HDFS sink header interpreters make a new directory or the file rolls. I have some .tmp files that are from 2 weeks ago - the agent that wrote them ...
   Author: DSuiter RDX, 2013-10-24, 17:46
Re: Roll based on date - Flume - [mail # user]
...Martinus, you have to set all the other roll options to 0 explicitly in the configuration if you want them only to roll on one parameter, it will take the shortest working parameter it can m...
   Author: DSuiter RDX, 2013-10-22, 15:16
Extra information being delivered via Flume - Flume - [mail # user]
...Hi all,  We set up a pipeline to get rsyslog input from a remote server via TCP using rsyslog remote TCP forwarding functionality. The data gets sent from the server to a syslogTCP sour...
   Author: DSuiter RDX, 2013-10-10, 18:56
Re: How to read multiples files getting continuously updated - Flume - [mail # user]
...Abhijeet,  The built-in Avro client might be good to look into. In my experience, it grabs what is in a directory and converts it to Avro format to send to a Flume Avro source, which ca...
   Author: DSuiter RDX, 2013-10-10, 11:46
[expand - 1 more] - Re: Shutdown metric question - Flume - [mail # user]
...Thanks Hari, that was what I was hoping to hear. Based on the first two lines, that was what I had expected, but wanted to confirm before trusting anything of value to the agent recipe as it...
   Author: DSuiter RDX, 2013-10-09, 12:40
[expand - 1 more] - Re: Problem aggregating syslogTCP > avro > HDFS - Flume - [mail # user]
...Ok, I just realized that I am missing a 0 on the rollSize, and it is probably doing exactly what it is supposed to since I told it close the file at 3 KB not 3 MB...  Sorry everyone! &n...
   Author: DSuiter RDX, 2013-10-07, 16:12
Flume (11)
MapReduce (5)
Sqoop (2)
Avro (1)
Hadoop (1)
mail # user (11)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (11)
Jonathan Hsieh (365)
Hari Shreedharan (331)
Disabled imported user (213)
Mike Percy (204)
Brock Noland (164)
E. Sammer (112)
Roshan Naik (99)
Will McQueen (87)
Arvind Prabhakar (83)
Alexander Alten-Lorenz (61)
Bruce Mitchener (48)
Juhani Connolly (47)
Denny Ye (44)
Jeff Lord (38)
Ashish (36)
Israel Ekpo (31)
Mubarak Seyed (30)
Jarek Jarcec Cecho (29)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Otis Gospodnetic (19)
Patrick Hunt (19)
Patrick Wendell (19)
Dani Abel Rayan (17)
Wolfgang Hoschek (17)
DSuiter RDX