Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 11 (0.081s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: HDFS Sink Memory Leak - Flume - [mail # user]
...David,  It was a mix. Our test pipeline is what would euphemistically be called "low-velocity" when it comes to data. When we experimented with rollInterval, we found a lot of lingering...
   Author: DSuiter RDX, 2013-11-11, 18:29
Collecting WINDOWS event viewer logs? - Flume - [mail # user]
...Hi all,  I've been using the rsyslog TCP forwarding feature to collect syslogs with syslogTCP source from a linux server, and it is working well.  We are now attempting to get a si...
   Author: DSuiter RDX, 2013-11-06, 16:16
Preserving origin syslog information - Flume - [mail # user]
...Hi, just a general behavioral question.  We have a syslogTCP source catching remotely generated syslog events. They got to an Avro sink, which delivers them to an Avro source, then into...
   Author: DSuiter RDX, 2013-10-30, 15:11
Re: Use flume to copy data in local directory (hadoop server) into hdfs - Flume - [mail # user]
...Luu,  You might want to set up some redundant/load-balancing channels and sinks, so if one sink is tied up, the operation can be attempted on another sink. I am not very experienced wit...
   Author: DSuiter RDX, 2013-10-24, 17:57
[expand - 2 more] - Re: Problem setting the rollInterval for HDFS sink - Flume - [mail # user]
...I get that sometimes, but usually when the HDFS sink header interpreters make a new directory or the file rolls. I have some .tmp files that are from 2 weeks ago - the agent that wrote them ...
   Author: DSuiter RDX, 2013-10-24, 17:46
Re: Roll based on date - Flume - [mail # user]
...Martinus, you have to set all the other roll options to 0 explicitly in the configuration if you want them only to roll on one parameter, it will take the shortest working parameter it can m...
   Author: DSuiter RDX, 2013-10-22, 15:16
Extra information being delivered via Flume - Flume - [mail # user]
...Hi all,  We set up a pipeline to get rsyslog input from a remote server via TCP using rsyslog remote TCP forwarding functionality. The data gets sent from the server to a syslogTCP sour...
   Author: DSuiter RDX, 2013-10-10, 18:56
Re: How to read multiples files getting continuously updated - Flume - [mail # user]
...Abhijeet,  The built-in Avro client might be good to look into. In my experience, it grabs what is in a directory and converts it to Avro format to send to a Flume Avro source, which ca...
   Author: DSuiter RDX, 2013-10-10, 11:46
[expand - 1 more] - Re: Shutdown metric question - Flume - [mail # user]
...Thanks Hari, that was what I was hoping to hear. Based on the first two lines, that was what I had expected, but wanted to confirm before trusting anything of value to the agent recipe as it...
   Author: DSuiter RDX, 2013-10-09, 12:40
[expand - 1 more] - Re: Problem aggregating syslogTCP > avro > HDFS - Flume - [mail # user]
...Ok, I just realized that I am missing a 0 on the rollSize, and it is probably doing exactly what it is supposed to since I told it close the file at 3 KB not 3 MB...  Sorry everyone! &n...
   Author: DSuiter RDX, 2013-10-07, 16:12
Sort:
project
Flume (11)
MapReduce (5)
Sqoop (2)
Avro (1)
Hadoop (1)
type
mail # user (11)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (11)
author
Hari Shreedharan (400)
Jonathan Hsieh (365)
Mike Percy (278)
Brock Noland (229)
Disabled imported user (213)
E. Sammer (112)
Roshan Naik (99)
Will McQueen (91)
Alexander Alten-Lorenz (90)
Arvind Prabhakar (83)
Juhani Connolly (54)
Bruce Mitchener (48)
Denny Ye (44)
Jeff Lord (38)
Israel Ekpo (36)
Mubarak Seyed (32)
Ashish Paliwal (31)
Jarek Jarcec Cecho (30)
Ashish (27)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Edward Sargisson (19)
Patrick Hunt (19)
Patrick Wendell (19)
Dani Abel Rayan (17)
DSuiter RDX