Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 11 (0.077s).
Loading phrases to help you
refine your search...
Re: HDFS Sink Memory Leak - Flume - [mail # user]
...David,  It was a mix. Our test pipeline is what would euphemistically be called "low-velocity" when it comes to data. When we experimented with rollInterval, we found a lot of lingering...
   Author: DSuiter RDX, 2013-11-11, 18:29
Collecting WINDOWS event viewer logs? - Flume - [mail # user]
...Hi all,  I've been using the rsyslog TCP forwarding feature to collect syslogs with syslogTCP source from a linux server, and it is working well.  We are now attempting to get a si...
   Author: DSuiter RDX, 2013-11-06, 16:16
Preserving origin syslog information - Flume - [mail # user]
...Hi, just a general behavioral question.  We have a syslogTCP source catching remotely generated syslog events. They got to an Avro sink, which delivers them to an Avro source, then into...
   Author: DSuiter RDX, 2013-10-30, 15:11
Re: Use flume to copy data in local directory (hadoop server) into hdfs - Flume - [mail # user]
...Luu,  You might want to set up some redundant/load-balancing channels and sinks, so if one sink is tied up, the operation can be attempted on another sink. I am not very experienced wit...
   Author: DSuiter RDX, 2013-10-24, 17:57
Re: Problem setting the rollInterval for HDFS sink - Flume - [mail # user]
...I get that sometimes, but usually when the HDFS sink header interpreters make a new directory or the file rolls. I have some .tmp files that are from 2 weeks ago - the agent that wrote them ...
   Author: DSuiter RDX, 2013-10-24, 17:46
Re: Roll based on date - Flume - [mail # user]
...Martinus, you have to set all the other roll options to 0 explicitly in the configuration if you want them only to roll on one parameter, it will take the shortest working parameter it can m...
   Author: DSuiter RDX, 2013-10-22, 15:16
Extra information being delivered via Flume - Flume - [mail # user]
...Hi all,  We set up a pipeline to get rsyslog input from a remote server via TCP using rsyslog remote TCP forwarding functionality. The data gets sent from the server to a syslogTCP sour...
   Author: DSuiter RDX, 2013-10-10, 18:56
Re: How to read multiples files getting continuously updated - Flume - [mail # user]
...Abhijeet,  The built-in Avro client might be good to look into. In my experience, it grabs what is in a directory and converts it to Avro format to send to a Flume Avro source, which ca...
   Author: DSuiter RDX, 2013-10-10, 11:46
Re: Shutdown metric question - Flume - [mail # user]
...Thanks Hari, that was what I was hoping to hear. Based on the first two lines, that was what I had expected, but wanted to confirm before trusting anything of value to the agent recipe as it...
   Author: DSuiter RDX, 2013-10-09, 12:40
Re: Problem aggregating syslogTCP > avro > HDFS - Flume - [mail # user]
...Ok, I just realized that I am missing a 0 on the rollSize, and it is probably doing exactly what it is supposed to since I told it close the file at 3 KB not 3 MB...  Sorry everyone! &n...
   Author: DSuiter RDX, 2013-10-07, 16:12
Sort:
project
Flume (11)
MapReduce (5)
Sqoop (2)
Avro (1)
Hadoop (1)
type
mail # user (11)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (6)
last 9 months (11)
author
Hari Shreedharan (370)
Jonathan Hsieh (365)
Mike Percy (272)
Brock Noland (225)
Disabled imported user (213)
E. Sammer (112)
Will McQueen (91)
Alexander Alten-Lorenz (90)
Roshan Naik (86)
Arvind Prabhakar (79)
Juhani Connolly (54)
Bruce Mitchener (48)
Denny Ye (44)
Israel Ekpo (36)
Jeff Lord (32)
DSuiter RDX