| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
22 (2.73s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...Just a quick followup on this....I moved all the logging, etc to the same drive/device and I'm no longer seeing those permission errors!. I'm going to keep testing this week. Th...
|
|
|
Author: Dan Young,
2012-11-20, 20:03
|
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...Ahh...thank you. Let me check some things and make some changes.... On Tue, Nov 20, 2012 at 10:14 AM, Brock Noland wrote: ...
|
|
|
Author: Dan Young,
2012-11-20, 17:17
|
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...This is running on an EC2 instance, and these are the ephemeral drive(s). Filesystem 1K-blocks Used Available Use% Mounted on /dev/xvda1 ...
|
|
|
Author: Dan Young,
2012-11-20, 17:10
|
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...Coolio, thank you Brock. Did a quick test with a mv vs cp.....this is one test, repeated a few times....the smaller file (~60M) seemed to work fine w/ a mv, but a larger file we're see...
|
|
|
Author: Dan Young,
2012-11-20, 16:59
|
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...Hey Brock, I can do some more testing on my side with smaller files as well as doing a mv vs a cp . I do believe that a slight delay would be helpful since people will be moving/copyin...
|
|
|
Author: Dan Young,
2012-11-20, 15:02
|
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...Hello Brock, It seems like we get this message each time that logrotate runs and is in the process of copying the file to the SpoolingDirectory. It seems that Flume starts reading the ...
|
|
|
Author: Dan Young,
2012-11-19, 19:33
|
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...logrotate config, in /etc/logrotate.d, ran from cron.hourly. /var/log/clickstream/clickstream.log { missingok rotate 3 compress delaycompress copytru...
|
|
|
Author: Dan Young,
2012-11-17, 16:33
|
|
|
Re: .SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...Hey Brock, No I have not modified the conf while the agent was running. /mnt/flume is local. Note that this is running on an ec2 instance and the disk is the ephemeral drive, not...
|
|
|
Author: Dan Young,
2012-11-17, 16:01
|
|
|
.SpoolingFileLineReader warning.... - Flume - [mail # user]
|
|
...First a bit of context, I'm using logrotate to monitor and copy (cp -p) log files to a flume spooling directory source. So every hour, logrotate checks for and copies a file from the s...
|
|
|
Author: Dan Young,
2012-11-17, 15:02
|
|
|
Re: flume-ng script error... - Flume - [mail # user]
|
|
...Hey Brock, That was it. I took that out of the hadoop-env.sh and now we're laughin' ! Thank you. Regards, Dano On Thu, Nov 15, 2012 at 10:33 AM, Brock No...
|
|
|
Author: Dan Young,
2012-11-15, 18:00
|
|
|
|
