| clear query|facets|time |
Search criteria: .
Results from 41 to 50 from
146 (0.096s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: hdfs.idleTimeout ,what's it used for ? - Flume - [mail # user]
|
|
...I lined up why it was happening in FLUME-1850 He has hourly rolls, a 4000 interval and a 900 idle. After an hour 400 remains on the interval. So the interval gets triggered...
|
|
|
Author: Juhani Connolly,
2013-01-18, 02:39
|
|
|
Re: hdfs.idleTimeout ,what's it used for ? - Flume - [mail # user]
|
|
...It's also useful if you want files to get promptly closed and renamed from the .tmp or whatever. We use it with something like 30seconds setting(we have a constant stream o...
|
|
|
Author: Juhani Connolly,
2013-01-18, 02:08
|
|
|
Re: EventDrivenSource and dead threads - Flume - [mail # dev]
|
|
...What I described isn't really taking control of lifecycle. What would happen is: - source start. State=start - OOM exception happens - getLifecycleState called, override calls server.i...
|
|
|
Author: Juhani Connolly,
2013-01-17, 08:27
|
|
|
Re: EventDrivenSource and dead threads - Flume - [mail # dev]
|
|
...Sink, Source and Channel all extend LifecycleAware, so the function is available to all components already. I was more questioning whether it was reasonable to start including &n...
|
|
|
Author: Juhani Connolly,
2013-01-17, 06:21
|
|
|
Re: EventDrivenSource and dead threads - Flume - [mail # dev]
|
|
...Hmm, overriding the implementation of getLifecycleState provided by AbstractSource could work. It would be going against the convention that has been maintained in all other comp...
|
|
|
Author: Juhani Connolly,
2013-01-17, 05:08
|
|
|
EventDrivenSource and dead threads - Flume - [mail # dev]
|
|
...I came upon an issue with ScribeSource, though it's theoretically applicable to any EventDrivenSource whose event generating thread(s) die. Simple put, sending a bad packet...
|
|
|
Author: Juhani Connolly,
2013-01-17, 03:45
|
|
|
Re: Exceptions after reloading configuration - Flume - [mail # user]
|
|
...I hadn't noticed that patch, looks useful! Was mainly referring to 1.2 where hot reconfiguration certainly wasn't reliable. So I guess Sam is looking at either upgrading(re...
|
|
|
Author: Juhani Connolly,
2013-01-17, 02:36
|
|
|
Re: Exceptions after reloading configuration - Flume - [mail # user]
|
|
...Switching configuration on a running node is pretty buggy, I would recommend just restarting flume, as while sometimes it will work there are issues like components not getting p...
|
|
|
Author: Juhani Connolly,
2013-01-17, 02:11
|
|
|
Re: OutOfMemory - Flume - [mail # user]
|
|
...How big are your events? 10000 capacity doesn't seem like it should run into any issues, but since it is all on memory, it's possible your channel is eating up all your mem...
|
|
|
Author: Juhani Connolly,
2013-01-17, 02:06
|
|
|
Re: Memory Channel - Flume - [mail # user]
|
|
...The channel is a temporary storage device that decouples the source from the sink. Adding and removing data to it are achieved with transactions that either put or take one...
|
|
|
Author: Juhani Connolly,
2013-01-17, 02:00
|
|
|
|
