| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
55 (0.065s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: hdfs.idleTimeout ,what's it used for ? - Flume - [mail # user]
|
|
...@Mohit: For the HDFS Sink, the tmp files are placed based on the hadoop.tmp.dir property. The default location is /tmp/hadoop-${user.name} To change this you can add -Dhadoop.tmp.dir= ...
|
|
|
Author: Connor Woodson,
2013-01-18, 02:20
|
|
|
Re: hdfs.idleTimeout ,what's it used for ? - Flume - [mail # user]
|
|
...Whether idleTimeout is lower or higher than rollInterval is a preference; set it before, and assume you get one message right on the turn of the hour, then you will have some part of that ho...
|
|
|
Author: Connor Woodson,
2013-01-18, 02:19
|
|
|
Re: hdfs.idleTimeout ,what's it used for ? - Flume - [mail # user]
|
|
...the rollInterval will still cause the last 01-17 file to be closed eventually. The way the HDFS sink works with the different files is each unique path is specified by a different BucketWrit...
|
|
|
Author: Connor Woodson,
2013-01-17, 20:29
|
|
|
Re: EventDrivenSource and dead threads - Flume - [mail # dev]
|
|
...I don't know if this is within the scope of this change, but sinks sometimes will need to be restarted; for instance, I had an HDFS sink crash from an Out of Memory error (caused by the JIRA...
|
|
|
Author: Connor Woodson,
2013-01-17, 08:54
|
|
|
Re: EventDrivenSource and dead threads - Flume - [mail # dev]
|
|
...What I was trying to say is that the ScribeSource should not be responsible for restarting itself (just from my understanding of your idea; it breaks the existing paradigm as components shou...
|
|
|
Author: Connor Woodson,
2013-01-17, 07:02
|
|
|
Re: EventDrivenSource and dead threads - Flume - [mail # dev]
|
|
...Why limit it to the sources? If there is going to be a change to one component's lifecycle, then I see no reason not to change every component's lifecycle. Sinks and Channels could ver...
|
|
|
Author: Connor Woodson,
2013-01-17, 06:01
|
|
|
Re: writing logs to HDFS - Flume - [mail # user]
|
|
...Look at the 'roll' properties of the HDFS sink. You can roll by size, time, events, or you can set those to 0 and only roll by your path. http://flume.apache.org/FlumeUserGuide.html#hd...
|
|
|
Author: Connor Woodson,
2013-01-15, 05:59
|
|
|
Re: Unable to activate flume-ng-cassandra-sink - Flume - [mail # user]
|
|
...The reason I don't recommend using it is that I didn't know it existed :P That seems like a great place to put it. I've done quite a bit of customization, so for me it's easier to just...
|
|
|
Author: Connor Woodson,
2013-01-15, 02:17
|
|
|
Re: Unable to activate flume-ng-cassandra-sink - Flume - [mail # user]
|
|
...Leave the Cassandra sink jar with its other jars in a folder some where. In FLUME_HOME/conf, open flume-env.sh and go to the FLUME_CLASSPATH line. Uncomment it if needed. Append the path to ...
|
|
|
Author: Connor Woodson,
2013-01-15, 02:06
|
|
|
Re: Question about gzip compression when using Flume Ng - Flume - [mail # user]
|
|
...Is there any incompatibility in trying to write to a different version of Hadoop then? - Connor On Mon, Jan 14, 2013 at 5:25 PM, Bhaskar V. Karambelkar <[EMAIL PROTECTED] &nb...
|
|
|
Author: Connor Woodson,
2013-01-15, 01:26
|
|
|
|
