| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
27 (5.221s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Recommendation of parameters for better performance with File Channel - Flume - [mail # user]
|
|
...Hari, If each sink uses a different file prefix, what's the need to write to multiple HDFS directories. All our sinks write to the same HDFS directory and each uses a unique file prefix, and...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-12-12, 21:13
|
|
|
Re: HDFS Sink keeps .tmp files and closes with exception - Flume - [mail # user]
|
|
...Hari, There are 2 sides to this problem, The flume side issue was fixed in 1.2.0, FLUME-1163. But the solution in FLUME-1163, requires that the Hadoop Libraries used with flume, support the ...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-10-19, 23:42
|
|
|
Re: HDFS Sink keeps .tmp files and closes with exception - Flume - [mail # user]
|
|
...Use CDH3u5 hadoop distribution. 1.x don't handle client JVM shutdown's correctly. Search the mail threads with my name, you'll find more answers. But you've no choice but to use Cloude...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-10-18, 22:39
|
|
|
Re: syslog source - sinks without datetime/hostname - Flume - [mail # user]
|
|
...Roshan, The problem is not at the event end, it's at the serializer end. The BodyTextSerializer which is the default, does not serialize the headers, so no matter what headers you have or do...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-10-16, 23:24
|
|
|
Re: FlumeNG and ElasticSearch Integration - Flume - [mail # user]
|
|
...You can write your own sink, or another approach is flume -> some messaging sink -> es (via a river) e.g. flume -> rabbitMQ (Search github for flume-rabbitmq-sink) and u...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-09-13, 16:16
|
|
|
Re: HDFS sink leaves .tmp files - Flume - [mail # user]
|
|
...Don't know about RPM, but there's a 1.2.x tarball of the 1.2 build @ http://archive.cloudera.com/cdh/3/flume-ng-1.2.0-cdh3u5.tar.gz On Mon, Sep 10, 2012 at 3:01 PM, Chris Neal wr...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-09-10, 20:08
|
|
|
Re: Flume (NG?) with S3 Sink? - Flume - [mail # user]
|
|
...There's a project over at Github https://github.com/Hobsons/hobsons-flumeng-s3-sink haven't tried it myself though. On Tue, Aug 28, 2012 at 5:29 PM, Julian Henry Alcala wrote: ...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-08-28, 21:42
|
|
|
Re: At flume shutdown only one HDFSSink is closed properly - Flume - [mail # user]
|
|
...Hi Mike, There are indeed Jira issues for this. A flume jira issue , which was fixed in 1.2.0. FLUME-1163. But that is only half the story, the hadoop jira issue for supporting t...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-08-27, 14:53
|
|
|
Re: At flume shutdown only one HDFSSink is closed properly - Flume - [mail # user]
|
|
...oops, this is just the same Hadoop's FileSystem.close() shutdown hook issue. I was getting the exception no matter whether I had 1 HDFS sink or more. I was using hadoop vanilla 1.0.3, and lo...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-08-24, 19:13
|
|
|
Re: Proper documentation for setting up sink groups - Flume - [mail # user]
|
|
...Some really insightful explanations Hari, thanks for the insight. Btw, I do feel all this should be in flume user guide for the greater good of mankind :) On Thu, Aug 23, 2012 a...
|
|
|
Author: Bhaskar V. Karambelkar,
2012-08-23, 22:55
|
|
|
|
