| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
72 (0.109s).
|
|
|
Loading phrases to help you refine your search...
|
|
[FLUME-1445] Multiple Sinks can connect to single Channel - Flume - [issue]
|
|
...If we has one Channel (mc) and two Sinks (hsa, hsb), then they may be connected with each other with configuration exampleagent.sinks.hsa.channel = mcagent.sinks.hsb.channel = mcIt means tha...
|
|
|
http://issues.apache.org/jira/browse/FLUME-1445
Author: Denny Ye,
2012-09-07, 00:25
|
|
|
Re: How to use LZO in Flume-ng - Flume - [mail # user]
|
|
...'com.hadoop.compression.lzo.LzoCodec' is one of extension for 'org.apache.hadoop.io.compress.CompressionCodec' 2012/8/28 Denny Ye 1-splittable-lzo-compression/%5D> to y ative...
|
|
|
Author: Denny Ye,
2012-08-28, 07:28
|
|
|
Re: How to use LZO in Flume-ng - Flume - [mail # user]
|
|
...hi Kevin, I applied for LZO successfully. I will post my LZO configuration, you can compare the difference. 1. agent.sinks.hdfsSin1.hdfs.codeC = com.hadoop....
|
|
|
Author: Denny Ye,
2012-08-28, 07:21
|
|
|
Re: About event's size - Flume - [mail # user]
|
|
...hi Yanzhi, What's exception or failure log from your case. There is no size limitation at Flume event. Wish your feedback with more information. Thanks -Regar...
|
|
|
Author: Denny Ye,
2012-08-28, 03:04
|
|
|
Re: 答复: HDFS SINK Performacne - Flume - [mail # user]
|
|
...20MB/min or 20MB/sec? I doubt that it may have presentation mistake. Can you confirm it? -Regards Denny Ye 2012/8/28 Shara Shi e ==================**** bdata/exec/%Y/%m/%d...
|
|
|
Author: Denny Ye,
2012-08-28, 03:02
|
|
|
Re: HDFS SINK Performacne - Flume - [mail # user]
|
|
...hi Shara, You are using MemoryChannel as repository. I tested it with outcomes: 45MB/sec without full GC in local updated code. Is this your goal? or more high throughput? &nbs...
|
|
|
Author: Denny Ye,
2012-08-27, 12:04
|
|
|
Re: Flume hdfs sink rollover - Flume - [mail # user]
|
|
...Yes, you are right. Flume uses uncompressed size to judge the case of rolling. The appropriate place to calculate size is in-memory. Normally, compression ratio of snappy might be 5x-10x, mo...
|
|
|
Author: Denny Ye,
2012-08-27, 01:29
|
|
|
Re: Flume hdfs sink rollover - Flume - [mail # user]
|
|
...hi Mohit, Why you confirm it doesn't work at time? I think it reaches to size limitation of your setting 'hdfs.rollSize'. Each snappy file almost 5 hundreds megabyt...
|
|
|
Author: Denny Ye,
2012-08-26, 13:47
|
|
|
Re: About flume compress - Flume - [mail # user]
|
|
...hi Yanzhi, What's the means of 'Compressed event'? Do you mention the compressed body of event? Content of body in each event is determined by yoursel...
|
|
|
Author: Denny Ye,
2012-08-24, 09:49
|
|
|
[FLUME-1382] Flume adopt message from existing local Scribe - Flume - [issue]
|
|
...Currently, we are using Scribe in data ingest system. Central Scribe is hard to maintain and upgrade. Thus, we would like to replace central Scribe with Flume and adopt message from existing...
|
|
|
http://issues.apache.org/jira/browse/FLUME-1382
Author: Denny Ye,
2012-08-24, 05:09
|
|
|
|