| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
47 (0.073s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Recommendation of parameters for better performance with File Channel - Flume - [mail # user]
|
|
...I am using latest release of flume. (Flume 1.3.0) and hadoop 1.0.3. On 12/12/2012 03:35 PM, Jagadish Bihani wrote:...
|
|
|
Author: Jagadish Bihani,
2012-12-12, 10:08
|
|
|
Recommendation of parameters for better performance with File Channel - Flume - [mail # user]
|
|
...Hi I am able to write maximum 1.5 MB/sec data to HDFS (without compression) using File Channel. Are there any recommendations to improve the performance? Has anybody achieved aro...
|
|
|
Author: Jagadish Bihani,
2012-12-12, 10:05
|
|
|
Re: Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
|
|
...Hi Mike Thanks for the valuable inputs. That was driving us crazy. But I had tested that this issue doesn't happen with compression format lzo/lzop (tested on hadoop 1.0.3). &nb...
|
|
|
Author: Jagadish Bihani,
2012-11-03, 11:32
|
|
|
Re: Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
|
|
...Hi Any inputs on this? It looks like a basic thing which, I guess, must have been handled in flume On 10/30/2012 10:31 PM, Jagadish Bihani wrote: ...
|
|
|
Author: Jagadish Bihani,
2012-11-02, 07:50
|
|
|
Re: Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
|
|
...Text. Few updates on that: map reduce job processes the the file correctly then. Is it something related to https://issues.apache.org/jira/browse/HADOOP-6852? Regards, Jaga...
|
|
|
Author: Jagadish Bihani,
2012-10-30, 17:01
|
|
|
Re: Flume compression peculiar behaviour while processing compressed files by a map reduce job - Flume - [mail # user]
|
|
...Does anyone have any inputs about why below mentioned behaviour might have happened? On 10/26/2012 06:32 PM, Jagadish Bihani wrote:...
|
|
|
Author: Jagadish Bihani,
2012-10-30, 03:06
|
|
|
Re: Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
|
|
...Same thing happens even for gzip. Regards, Jagadish On 10/26/2012 04:30 PM, Jagadish Bihani wrote:...
|
|
|
Author: Jagadish Bihani,
2012-10-26, 13:02
|
|
|
Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
|
|
...Hi I have a very peculiar scenario. 1. My HDFS sink creates a bz2 file. File is perfectly fine I can decompress it and read it. It has 0.2 million records. 2. Now I ...
|
|
|
Author: Jagadish Bihani,
2012-10-26, 11:00
|
|
|
Re: File Channel performance and fsync - Flume - [mail # user]
|
|
...Hi Brock I am using flume 1.2.0. About the batching : as per user guide "exec source" does have batch option in 1.2.0 (param name: batchSize and default value:20) and I hav...
|
|
|
Author: Jagadish Bihani,
2012-10-23, 06:40
|
|
|
Re: File Channel performance and fsync - Flume - [mail # user]
|
|
...Hi Denny Thanks for the inputs. Btw when you say you tested another case without 'fsync'; I think you changed the file channel code to comment out 'flush' part of it. And if we rely on...
|
|
|
Author: Jagadish Bihani,
2012-10-23, 06:31
|
|
|
|
