Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 8 from 8 (0.129s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Downsides of not using any sink groups - Flume - [mail # user]
...In my case the sinks are pointing to a group of machines so one of these may go down leaving others running. Without sink groups in this case there will not be no backoff but seems that it w...
   Author: Pankaj Gupta, 2013-08-23, 07:46
Re: Architectural questions - Flume - [mail # user]
...Hi Hari,  Just curios about the performance improvement, can you provide the number of the JIRA that improves performance in 1.3.1?  Thanks, Pankaj   On Wed, Aug 14, 2013 at 2...
   Author: Pankaj Gupta, 2013-08-18, 05:50
[expand - 12 more] - Re: Lock contention in FileChannel - Flume - [mail # user]
...I am getting very good performance by removing the groups altogether and keeping a high number of total sinks (64). If I organize sinks into groups of 4 I loose parallelism and don't get as ...
   Author: Pankaj Gupta, 2013-08-15, 06:04
[expand - 4 more] - Re: Configuring flume for better throughput - Flume - [mail # user]
...Also, agent1.sinks.hdfs-sink1-1.hdfs.threadsPoolSize = 1, might seem odd but we only write to one file on HDFS per sink, so 1 seems to be the right value. In any case, I've tried increasing ...
   Author: Pankaj Gupta, 2013-08-01, 02:24
Flume HDFS Sink using indexed LZO - Flume - [mail # user]
...Hi,  Is it possible to have Flume HDFS Sink write to HDFS in indexed LZO format. I see in documentation that there is support for LZO but is that LZO indexed. My use case is to write in...
   Author: Pankaj Gupta, 2012-12-06, 19:04
[expand - 2 more] - Re: Throughput of HDFSSink - Flume - [mail # user]
...Wow, with StressSource I am able to get ~6000 events/sec per flow, which matches the benchmark here: https://cwiki.apache.org/FLUME/flume-ng-syslog-stress-test-2012-04-28.html  Thanks f...
   Author: Pankaj Gupta, 2012-11-09, 19:27
[expand - 1 more] - Re: HDFS Sink log rotation on the basis of time of writing - Flume - [mail # user]
...Hi Brock,  But then if I rotate frequently e.g. every minute, the total number of files in a single folder of HDFS will go into thousands very quickly. I am not sure how/if that will af...
   Author: Pankaj Gupta, 2012-11-05, 15:49
[expand - 1 more] - Failover in Flume NG - Flume - [mail # user]
...Hi,   We are investigating using Flume for log aggregation in our organization and have this dilemma over going with Flume NG or OG. We really like the centralized configuration managem...
   Author: Pankaj Gupta, 2012-10-16, 17:09
Sort:
project
Flume (8)
HBase (4)
MapReduce (4)
Pig (3)
Kafka (2)
Zookeeper (1)
type
mail # user (8)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (8)
author
Jonathan Hsieh (365)
Hari Shreedharan (331)
Disabled imported user (213)
Mike Percy (204)
Brock Noland (164)
E. Sammer (112)
Roshan Naik (99)
Will McQueen (87)
Arvind Prabhakar (83)
Alexander Alten-Lorenz (61)
Bruce Mitchener (48)
Juhani Connolly (47)
Denny Ye (44)
Jeff Lord (38)
Ashish (36)
Israel Ekpo (31)
Mubarak Seyed (30)
Jarek Jarcec Cecho (29)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Otis Gospodnetic (19)
Patrick Hunt (19)
Patrick Wendell (19)
Dani Abel Rayan (17)
Wolfgang Hoschek (17)
Pankaj Gupta