Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 8 from 8 (0.105s).
Loading phrases to help you
refine your search...
Re: Downsides of not using any sink groups - Flume - [mail # user]
...In my case the sinks are pointing to a group of machines so one of these may go down leaving others running. Without sink groups in this case there will not be no backoff but seems that it w...
   Author: Pankaj Gupta, 2013-08-23, 07:46
Re: Architectural questions - Flume - [mail # user]
...Hi Hari,  Just curios about the performance improvement, can you provide the number of the JIRA that improves performance in 1.3.1?  Thanks, Pankaj   On Wed, Aug 14, 2013 at 2...
   Author: Pankaj Gupta, 2013-08-18, 05:50
Re: Lock contention in FileChannel - Flume - [mail # user]
...Just to provide an update here. With sink groups removed and using two dataDirs per disk, total of 32 avro sinks, I am able to get reasonable throughput of up to 100 Mbps. @brock thanks for ...
   Author: Pankaj Gupta, 2013-08-18, 04:43
Re: Configuring flume for better throughput - Flume - [mail # user]
...Also, agent1.sinks.hdfs-sink1-1.hdfs.threadsPoolSize = 1, might seem odd but we only write to one file on HDFS per sink, so 1 seems to be the right value. In any case, I've tried increasing ...
   Author: Pankaj Gupta, 2013-08-01, 02:24
Flume HDFS Sink using indexed LZO - Flume - [mail # user]
...Hi,  Is it possible to have Flume HDFS Sink write to HDFS in indexed LZO format. I see in documentation that there is support for LZO but is that LZO indexed. My use case is to write in...
   Author: Pankaj Gupta, 2012-12-06, 19:04
Re: Throughput of HDFSSink - Flume - [mail # user]
...Wow, with StressSource I am able to get ~6000 events/sec per flow, which matches the benchmark here: https://cwiki.apache.org/FLUME/flume-ng-syslog-stress-test-2012-04-28.html  Thanks f...
   Author: Pankaj Gupta, 2012-11-09, 19:27
Re: HDFS Sink log rotation on the basis of time of writing - Flume - [mail # user]
...Hi Brock,  But then if I rotate frequently e.g. every minute, the total number of files in a single folder of HDFS will go into thousands very quickly. I am not sure how/if that will af...
   Author: Pankaj Gupta, 2012-11-05, 15:49
Failover in Flume NG - Flume - [mail # user]
...Hi,   We are investigating using Flume for log aggregation in our organization and have this dilemma over going with Flume NG or OG. We really like the centralized configuration managem...
   Author: Pankaj Gupta, 2012-10-16, 17:09
Sort:
project
Flume (8)
HBase (4)
MapReduce (4)
Pig (3)
Kafka (2)
Zookeeper (1)
type
mail # user (8)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (8)
author
Hari Shreedharan (389)
Jonathan Hsieh (365)
Mike Percy (277)
Brock Noland (228)
Disabled imported user (213)
E. Sammer (112)
Roshan Naik (96)
Will McQueen (91)
Alexander Alten-Lorenz (90)
Arvind Prabhakar (81)
Juhani Connolly (54)
Bruce Mitchener (48)
Denny Ye (44)
Jeff Lord (37)
Israel Ekpo (36)
Ashish Paliwal (32)
Mubarak Seyed (32)
Jarek Jarcec Cecho (30)
Prasad Mujumdar (25)
Ashish (24)
Nicholas Verbeck (20)
Patrick Hunt (19)
Patrick Wendell (19)
Edward Sargisson (18)
Dani Abel Rayan (17)
Pankaj Gupta