Kafka, mail # user - S3 Consumer - 2012-12-27, 09:42
 Search Hadoop and all its subprojects:

Switch to Plain View
Hi,

I am looking for a S3 based consumer, which can write all the received
events to S3 bucket (say every minute). Something similar to Flume HDFSSink
http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
I have tried evaluating hadoop-consumer in contrib folder. But it seems to
be more for offline processing, which will fetch everything from offset 0
at once and replace it in S3 bucket.
Any help would be appreciated ?

Pratyush Chandra

 
+
David Arthur 2012-12-27, 15:08
+
Pratyush Chandra 2012-12-28, 13:57
+
Matthew Rathbone 2012-12-28, 14:32
+
Pratyush Chandra 2012-12-28, 15:22
+
Liam Stewart 2012-12-28, 16:06
+
Russell Jurney 2012-12-28, 23:46
+
Chetan Conikee 2012-12-29, 06:15
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB