Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> S3 source


+
Roman Shaposhnik 2012-08-24, 00:06
Copy link to this message
-
Re: S3 source
Roman,
I haven't seen an implementation floating around, but I would love to get
support for an S3 Source into Flume!

Regards,
Mike

On Thu, Aug 23, 2012 at 5:06 PM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:

> Hi!
>
> I have, what I would imagine, is a pretty common use case -- a bunch of S3
> buckets with access logging enabled. S3 is nice in a sense that the logging
> for the bucket all goes back to a bucket of your choice, but of course, I
> really
> want this data in HDFS so I can analyze it.
>
> Is there a flume source that can help me here? I couldn't find one.
>
> Thanks,
> Roman.
>
+
Mubarak Seyed 2012-08-24, 00:50
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB