Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> S3 source

Copy link to this message
Re: S3 source
I haven't seen an implementation floating around, but I would love to get
support for an S3 Source into Flume!


On Thu, Aug 23, 2012 at 5:06 PM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:

> Hi!
> I have, what I would imagine, is a pretty common use case -- a bunch of S3
> buckets with access logging enabled. S3 is nice in a sense that the logging
> for the bucket all goes back to a bucket of your choice, but of course, I
> really
> want this data in HDFS so I can analyze it.
> Is there a flume source that can help me here? I couldn't find one.
> Thanks,
> Roman.