Gary Malouf 2013-03-14, 21:54
-Re: Writing to HDFS from multiple HDFS agents (separate machines)
Mohammad Tariq 2013-03-14, 22:00
One idea could be to create the sub directories with the machines'
hostnames, in case you are getting data from multiple sources. you can
easily find out which data belongs to which machine then.
On Fri, Mar 15, 2013 at 3:24 AM, Gary Malouf <[EMAIL PROTECTED]> wrote:
> Hi guys,
> I'm new to flume (hdfs for that metter), using the version packaged with
> CDH4 (1.3.0) and was wondering how others are maintaining different file
> names being written to per HDFS sink.
> My initial thought is to create a separate sub-directory in hdfs for each
> sink - though I feel like the better way is to somehow prefix each file
> with a unique sink id. Are there any patterns that others are following
> for this?
Seshu V 2013-03-15, 21:20
Paul Chavez 2013-03-14, 22:31
Gary Malouf 2013-03-14, 22:34
Mike Percy 2013-03-15, 01:46
Gary Malouf 2013-03-15, 02:30
Gary Malouf 2013-03-15, 02:42
Mike Percy 2013-03-15, 20:43
Paul Chavez 2013-03-15, 03:30