Nitin Pawar 2012-09-18, 08:32
-Re: doubt on hdfs sink
Nitin Pawar 2012-09-18, 09:02
I got this working by setting all the properties
Also realized, rollSize is after decompression
On Tue, Sep 18, 2012 at 2:02 PM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
> I have a working setup of flume which writes into hdfs.
> I am using flum 1.2.0
> I have following settings.
> agent1.sinks.HDFS.hdfs.file.Type = SequenceFile
> agent1.sinks.HDFS.hdfs.writeFormat = Text
> agent1.sinks.hdfs.rollInterval = 86400
> agent1.channels.MemoryChannel-2.type = memory
> My doubt is, why does flume creates one hdfs file for one event. I
> want it to write a single hdfs file per day for the log.
> Can someone please help me find out what I have done wrong?
> Nitin Pawar