Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> send the whole logs


Copy link to this message
-
Re: send the whole logs
Hi David,

I'm using Syslog UDP source and on the syslog messages it have it's
timestamp for each message. I also use HDFS sink, but when I saw the result
message on HDFS folder, it doesn't have the timestamp (date) info.

Thanks,

Martinus
On Tue, Oct 8, 2013 at 9:01 PM, David Sinclair <
[EMAIL PROTECTED]> wrote:

> Martinus,
>
> Can you give a little more details? It sounds like you want to use the
> Spooling Directory Source,
> http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source,
> but if you can be clearer about your requirements, I may be able to help
> you better.
>
> dave
>
>
> On Tue, Oct 8, 2013 at 6:45 AM, Martinus m <[EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> What configurations should I put on flume.conf to get the whole logs
>> message to be put into the sink?
>>
>> Thanks.
>>
>> Martinus
>>
>
>