Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> writing logs to HDFS


Copy link to this message
-
Re: writing logs to HDFS
Look at the 'roll' properties of the HDFS sink. You can roll by size, time,
events, or you can set those to 0 and only roll by your path.

http://flume.apache.org/FlumeUserGuide.html#hdfs-sink

- Connor
On Mon, Jan 14, 2013 at 9:51 PM, Chhaya Vishwakarma <
[EMAIL PROTECTED]> wrote:

>  Hi,****
>
> ** **
>
> When flume writes logs to HDFS it creates many small files of single log
> file. Can I write logs to HDFS only in file ? ****
>
> ** **
>
> ** **
>
> Regards,****
>
> Chhaya Vishwakarma****
>
> ** **
>
> ** **
>
> ** **
>
> ------------------------------
> The contents of this e-mail and any attachment(s) may contain confidential
> or privileged information for the intended recipient(s). Unintended
> recipients are prohibited from taking action on the basis of information in
> this e-mail and using or disseminating the information, and must notify the
> sender and delete it from their system. L&T Infotech will not accept
> responsibility or liability for the accuracy or completeness of, or the
> presence of any virus or disabling code in this e-mail"
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB