Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Flume and HDFS integration


Copy link to this message
-
Re: Flume and HDFS integration
On Thu, Nov 29, 2012 at 9:18 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
> HI,
>
> 1) It's a sequence file, you can change it a text file if you want. See
> FileType here http://flume.apache.org/FlumeUserGuide.html#hdfs-sink

Don't you also have to change a serialization format to get rid of the binary
structure completely? IOW, you'd have to add something like:
    agent.sinks.hdfsSink.hdfs.serializer org.apache.flume.serialization.BodyTextEventSerializer
?

Thanks,
Roman.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB