Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Flume and HDFS integration

Copy link to this message
Re: Flume and HDFS integration

On Thu, Nov 29, 2012 at 7:17 PM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:
> On Thu, Nov 29, 2012 at 9:18 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
>> 1) It's a sequence file, you can change it a text file if you want. See
>> FileType here http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
> Don't you also have to change a serialization format to get rid of the binary
> structure completely? IOW, you'd have to add something like:
>     agent.sinks.hdfsSink.hdfs.serializer > org.apache.flume.serialization.BodyTextEventSerializer

BodyTextEventSerializer is the default serializer. Serializers decide
how to turn Events into records while fileType decides what type of
file the event is written to.