Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Flume and HDFS integration


+
Emile Kao 2012-11-29, 17:14
+
Brock Noland 2012-11-29, 17:18
Copy link to this message
-
Re: Flume and HDFS integration
Roman Shaposhnik 2012-11-30, 01:17
On Thu, Nov 29, 2012 at 9:18 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
> HI,
>
> 1) It's a sequence file, you can change it a text file if you want. See
> FileType here http://flume.apache.org/FlumeUserGuide.html#hdfs-sink

Don't you also have to change a serialization format to get rid of the binary
structure completely? IOW, you'd have to add something like:
    agent.sinks.hdfsSink.hdfs.serializer org.apache.flume.serialization.BodyTextEventSerializer
?

Thanks,
Roman.
+
Brock Noland 2012-11-30, 01:26
+
Emile Kao 2012-11-30, 08:51
+
Roman Shaposhnik 2012-12-01, 00:40
+
Brock Noland 2012-11-30, 12:40
+
Emile Kao 2012-12-03, 09:51