I’m getting messages through SyslogUDP and storint them on HDFS. But data at the end is not separated by \n as I would expect Reslut is stored without \n thus makes it hard to further process with standard tool set # flume config tier1.sources.sourceDHCP_Raw.type = syslogudp tier1.sources.sourceDHCP_Raw.host = 0.0.0.0 tier1.sources.sourceDHCP_Raw.port = 5141
I tried that with serializer type, but that did not help. What actually saved my day was adding:
tier1.sinks.sinkDHCP_Raw.hdfs.writeFormat = Text tier1.sinks.sinkDHCP_Raw.hdfs.fileType = DataStream
From: Jeff Lord [mailto:[EMAIL PROTECTED]] Sent: 2014.06.05 19:51 To: [EMAIL PROTECTED] Subject: Re: HDFS not adding \n
Can you try adding this line to your config?
tier1.sinks.sinkDHCP_Raw.serializer = text
Tadas Makčinskas 2014-06-06, 10:59
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext