Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> strange flume hdfs put


Copy link to this message
-
strange flume hdfs put
hello,
I put some data to hdfs via flume 1.3.1,but it changed!

source data:
[zhouhh@Hadoop47 ~]$  echo "<13>Mon Feb 18 18:25:26 2013 hello world zhh "
| nc -v hadoop48 5140
Connection to hadoop48 5140 port [tcp/*] succeeded!

the flume agent received:
13/02/19 10:43:46 INFO hdfs.BucketWriter: Creating
hdfs://Hadoop48:54310/flume//FlumeData.1361241606972.tmp
13/02/19 10:44:16 INFO hdfs.BucketWriter: Renaming
hdfs://Hadoop48:54310/flume/FlumeData.1361241606972.tmp to
hdfs://Hadoop48:54310/flume/FlumeData.1361241606972

the content in hdfs:

[zhouhh@Hadoop47 ~]$ hadoop fs -cat
 hdfs://Hadoop48:54310/flume/FlumeData.1361241606972
SEQ!org.apache.hadoop.io.LongWritable"org.apache.hadoop.io.BytesWritable▒.FI▒Z▒Q{2▒,\<▒U▒Y)Mon
Feb 18 18:25:26 2013 hello world zhh
[zhouhh@Hadoop47 ~]$

I don't know why there is some data like
"org.apache.hadoop.io.LongWritable",there are some bugs?

Best Regards,
Andy
+
hoo.smth 2013-02-19, 03:14
+
Hari Shreedharan 2013-02-19, 03:17
+
周梦想 2013-02-19, 03:43
+
周梦想 2013-02-19, 03:50
+
Hari Shreedharan 2013-02-19, 03:51
+
周梦想 2013-02-19, 04:15
+
Hari Shreedharan 2013-02-19, 05:09
+
周梦想 2013-02-19, 06:12
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB