Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> About debugging HDFS and MapReduce...


Copy link to this message
-
About debugging HDFS and MapReduce...
Hello!!
My name is Yoonmin Nam from South Korea.Currently, I am trying to debug namenode and datanode using eclipse and fully-distributed environemnt in my lab. (1 master and 10 nodes)However, I can do debug but not fully, just some portion of source code of hadoop.This means I cannot see how some daemon thread such as DataStreamer.Also, I want to see how NameNode thread and DataNode thread work but I can't.As you can see, there is Daemon thread (Thread-2) and it might be DataStreamer thread but.. I can't see. So, I think everyone in the hdfs-dev have very professional experience in developing HDFS and MapReduce and I want to ask you about how can I see all real daemons are working for academic reason.Even you have no idea about it, may I ask you that how you test your implementation of HDFS or MapReduce?Thanks!!
// Yoonmin Nam
+
Ted Yu 2013-10-07, 04:22
+
남윤민 2013-10-07, 04:38
+
haosdent 2013-10-07, 05:23
+
Yoonmin Nam 2013-10-07, 05:38
+
Bobby Evans 2013-10-07, 15:30
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB