Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> modification to Hadoop Jobtracker


Copy link to this message
-
Re: modification to Hadoop Jobtracker
Hi, bikash

I also worked on this several months ago,

If I don't have a wrong memory, the involved files should be:
JobTracker.java, TaskTracker.java,

the most interesting functions should be JobTracker.heartbeat(), and
TaskTracker.transmitHeartbeat(), I think you will also need to add more
member variables in TaskTrackerStatus.java

take care about the write() and read() in TaskTrackerStatus.java,

Best,

Nan

On Sat, Mar 19, 2011 at 1:59 AM, bikash sharma <[EMAIL PROTECTED]>wrote:

> Hi,
> For my research project, I need to modify Hadoop JobTracker to collect some
> statistics of TaskTracker nodes.
> For example, I would like to piggy-back heartbeat messages sent from
> TaskTrackers to JobTracker with some extra information related to the
> resource utilization and other statistics.
> I am able to checkout Hadoop common code base and build in Eclipse.
> Specifically, which files should I look at, and after the above mentioned
> modification, how to collect the statistics?
>
> Thanks,
> Bikash
>

--
Nan Zhu
School of Software,5501
Shanghai Jiao Tong University
800,Dongchuan Road,Shanghai,China
E-Mail: [EMAIL PROTECTED]
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB