Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Tasktracker appearing from "nowhere"


Copy link to this message
-
Re: Tasktracker appearing from "nowhere"
Peter,

> I'm getting the following errors:
>
> WARN org.apache.hadoop.mapred.JobTracker: Serious problem, cannot find record of 'previous' heartbeat for 'tracker_m351.ra.wink.com:localhost/127.0.0.1:41885';
> reinitializing the tasktracker
>
> INFO org.apache.hadoop.mapred.JobTracker: Adding task 'attempt_201005271529_0004_r_000042_1' to tip task_201005271529_0004_r_000042, for tracker
> 'tracker_m351.ra.wink.com:localhost/127.0.0.1:41885'
>
> INFO org.apache.hadoop.mapred.JobTracker: Removed completed task 'attempt_201005271529_0004_m_000112_0' from 'tracker_m351.ra.wink.com:localhost/127.0.0.1:41885'
>
>
> despite not having m351 in any of the config files except racks.txt.
> If I take it out of there I can't start any jobs at all.
>
> Question is - what would make a machine be contacted as a tasktracker when it is not in the slave or *.xml files?
>

If m351 has Hadoop and a mapred-site.xml or hadoop-site.xml pointing
to the right JobTracker, it would register itself as a TaskTracker
when Hadoop starts on it. The slave file is used primarily to start
the daemons from a central place and is not a way to specify which
nodes must join the Hadoop cluster.

Thanks
hemanth
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB