Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - TaskTracker Error
tgh
2012-02-23, 09:03
Harsh J
2012-02-23, 09:30
tgh
2012-02-23, 10:10
tgh
2012-02-24, 01:07
Vladislav Feigin
2012-02-23, 11:57
tgh
2012-02-24, 01:30
Vladislav Feigin
2012-02-24, 07:07
+
tgh 2012-02-23, 09:03
Copy link to this message
-
RE: TaskTracker Error
Jun Ping Du 2012-02-23, 09:59
I see from the log, the tasktracker try to connect to ipc server:
ubuntu.local/192.168.164.138:9100.
Do you set the correct mapred.job.tracker on slave node also?

Thanks,

Junping

-----Original Message-----
From: tgh [mailto:[EMAIL PROTECTED]]
Sent: Thursday, February 23, 2012 5:03 PM
To: [EMAIL PROTECTED]
Subject: TaskTracker Error

Hi

         I setup hadoop with hadoop 0.20.2

        

         I use three virtual machines on vmware,

         The three virtual machine could ssh with each other,

ERROR rise ,   the tasktracker on slave 192.168.164.137 and
192.168.164.138
cloud not connect to master, while the tasktracker on 192.168.164.136
seems no error,

 

Cloud you help me

 

The conf file is set as follows,

root@ubuntu:/home/hadoop-0.20.2/conf# cat masters

192.168.164.136

root@ubuntu:/home/hadoop-0.20.2/conf# cat slaves

192.168.164.136

192.168.164.137

192.168.164.138

root@ubuntu:/home/hadoop-0.20.2/conf#

root@ubuntu:/home/hadoop-0.20.2/conf# cat core-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

 

<!-- Put site-specific property overrides in this file. -->

 

<configuration>

  <property>

    <name>fs.default.name</name>

    <value>hdfs://192.168.164.136:9100</value>

  </property>

  <property>

    <name>hadoop.tmp.dir</name>

    <value>/home/hadoop-0.20.2/tmp/</value>

  </property>

  <property>

    <name>dfs.replication</name>

    <value>1</value>

  </property>

  <!-- property>  

    <name>mapred.child.java.opts</name>

    <value>-Xmx128m</value>

  </property>

  <property>  

    <name>dfs.block.size</name>

    <value>5120000</value>  

    <description>The default block size for new files.</description>

  </property -->

</configuration>

 

root@ubuntu:/home/hadoop-0.20.2/conf# cat mapred-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

 

<!-- Put site-specific property overrides in this file. -->

 

<configuration>

  <property>

    <name>mapred.job.tracker</name>

    <value>192.168.164.136:9101</value>

  </property>

</configuration>

 

 

 

now ERROR rise ,   the tasktracker on slave 192.168.164.137 and
192.168.164.138 cloud not connect to master, while the tasktracker on
192.168.164.136 seems no error,

 

this is the log on 192.168.164.138,

root@ubuntu:/home/hadoop-0.20.2/logs#

root@ubuntu:/home/hadoop-0.20.2/logs# cat
hadoop-root-tasktracker-ubuntu.log
2012-02-23 00:44:10,851 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting TaskTracker

STARTUP_MSG:   host = ubuntu/127.0.1.1

STARTUP_MSG:   args = []

STARTUP_MSG:   version = 0.20.2

STARTUP_MSG:   build https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010

************************************************************/

2012-02-23 00:44:16,080 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog

2012-02-23 00:44:16,199 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is
-1.
Opening the listener on 50060

2012-02-23 00:44:16,205 INFO org.apache.hadoop.http.HttpServer:
listener.getLocalPort() returned 50060
webServer.getConnectors()[0].getLocalPort() returned 50060

2012-02-23 00:44:16,205 INFO org.apache.hadoop.http.HttpServer: Jetty
bound to port 50060

2012-02-23 00:44:16,205 INFO org.mortbay.log: jetty-6.1.14

2012-02-23 00:45:08,741 INFO org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:50060

2012-02-23 00:45:08,808 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId
2012-02-23 00:45:08,848 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=49689

2012-02-23 00:45:08,909 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting

2012-02-23 00:45:08,912 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost/127.0.0.1:49689

2012-02-23 00:45:08,912 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tracker tracker_ubuntu:localhost/127.0.0.1:49689

2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 49689: starting

2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 49689: starting

2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 49689: starting

2012-02-23 00:45:08,911 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 49689: starting

2012-02-23 00:45:08,919 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 49689: starting

2012-02-23 00:47:53,638 INFO org.apache.hadoop.mapred.TaskTracker:  Using
MemoryCalculatorPlugin :
org.apache.hadoop.util.LinuxMemoryCalculatorPlugin@cafb56

2012-02-23 00:47:53,641 INFO org.apache.hadoop.mapred.TaskTracker:
Starting
thread: Map-events fetcher for all reduce tasks on
tracker_ubuntu:localhost/127.0.0.1:49689

2012-02-23 00:47:53,646 WARN org.apache.hadoop.mapred.TaskTracker:
TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is
disabled.

2012-02-23 00:47:53,647 INFO org.apache.hadoop.mapred.IndexCache:
IndexCache created with max memory = 10485760

2012-02-23 00:47:55,110 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: ubuntu.local/192.168.164.138:9100. Already tried 0
time(s).

2012-02-23 00:47:56,112 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: ubuntu.local/192.168.164.138:9100. Already tried 1
time(s).

2012-02-23 00:47:57,114 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: ubuntu.local/192.168.164.138:9100. Already tried 2
time(s).

2012-02-23 00:47:58,116 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: ubuntu.local/192.168.164.138:9100. Already tried 3
time(s).

2012-02-23 00:47:59,118
+
Harsh J 2012-02-23, 09:30
+
tgh 2012-02-23, 10:10
+
tgh 2012-02-24, 01:07
+
Vladislav Feigin 2012-02-23, 11:57
+
tgh 2012-02-24, 01:30
+
Vladislav Feigin 2012-02-24, 07:07