Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Can't run Hadoop MR 1.0.3 Junit tests in IDE.


Copy link to this message
-
Can't run Hadoop MR 1.0.3 Junit tests in IDE.
Hi,

I'm trying to run Hadoop Junit tests in IDE, but I got errors. I've the
mapreduce running properly. I'm using the version Hadoop 1.0.3:
*
*
2012-08-10 13:53:05,803 ERROR mapred.MiniMRCluster
(MiniMRCluster.java:run(119)) - Job tracker crashed
java.lang.NullPointerException
at java.io.File.<init>(File.java:239)
 at org.apache.hadoop.mapred.JobHistory.initLogDir(JobHistory.java:531)
at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:499)
 at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2330)
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2327)
 at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2327)
 at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2188)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2182)
 at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:296)
at
org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:114)
 at
org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:1)
at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
 at
org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:112)
at java.lang.Thread.run(Thread.java:679)
2012-08-10 13:53:05,895 INFO  mapred.MiniMRCluster
(MiniMRCluster.java:<init>(188)) - mapred.local.dir is
/home/xeon/workspace/hadoop-1.0.3-tests/build/test/mapred/local/0_0
2012-08-10 13:53:10,923 INFO  http.HttpServer
(HttpServer.java:addGlobalFilter(411)) - Added global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-08-10 13:53:10,941 INFO  mapred.TaskLogsTruncater
(TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with
mapRetainSize=-1 and reduceRetainSize=-1
2012-08-10 13:53:10,947 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(694)) - Starting tasktracker with owner as xeon
2012-08-10 13:53:10,948 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(710)) - Good mapred local directories are:
/home/xeon/workspace/hadoop-1.0.3-tests/build/test/mapred/local/0_0
2012-08-10 13:53:10,959 WARN  util.NativeCodeLoader
(NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
2012-08-10 13:53:10,977 INFO  ipc.Server (Server.java:run(328)) - Starting
SocketReader
2012-08-10 13:53:10,979 INFO  ipc.Server (Server.java:run(598)) - IPC
Server Responder: starting
2012-08-10 13:53:10,979 INFO  ipc.Server (Server.java:run(434)) - IPC
Server listener on 58393: starting
2012-08-10 13:53:10,983 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 0 on 58393: starting
2012-08-10 13:53:10,984 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 1 on 58393: starting
2012-08-10 13:53:10,984 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 2 on 58393: starting
2012-08-10 13:53:10,987 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 3 on 58393: starting
2012-08-10 13:53:10,987 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(794)) - TaskTracker up at:
localhost.localdomain/127.0.0.1:58393
2012-08-10 13:53:10,988 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(797)) - Starting tracker tracker_host0.foo.com:
localhost.localdomain/127.0.0.1:58393
2012-08-10 13:53:12,050 INFO  ipc.Client
(Client.java:handleConnectionFailure(666)) - Retrying connect to server:
localhost/127.0.0.1:0. Already tried 0 time(s).
2012-08-10 13:53:13,051 INFO  ipc.Client
(Client.java:handleConnectionFailure(666)) - Retrying connect to server:
localhost/127.0.0.1:0. Already tried 1 time(s).
2012-08-10 13:53:14,053 INFO  ipc.Client
(Client.java:handleConnectionFailure(666)) - Retrying connect to server:
localhost/127.0.0.1:0. Already tried 2 time(s).
How do I run Hadoop Junit tests properly?
Thanks,
*
*
*
*

Best regards,