Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Can't run Hadoop MR 1.0.3 Junit tests in IDE.


Copy link to this message
-
Can't run Hadoop MR 1.0.3 Junit tests in IDE.
Hi,

I'm trying to run Hadoop Junit tests in IDE, but I got errors. I've the
mapreduce running properly. I'm using the version Hadoop 1.0.3:
*
*
2012-08-10 13:53:05,803 ERROR mapred.MiniMRCluster
(MiniMRCluster.java:run(119)) - Job tracker crashed
java.lang.NullPointerException
at java.io.File.<init>(File.java:239)
 at org.apache.hadoop.mapred.JobHistory.initLogDir(JobHistory.java:531)
at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:499)
 at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2330)
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2327)
 at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
 at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2327)
 at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2188)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2182)
 at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:296)
at
org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:114)
 at
org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:1)
at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
 at
org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:112)
at java.lang.Thread.run(Thread.java:679)
2012-08-10 13:53:05,895 INFO  mapred.MiniMRCluster
(MiniMRCluster.java:<init>(188)) - mapred.local.dir is
/home/xeon/workspace/hadoop-1.0.3-tests/build/test/mapred/local/0_0
2012-08-10 13:53:10,923 INFO  http.HttpServer
(HttpServer.java:addGlobalFilter(411)) - Added global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-08-10 13:53:10,941 INFO  mapred.TaskLogsTruncater
(TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with
mapRetainSize=-1 and reduceRetainSize=-1
2012-08-10 13:53:10,947 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(694)) - Starting tasktracker with owner as xeon
2012-08-10 13:53:10,948 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(710)) - Good mapred local directories are:
/home/xeon/workspace/hadoop-1.0.3-tests/build/test/mapred/local/0_0
2012-08-10 13:53:10,959 WARN  util.NativeCodeLoader
(NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
2012-08-10 13:53:10,977 INFO  ipc.Server (Server.java:run(328)) - Starting
SocketReader
2012-08-10 13:53:10,979 INFO  ipc.Server (Server.java:run(598)) - IPC
Server Responder: starting
2012-08-10 13:53:10,979 INFO  ipc.Server (Server.java:run(434)) - IPC
Server listener on 58393: starting
2012-08-10 13:53:10,983 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 0 on 58393: starting
2012-08-10 13:53:10,984 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 1 on 58393: starting
2012-08-10 13:53:10,984 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 2 on 58393: starting
2012-08-10 13:53:10,987 INFO  ipc.Server (Server.java:run(1358)) - IPC
Server handler 3 on 58393: starting
2012-08-10 13:53:10,987 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(794)) - TaskTracker up at:
localhost.localdomain/127.0.0.1:58393
2012-08-10 13:53:10,988 INFO  mapred.TaskTracker
(TaskTracker.java:initialize(797)) - Starting tracker tracker_host0.foo.com:
localhost.localdomain/127.0.0.1:58393
2012-08-10 13:53:12,050 INFO  ipc.Client
(Client.java:handleConnectionFailure(666)) - Retrying connect to server:
localhost/127.0.0.1:0. Already tried 0 time(s).
2012-08-10 13:53:13,051 INFO  ipc.Client
(Client.java:handleConnectionFailure(666)) - Retrying connect to server:
localhost/127.0.0.1:0. Already tried 1 time(s).
2012-08-10 13:53:14,053 INFO  ipc.Client
(Client.java:handleConnectionFailure(666)) - Retrying connect to server:
localhost/127.0.0.1:0. Already tried 2 time(s).
How do I run Hadoop Junit tests properly?
Thanks,
*
*
*
*

Best regards,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB