|
|
-
Can't find the Job Status in WEB UIkira.wang 2013-01-21, 09:19
1. Actually, The job in the picture in the last email was running via
the local form. Because I delete the mapred-site.xml in @HADOOP_HOME/etc/Hadoop, and start resourcemanager. 2. But, when I configured mapreduce-site.xml as below: <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property> It does not work and carry out the errors: 13/01/21 16:53:16 INFO mapreduce.Job: map 0% reduce 0% 13/01/21 16:53:16 INFO mapreduce.Job: Job job_1358758352533_0001 failed with state FAILED due to: Application appl ication_1358758352533_0001 failed 1 times due to AM Container for appattempt_1358758352533_0001_000001 exited with exitCode: 1 due to: .Failing this attempt.. Failing the application. 13/01/21 16:53:16 INFO mapreduce.Job: Counters: 0 Job Finished in 6.192 seconds java.io.FileNotFoundException: File does not exist: hdfs://master2:9000/user/root/QuasiMonteCarlo_TMP_3_141592654/ out/reduce-out at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSy stem.java:736) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1685) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1709) at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:3 14) at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:351) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:360) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57 ) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl .java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver .java:72) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57 ) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl .java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.util.RunJar.main(RunJar.java:208) I checked the logs: the container status changes from ACCEPTED to FAILED suddenly, 2013-01-21 16:53:13,310 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_1358758352533_0001_01_000001, NodeId: xiaoi-115:50782, NodeHttpAddress: xiaoi-115:8042, Resource: memory: 1536, Priority: org.apache.hadoop.yarn.api.records.impl.pb.PriorityPBImpl@1f, State: NEW, Token: null, Status: container_id {, app_attempt_id {, application_id {, id: 1, cluster_timestamp: 1358758352533, }, attemptId: 1, }, id: 1, }, state: C_NEW, ] for AM appattempt_1358758352533_0001_000001 2013-01-21 16:53:13,311 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl : appattempt_1358758352533_0001_000001 State change from ALLOCATED to LAUNCHED 2013-01-21 16:53:13,693 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1358758352533_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING 2013-01-21 16:53:15,703 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1358758352533_0001_01_000001 Container Transitioned from RUNNING to COMPLETED 2013-01-21 16:53:15,703 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApp: Completed container: container_1358758352533_0001_01_000001 in state: COMPLETED event:FINISHED 2013-01-21 16:53:15,703 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1358758352533_0001 CONTAINERID=container_1358758352533_0001_01_000001 2013-01-21 16:53:15,703 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released container container_1358758352533_0001_01_000001 of capacity memory: 1536 on host xiaoi-115:50782, which currently has 0 containers, memory: 0 used and memory: 8192 available, release resources=true 2013-01-21 16:53:15,704 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler: Application appattempt_1358758352533_0001_000001 released container container_1358758352533_0001_01_000001 on node: host: xiaoi-115:50782 #containers=0 available=8192 used=0 with event: FINISHED 2013-01-21 16:53:15,705 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl 2013-01-21 16:53:15,705 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application application_1358758352533_0001 failed 1 times due to AM Container for appattempt_1358758352533_0001_000001 exited with exitCode: 1 due to: .Failing this attempt.. Failing the application. 2013-01-21 16:53:15,706 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1358758352533_0001 State change from ACCEPTED to FAILED 2013-01-21 16:53:15,707 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1358758352533_0001 failed 1 times due to AM Container for appattempt_1358758352533_0001_000001 exited with exitCode: 1 due to: .Failing this attempt.. Failing the application. APPID=application_1358758352533_0001 2013-01-21 16:53:15,708 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_13 |