|
|
-
UserGroupInformation when running randomwriter test
Li Li 2012-11-17, 09:59
hi all I am trying to set up a hadoop cluster and run the random writer test hadoop jar /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar randomwriter random-data but there is an exception. After this exception, the jobtracker is crashed. [[EMAIL PROTECTED] hadoop-1.0.4]$ hadoop jar /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar randomwriter random-data Running 0 maps. Job started: Sat Nov 17 17:50:37 CST 2012 12/11/17 17:50:38 INFO mapred.JobClient: Cleaning up the staging area hdfs://db-fcr-dev00.db01:9000/tmp/hadoop-work/mapred/staging/work/.staging/job_201211171750_0001 12/11/17 17:50:38 ERROR security.UserGroupInformation: PriviledgedActionException as:work cause:java.io.IOException: Call to db-fcr-dev00.db01/xx.33.22:9001 failed on local exception: java.io.EOFException java.io.IOException: Call to db-fcr-dev00.db01/xx.33.22:9001 failed on local exception: java.io.EOFException at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107) at org.apache.hadoop.ipc.Client.call(Client.java:1075) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) at org.apache.hadoop.mapred.$Proxy2.submitJob(Unknown Source) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:921) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824) at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261) at org.apache.hadoop.examples.RandomWriter.run(RandomWriter.java:272) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.examples.RandomWriter.main(RandomWriter.java:283) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:375) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:804) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749) [[EMAIL PROTECTED] hadoop-1.0.4]$ jps 16663 NameNode 17086 Jps
-
Re: UserGroupInformation when running randomwriter test
Harsh J 2012-11-17, 15:20
Are you sure that port 9001 is running the JobTracker service? Seems to me like you are trying to connect to the NameNode instead of the JobTracker.
On Sat, Nov 17, 2012 at 3:29 PM, Li Li <[EMAIL PROTECTED]> wrote: > hi all > I am trying to set up a hadoop cluster and run the random writer test > hadoop jar /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar > randomwriter random-data > but there is an exception. After this exception, the jobtracker is > crashed. > > > [[EMAIL PROTECTED] hadoop-1.0.4]$ hadoop jar > /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar randomwriter > random-data > Running 0 maps. > Job started: Sat Nov 17 17:50:37 CST 2012 > 12/11/17 17:50:38 INFO mapred.JobClient: Cleaning up the staging area > hdfs://db-fcr-dev00.db01:9000/tmp/hadoop-work/mapred/staging/work/.staging/job_201211171750_0001 > 12/11/17 17:50:38 ERROR security.UserGroupInformation: > PriviledgedActionException as:work cause:java.io.IOException: Call to > db-fcr-dev00.db01/xx.33.22:9001 failed on local exception: > java.io.EOFException > java.io.IOException: Call to db-fcr-dev00.db01/xx.33.22:9001 failed on local > exception: java.io.EOFException > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107) > at org.apache.hadoop.ipc.Client.call(Client.java:1075) > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) > at org.apache.hadoop.mapred.$Proxy2.submitJob(Unknown Source) > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:921) > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > at > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850) > at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824) > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261) > at > org.apache.hadoop.examples.RandomWriter.run(RandomWriter.java:272) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at > org.apache.hadoop.examples.RandomWriter.main(RandomWriter.java:283) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) > at > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) > at > org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > Caused by: java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:375) > at > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:804) > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749) > [[EMAIL PROTECTED] hadoop-1.0.4]$ jps > 16663 NameNode > 17086 Jps
-- Harsh J
-
Re: UserGroupInformation when running randomwriter test
Li Li 2012-11-17, 15:33
I don't have root acount. I use netstat -lnp | grep java tcp 0 0 10.81.33.22:9000 0.0.0.0:* LISTEN 5590/java tcp 0 0 10.81.33.22:9001 0.0.0.0:* LISTEN 5782/java tcp 0 0 0.0.0.0:50030 0.0.0.0:* LISTEN 5782/java tcp 0 0 0.0.0.0:50070 0.0.0.0:* LISTEN 5590/java
it seems 50030 and 50070 port are bind to 0.0.0.0(all ip) but 9001 only 10.81.33.22. is it the problem? On Sat, Nov 17, 2012 at 11:20 PM, Harsh J <[EMAIL PROTECTED]> wrote:
> Are you sure that port 9001 is running the JobTracker service? Seems > to me like you are trying to connect to the NameNode instead of the > JobTracker. > > On Sat, Nov 17, 2012 at 3:29 PM, Li Li <[EMAIL PROTECTED]> wrote: > > hi all > > I am trying to set up a hadoop cluster and run the random writer test > > hadoop jar /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar > > randomwriter random-data > > but there is an exception. After this exception, the jobtracker is > > crashed. > > > > > > [[EMAIL PROTECTED] hadoop-1.0.4]$ hadoop jar > > /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar randomwriter > > random-data > > Running 0 maps. > > Job started: Sat Nov 17 17:50:37 CST 2012 > > 12/11/17 17:50:38 INFO mapred.JobClient: Cleaning up the staging area > > > hdfs://db-fcr-dev00.db01:9000/tmp/hadoop-work/mapred/staging/work/.staging/job_201211171750_0001 > > 12/11/17 17:50:38 ERROR security.UserGroupInformation: > > PriviledgedActionException as:work cause:java.io.IOException: Call to > > db-fcr-dev00.db01/xx.33.22:9001 failed on local exception: > > java.io.EOFException > > java.io.IOException: Call to db-fcr-dev00.db01/xx.33.22:9001 failed on > local > > exception: java.io.EOFException > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107) > > at org.apache.hadoop.ipc.Client.call(Client.java:1075) > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) > > at org.apache.hadoop.mapred.$Proxy2.submitJob(Unknown Source) > > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:921) > > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:396) > > at > > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) > > at > > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850) > > at > org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824) > > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261) > > at > > org.apache.hadoop.examples.RandomWriter.run(RandomWriter.java:272) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > > at > > org.apache.hadoop.examples.RandomWriter.main(RandomWriter.java:283) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > at java.lang.reflect.Method.invoke(Method.java:597) > > at > > > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) > > at > > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) > > at > > org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > at java.lang.reflect.Method.invoke(Method.java:597) > > at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext