|
|
-
[pig-0.9.1+hadoop1.0.0 e2e tests]: ERROR 2999: Unexpected internal error. Failed to create DataStorage
lulynn_2008 2012-02-16, 11:02
Hi, Please give your suggestion on resolve this error. Thank you. The error log: ERROR 2999: Unexpected internal error. Failed to create DataStorage
java.lang.RuntimeException: Failed to create DataStorage at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75) at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134) at org.apache.pig.impl.PigContext.connect(PigContext.java:183) at org.apache.pig.PigServer.<init>(PigServer.java:226) at org.apache.pig.PigServer.<init>(PigServer.java:215) at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:55) at org.apache.pig.Main.run(Main.java:492) at org.apache.pig.Main.main(Main.java:107) Caused by: java.io.IOException: Call to localhost/9.30.225.100:9000 failed on local exception: java.io.EOFException at org.apache.hadoop.ipc.Client.wrapException(Client.java:775) at org.apache.hadoop.ipc.Client.call(Client.java:743) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) at $Proxy0.getProtocolVersion(Unknown Source) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359) at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95) at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72) ... 9 more Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:386) at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446) ===============================================================================
+
lulynn_2008 2012-02-16, 11:02
-
Re: [pig-0.9.1+hadoop1.0.0 e2e tests]: ERROR 2999: Unexpected internal error. Failed to create DataStorage
Alan Gates 2012-02-16, 16:33
Generally this means you are failing to connect to the NameNode of your HDFS system. I've seen this because of a version incompatibility between your client and your server, or because of a misconfigured NameNode location in your config files. I would check the version of Hadoop installed in the HADOOP_HOME you are using on the launching machine and the version of Hadoop on your cluster. I would also check in HADOOP_HOME/conf/core-site.xml to check that the fs.default.name parameter matches the hostname and port your NameNode are running on.
Alan.
On Feb 16, 2012, at 3:02 AM, lulynn_2008 wrote:
> Hi, > Please give your suggestion on resolve this error. Thank you. > The error log: > ERROR 2999: Unexpected internal error. Failed to create DataStorage > > java.lang.RuntimeException: Failed to create DataStorage > at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75) > at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58) > at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214) > at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134) > at org.apache.pig.impl.PigContext.connect(PigContext.java:183) > at org.apache.pig.PigServer.<init>(PigServer.java:226) > at org.apache.pig.PigServer.<init>(PigServer.java:215) > at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:55) > at org.apache.pig.Main.run(Main.java:492) > at org.apache.pig.Main.main(Main.java:107) > Caused by: java.io.IOException: Call to localhost/9.30.225.100:9000 failed on local exception: java.io.EOFException > at org.apache.hadoop.ipc.Client.wrapException(Client.java:775) > at org.apache.hadoop.ipc.Client.call(Client.java:743) > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) > at $Proxy0.getProtocolVersion(Unknown Source) > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359) > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106) > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207) > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170) > at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95) > at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72) > ... 9 more > Caused by: java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:386) > at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501) > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446) > ===============================================================================
+
Alan Gates 2012-02-16, 16:33
-
Re:Re: [pig-0.9.1+hadoop1.0.0 e2e tests]: ERROR 2999: Unexpected internal error. Failed to create DataStorage
lulynn_2008 2012-02-17, 06:30
Problem resolved. This is because of " a version incompatibility between your client and your server ". At 2012-02-17 00:33:10,"Alan Gates" <[EMAIL PROTECTED]> wrote: >Generally this means you are failing to connect to the NameNode of your HDFS system. I've seen this because of a version incompatibility between your client and your server, or because of a misconfigured NameNode location in your config files. I would check the version of Hadoop installed in the HADOOP_HOME you are using on the launching machine and the version of Hadoop on your cluster. I would also check in HADOOP_HOME/conf/core-site.xml to check that the fs.default.name parameter matches the hostname and port your NameNode are running on. > >Alan. > >On Feb 16, 2012, at 3:02 AM, lulynn_2008 wrote: > >> Hi, >> Please give your suggestion on resolve this error. Thank you. >> The error log: >> ERROR 2999: Unexpected internal error. Failed to create DataStorage >> >> java.lang.RuntimeException: Failed to create DataStorage >> at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75) >> at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58) >> at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:214) >> at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:134) >> at org.apache.pig.impl.PigContext.connect(PigContext.java:183) >> at org.apache.pig.PigServer.<init>(PigServer.java:226) >> at org.apache.pig.PigServer.<init>(PigServer.java:215) >> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:55) >> at org.apache.pig.Main.run(Main.java:492) >> at org.apache.pig.Main.main(Main.java:107) >> Caused by: java.io.IOException: Call to localhost/9.30.225.100:9000 failed on local exception: java.io.EOFException >> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775) >> at org.apache.hadoop.ipc.Client.call(Client.java:743) >> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) >> at $Proxy0.getProtocolVersion(Unknown Source) >> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359) >> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106) >> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207) >> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170) >> at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82) >> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378) >> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) >> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95) >> at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72) >> ... 9 more >> Caused by: java.io.EOFException >> at java.io.DataInputStream.readInt(DataInputStream.java:386) >> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501) >> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446) >> ===============================================================================>
+
lulynn_2008 2012-02-17, 06:30
-
[pig-0.9.1+hadoop1.0.0 e2e tests]: ERROR 2078: Caught error from UDF: org.apache.pig.test.udf.evalfunc.BadUdf, Out of bounds access [Index: 2, Size: 2]
lulynn_2008 2012-02-16, 11:04
Hi, Please give your suggestions to this error:
org.apache.pig.backend.executionengine.ExecException: ERROR 2078: Caught error from UDF: org.apache.pig.test.udf.evalfunc.BadUdf, Out of bounds access [Index: 2, Size: 2] at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:247) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:258) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:316) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:332) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:284) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.runPipeline(PigGenericMapReduce.java:459) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:427) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:407) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:261) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(AccessController.java:284) at javax.security.auth.Subject.doAs(Subject.java:573) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1108) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.lang.IndexOutOfBoundsException: Index: 2, Size: 2 at java.util.ArrayList.set(ArrayList.java:638) at org.apache.pig.data.DefaultTuple.set(DefaultTuple.java:181) at org.apache.pig.test.udf.evalfunc.BadUdf.exec(BadUdf.java:40) at org.apache.pig.test.udf.evalfunc.BadUdf.exec(BadUdf.java:28) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POUserFunc.getNext(POUserFunc.java:216) ... 16 more
+
lulynn_2008 2012-02-16, 11:04
|
|