Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Failed to create DataStorage


Copy link to this message
-
RE: Failed to create DataStorage
Olga Natkovich 2010-08-27, 22:04
Correct, 0.7 works with Hadoop 20.x

-----Original Message-----
From: Saurav Datta [mailto:[EMAIL PROTECTED]]
Sent: Friday, August 27, 2010 2:58 PM
To: [EMAIL PROTECTED]
Subject: Re: Failed to create DataStorage

Thanks Alan !
Will Pig 0.7.0  run on Hadoop 0.20.x  ?
Or should we use any other Hadoop release ?

Regards,
Saurav

On Aug 27, 2010, at 2:50 PM, Alan Gates wrote:

> Pig has not been tested with Hadoop 0.21, so I don't know if this  
> will work or not.
>
> Alan.
>
> On Aug 27, 2010, at 2:42 PM, Saurav Datta wrote:
>
>> Hi ,
>>
>> I am trying to run Pig 0.7.0 on Hadoop 0.21.0 .
>>
>> Getting the below error :
>>
>> $ pig
>> 10/08/27 14:38:18 INFO pig.Main: Logging error messages to: /Users/
>> rahulmalviya/Documents/Hadoop/hadoop-0.21.0/bin/pig_1282945098943.log
>> 2010-08-27 14:38:19,245 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
>> Connecting to hadoop file system at: hdfs://localhost:9000
>> 2010-08-27 14:38:19,600 [main] ERROR org.apache.pig.Main - ERROR  
>> 2999:
>> Unexpected internal error. Failed to create DataStorage
>> Details at logfile: /Users/rahulmalviya/Documents/Hadoop/
>> hadoop-0.21.0/
>> bin/pig_1282945098943.log
>>
>> Is this a version issue ? Any suggestions ?
>>
>> Let me know if you need any information from me to debug this .
>>
>> Thanks in advance ,
>> Saurav
>>
>>
>>
>> P.S: Below is the content of the log file.
>>
>> isdevmars002:bin rahulmalviya$ cat /Users/rahulmalviya/Documents/
>> Hadoop/hadoop-0.21.0/bin/pig_1282945098943.log
>> Error before Pig is launched
>> ----------------------------
>> ERROR 2999: Unexpected internal error. Failed to create DataStorage
>>
>> java.lang.RuntimeException: Failed to create DataStorage
>> at
>> org
>> .apache
>> .pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:
>> 75)
>> at
>> org
>> .apache
>> .pig
>> .backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:
>> 58)
>> at
>> org
>> .apache
>> .pig
>> .backend
>> .hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:
>> 216)
>> at
>> org
>> .apache
>> .pig
>> .backend
>> .hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:
>> 126)
>> at org.apache.pig.impl.PigContext.connect(PigContext.java:184)
>> at org.apache.pig.PigServer.<init>(PigServer.java:184)
>> at org.apache.pig.PigServer.<init>(PigServer.java:173)
>> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:54)
>> at org.apache.pig.Main.main(Main.java:354)
>> Caused by: java.io.IOException: Call to localhost/127.0.0.1:9000
>> failed on local exception: java.io.EOFException
>> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>> at org.apache.hadoop.ipc.Client.call(Client.java:743)
>> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>> at $Proxy0.getProtocolVersion(Unknown Source)
>> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>> at  
>> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:
>> 106)
>> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
>> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)
>> at
>> org
>> .apache
>> .hadoop
>> .hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:
>> 1378)
>> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>> at
>> org
>> .apache
>> .pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:
>> 72)
>> ... 8 more
>> Caused by: java.io.EOFException
>> at java.io.DataInputStream.readInt(DataInputStream.java:375)
>> at org.apache.hadoop.ipc.Client
>> $Connection.receiveResponse(Client.java:501)
>> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>> >> >> >> >> >> >> >> >> =
>> =