Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Failed to create DataStorage


Copy link to this message
-
RE: Failed to create DataStorage
Correct, 0.7 works with Hadoop 20.x

-----Original Message-----
From: Saurav Datta [mailto:[EMAIL PROTECTED]]
Sent: Friday, August 27, 2010 2:58 PM
To: [EMAIL PROTECTED]
Subject: Re: Failed to create DataStorage

Thanks Alan !
Will Pig 0.7.0  run on Hadoop 0.20.x  ?
Or should we use any other Hadoop release ?

Regards,
Saurav

On Aug 27, 2010, at 2:50 PM, Alan Gates wrote:

> Pig has not been tested with Hadoop 0.21, so I don't know if this  
> will work or not.
>
> Alan.
>
> On Aug 27, 2010, at 2:42 PM, Saurav Datta wrote:
>
>> Hi ,
>>
>> I am trying to run Pig 0.7.0 on Hadoop 0.21.0 .
>>
>> Getting the below error :
>>
>> $ pig
>> 10/08/27 14:38:18 INFO pig.Main: Logging error messages to: /Users/
>> rahulmalviya/Documents/Hadoop/hadoop-0.21.0/bin/pig_1282945098943.log
>> 2010-08-27 14:38:19,245 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
>> Connecting to hadoop file system at: hdfs://localhost:9000
>> 2010-08-27 14:38:19,600 [main] ERROR org.apache.pig.Main - ERROR  
>> 2999:
>> Unexpected internal error. Failed to create DataStorage
>> Details at logfile: /Users/rahulmalviya/Documents/Hadoop/
>> hadoop-0.21.0/
>> bin/pig_1282945098943.log
>>
>> Is this a version issue ? Any suggestions ?
>>
>> Let me know if you need any information from me to debug this .
>>
>> Thanks in advance ,
>> Saurav
>>
>>
>>
>> P.S: Below is the content of the log file.
>>
>> isdevmars002:bin rahulmalviya$ cat /Users/rahulmalviya/Documents/
>> Hadoop/hadoop-0.21.0/bin/pig_1282945098943.log
>> Error before Pig is launched
>> ----------------------------
>> ERROR 2999: Unexpected internal error. Failed to create DataStorage
>>
>> java.lang.RuntimeException: Failed to create DataStorage
>> at
>> org
>> .apache
>> .pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:
>> 75)
>> at
>> org
>> .apache
>> .pig
>> .backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:
>> 58)
>> at
>> org
>> .apache
>> .pig
>> .backend
>> .hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:
>> 216)
>> at
>> org
>> .apache
>> .pig
>> .backend
>> .hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:
>> 126)
>> at org.apache.pig.impl.PigContext.connect(PigContext.java:184)
>> at org.apache.pig.PigServer.<init>(PigServer.java:184)
>> at org.apache.pig.PigServer.<init>(PigServer.java:173)
>> at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:54)
>> at org.apache.pig.Main.main(Main.java:354)
>> Caused by: java.io.IOException: Call to localhost/127.0.0.1:9000
>> failed on local exception: java.io.EOFException
>> at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>> at org.apache.hadoop.ipc.Client.call(Client.java:743)
>> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>> at $Proxy0.getProtocolVersion(Unknown Source)
>> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>> at  
>> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:
>> 106)
>> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
>> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)
>> at
>> org
>> .apache
>> .hadoop
>> .hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
>> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:
>> 1378)
>> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
>> at
>> org
>> .apache
>> .pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:
>> 72)
>> ... 8 more
>> Caused by: java.io.EOFException
>> at java.io.DataInputStream.readInt(DataInputStream.java:375)
>> at org.apache.hadoop.ipc.Client
>> $Connection.receiveResponse(Client.java:501)
>> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>> >> >> >> >> >> >> >> >> =
>> =
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB