Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Strange problem with CDH3 Beta 4


Copy link to this message
-
Re: Strange problem with CDH3 Beta 4
Had this. It's because Pig packages the Hadoop 0.20 classes into its
jar. Tail the namenode logs when you run the Pig shell and you'll see an
error about version. Try the instructions here:

http://thedatachef.blogspot.com/2011/01/apache-pig-08-with-cloudera-cdh3.html

--jacob
@thedatachef

On Wed, 2011-02-23 at 13:45 +0100, byambajargal wrote:
> Hello everyone
>
> I am using CDH3 Beta 4 distribution on 11 node cluster machines.
>
>
>
> I successfully installed Hadoop. However, Pig seems to be giving us some
> trouble. I installed Pig according to the instructions here (for Red
> Hat): https://docs.cloudera.com/display/DOC/Pig+Installation, and it
> will install successfully.
>
> However, when I start the grunt shell, i have got a error message
> Unexpected internal error. Failed to create DataStorage". and in pig log
> file
>
> Error before Pig is launched
> ----------------------------
> ERROR 2999: Unexpected internal error. Failed to create DataStorage
>
> java.lang.RuntimeException: Failed to create DataStorage
>          at
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75)
>          at
> org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58)
>          at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:213)
>          at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:133)
>          at org.apache.pig.impl.PigContext.connect(PigContext.java:183)
>          at org.apache.pig.PigServer.<init>(PigServer.java:225)
>          at org.apache.pig.PigServer.<init>(PigServer.java:214)
>          at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:55)
>          at org.apache.pig.Main.run(Main.java:462)
>          at org.apache.pig.Main.main(Main.java:107)
> Caused by: org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> org.apache.hadoop.hdfs.protocol.ClientProtocol version mismatch. (client
> = 63, server = 61)
>          at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:403)
>          at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
>          at
> org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
>          at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
>
>
>
> I installed Cloudera Hadoop version 0.20.2+737in on cluster
> mode<https://docs.cloudera.com/display/DOC/CDH3+Deployment+on+a+Cluster>, so
> Pig is compatible.
>
>
> thanks
>
> Byambaa
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB