Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> "Failed to create DataStorage" ?


Copy link to this message
-
Re: "Failed to create DataStorage" ?
Hi Ryan,

Seems like you are trying to connect to a hadoop cluster running 0.20.2.
Pig by default uses hadoop 1.0 unless you specify otherwise.

You should point HADOOP_HOME to your hadoop installation dir
(0.20.2-cdh3u3) from where you are launching pig

export HADOOP_HOME=<path_to_0.20.2-cdh3u3>
On Thu, Mar 21, 2013 at 12:59 PM, Ryan Compton <[EMAIL PROTECTED]>wrote:

> I can start a grunt shell just fine:
>
> -bash-3.2$ pwd
> /home/rfcompton/Downloads/pig-0.11.0-src
> -bash-3.2$ ./bin/pig
> 2013-03-21 12:55:00,048 [main] INFO  org.apache.pig.Main - Apache Pig
> version 0.11.1-SNAPSHOT (rexported) compiled Mar 21 2013, 12:49:21
> 2013-03-21 12:55:00,049 [main] INFO  org.apache.pig.Main - Logging
> error messages to:
> /home/rfcompton/Downloads/pig-0.11.0-src/pig_1363895700046.log
> 2013-03-21 12:55:00,076 [main] INFO  org.apache.pig.impl.util.Utils -
> Default bootup file /home/rfcompton/.pigbootup not found
> 2013-03-21 12:55:00,330 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting to hadoop file system at: hdfs://master:8020/
> 2013-03-21 12:55:00,581 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting to map-reduce job tracker at: node4:8021
> grunt>
>
> But I can't run a java program:
>
> -bash-3.2$ java -cp
>
> target/mybigjar-1.1-SNAPSHOT-jar-with-dependencies.jar:$HADOOP_CONF_DIR:/home/rfcompton/Downloads/pig-0.11.0-src/pig.jar
> org.apache.pig.Main
> 2013-03-21 12:55:58,806 [main] INFO  org.apache.pig.Main - Apache Pig
> version 0.11.1-SNAPSHOT (rexported) compiled Mar 21 2013, 12:49:21
> 2013-03-21 12:55:58,806 [main] INFO  org.apache.pig.Main - Logging
> error messages to: /home/rfcompton/pig_1363895758801.log
> 2013-03-21 12:55:58,829 [main] INFO  org.apache.pig.impl.util.Utils -
> Default bootup file /home/rfcompton/.pigbootup not found
> 2013-03-21 12:55:59,086 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting to hadoop file system at: hdfs://master:8020/
> 2013-03-21 12:56:03,844 [main] ERROR org.apache.pig.Main - ERROR 2999:
> Unexpected internal error. Failed to create DataStorage
> Details at logfile:
> /home/rfcompton/myshrep/OSI/Code/geocoderV2/pig_1363895758801.log
> -bash-3.2$
>
> So I did this:
> https://cwiki.apache.org/confluence/display/PIG/FAQ#FAQ-Q%3AWhatshallIdoifIsaw%22FailedtocreateDataStorage%22%3F
> and it didn't help.
>
> If it matters,
>
> -bash-3.2$ hadoop version
> Hadoop 0.20.2-cdh3u3
>