Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig HBaseStorage error


Copy link to this message
-
Pig HBaseStorage error
I am running basic pig script but it's failing. There is other job that
loads data that works.
 Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias raw
        at org.apache.pig.PigServer.openIterator(PigServer.java:900)
        at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
        at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
        at org.apache.pig.Main.run(Main.java:427)
        at org.apache.pig.Main.main(Main.java:108)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
raw
        at org.apache.pig.PigServer.storeEx(PigServer.java:999)
        at org.apache.pig.PigServer.store(PigServer.java:962)
        at org.apache.pig.PigServer.openIterator(PigServer.java:875)
        ... 7 more
Caused by:
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
ERROR 2017: Internal error creating job configuration.
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
        at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
        at org.apache.pig.PigServer.storeEx(PigServer.java:995)
        ... 9 more
Caused by: java.lang.NullPointerException
        at
org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
        at
org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
        at
org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
        at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
        at
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
        at
org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
        ... 14 more

raw = LOAD 'hbase://SESSION_TIMELINE1'
       USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
       's_t_mtx:*', '-loadKey true -limit 5')
       AS (id:bytearray, s_t_mtx_map:map[]);
dump raw;
[root@dsdb4 mapr]# hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
hbase(main):001:0> describe SESSION_TIMELINE1
NameError: uninitialized constant SESSION_TIMELINE1
hbase(main):002:0> describe 'SESSION_TIMELINE1'
DESCRIPTION
ENABLED
 {NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX', BLOOMFILTER
=> 'NONE', REPLICATION_SCOPE => '0', COMPRES true
 SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
 }
1 row(s) in 0.5750 seconds