I am running basic pig script but it's failing. There is other job that
loads data that works.
 Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias raw
        at org.apache.pig.PigServer.openIterator(PigServer.java:900)
        at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
        at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
        at org.apache.pig.Main.run(Main.java:427)
        at org.apache.pig.Main.main(Main.java:108)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
raw
        at org.apache.pig.PigServer.storeEx(PigServer.java:999)
        at org.apache.pig.PigServer.store(PigServer.java:962)
        at org.apache.pig.PigServer.openIterator(PigServer.java:875)
        ... 7 more
Caused by:
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
ERROR 2017: Internal error creating job configuration.
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
        at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
        at org.apache.pig.PigServer.storeEx(PigServer.java:995)
        ... 9 more
Caused by: java.lang.NullPointerException
        at
org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
        at
org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
        at
org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
        at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
        at
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
        at
org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
        ... 14 more

raw = LOAD 'hbase://SESSION_TIMELINE1'
       USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
       's_t_mtx:*', '-loadKey true -limit 5')
       AS (id:bytearray, s_t_mtx_map:map[]);
dump raw;
[root@dsdb4 mapr]# hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
hbase(main):001:0> describe SESSION_TIMELINE1
NameError: uninitialized constant SESSION_TIMELINE1
hbase(main):002:0> describe 'SESSION_TIMELINE1'
DESCRIPTION
ENABLED
 {NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX', BLOOMFILTER
=> 'NONE', REPLICATION_SCOPE => '0', COMPRES true
 SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
 }
1 row(s) in 0.5750 seconds

I am wondering if my pig script is correct? I took it from some of the
examples from the wiki:

raw = LOAD 'hbase://SESSION_TIMELINE1'
       USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
       's_t_mtx:*', '-loadKey true -limit 5')
       AS (id:bytearray, s_t_mtx_map:map[]);
dump raw;

On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

> I am running basic pig script but it's failing. There is other job that
> loads data that works.
>
>
>  Pig Stack Trace
> ---------------
> ERROR 2017: Internal error creating job configuration.
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> open iterator for alias raw
>         at org.apache.pig.PigServer.openIterator(PigServer.java:900)
>         at
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
>         at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
>         at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
>         at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
>         at org.apache.pig.Main.run(Main.java:427)
>         at org.apache.pig.Main.main(Main.java:108)
> Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
> raw
>         at org.apache.pig.PigServer.storeEx(PigServer.java:999)
>         at org.apache.pig.PigServer.store(PigServer.java:962)
>         at org.apache.pig.PigServer.openIterator(PigServer.java:875)
>         ... 7 more
> Caused by:
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> ERROR 2017: Internal error creating job configuration.
>         at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
>         at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
>         at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
>         at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
>         at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
>         at org.apache.pig.PigServer.storeEx(PigServer.java:995)
>         ... 9 more
> Caused by: java.lang.NullPointerException
>         at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
>         at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
>         at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
>         at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
>         at
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
>         at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
>         ... 14 more
>
> raw = LOAD 'hbase://SESSION_TIMELINE1'
>        USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
>        's_t_mtx:*', '-loadKey true -limit 5')
>        AS (id:bytearray, s_t_mtx_map:map[]);
> dump raw;
> [root@dsdb4 mapr]# hbase shell
> HBase Shell; enter 'help<RETURN>' for list of supported commands.

This seems to be the problem:

Caused by: java.lang.NullPointerException
        at
org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)

Which seems like the Conf is null, which is really odd.
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKConfig.java?view=markup

What version of Pig are you using? Does this happen when using a Pig build
from the trunk?
On Sat, Aug 11, 2012 at 7:20 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

> I am wondering if my pig script is correct? I took it from some of the
> examples from the wiki:
>
> raw = LOAD 'hbase://SESSION_TIMELINE1'
>        USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
>        's_t_mtx:*', '-loadKey true -limit 5')
>        AS (id:bytearray, s_t_mtx_map:map[]);
> dump raw;
>
> On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > I am running basic pig script but it's failing. There is other job that
> > loads data that works.
> >
> >
> >  Pig Stack Trace
> > ---------------
> > ERROR 2017: Internal error creating job configuration.
> > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> > open iterator for alias raw
> >         at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> >         at
> > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> >         at
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> >         at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> >         at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> >         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> >         at org.apache.pig.Main.run(Main.java:427)
> >         at org.apache.pig.Main.main(Main.java:108)
> > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
> > raw
> >         at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> >         at org.apache.pig.PigServer.store(PigServer.java:962)
> >         at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> >         ... 7 more
> > Caused by:
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> > ERROR 2017: Internal error creating job configuration.
> >         at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> >         at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> >         at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> >         at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> >         at
> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> >         at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> >         ... 9 more
> > Caused by: java.lang.NullPointerException
> >         at
> > org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
> >         at
> > org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
> >         at
> >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
> >         at
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
> >         at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> >         at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> >         at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> >         at
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)

*Note that I'm no longer using my Yahoo! email address. Please email me at
[EMAIL PROTECTED] going forward.*

On Sun, Aug 12, 2012 at 11:26 PM, Bill Graham <[EMAIL PROTECTED]> wrote:

> This seems to be the problem:
>
> Caused by: java.lang.NullPointerException
>         at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
>
> Which seems like the Conf is null, which is really odd.
>
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKConfig.java?view=markup
>
> What version of Pig are you using? Does this happen when using a Pig build
> from the trunk?
>
> I am using .9, strange thing is that when I run load job it works.

>
> On Sat, Aug 11, 2012 at 7:20 PM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > I am wondering if my pig script is correct? I took it from some of the
> > examples from the wiki:
> >
> > raw = LOAD 'hbase://SESSION_TIMELINE1'
> >        USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
> >        's_t_mtx:*', '-loadKey true -limit 5')
> >        AS (id:bytearray, s_t_mtx_map:map[]);
> > dump raw;
> >
> > On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <[EMAIL PROTECTED]
> > >wrote:
> >
> > > I am running basic pig script but it's failing. There is other job that
> > > loads data that works.
> > >
> > >
> > >  Pig Stack Trace
> > > ---------------
> > > ERROR 2017: Internal error creating job configuration.
> > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
> to
> > > open iterator for alias raw
> > >         at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> > >         at
> > >
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> > >         at
> > >
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> > >         at
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> > >         at
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> > >         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> > >         at org.apache.pig.Main.run(Main.java:427)
> > >         at org.apache.pig.Main.main(Main.java:108)
> > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
> alias
> > > raw
> > >         at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> > >         at org.apache.pig.PigServer.store(PigServer.java:962)
> > >         at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> > >         ... 7 more
> > > Caused by:
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> > > ERROR 2017: Internal error creating job configuration.
> > >         at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> > >         at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> > >         at
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> > >         at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> > >         at
> > >
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> > >         at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> > >         ... 9 more
> > > Caused by: java.lang.NullPointerException
> > >         at
> > >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
> > >         at
> > >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
> > >         at
> > >
> >
> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
> > >         at
> > >
> >
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
> > >         at
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> > >         at
> > >
>

HBase CF names are case sensitive, so you're query might be off since
you're using lowercase.

If that the problem still persists with the same case, would it be possible
to see if you can reproduce against a Pig build from the trunk?
On Mon, Aug 13, 2012 at 8:28 AM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

>
>
> On Sun, Aug 12, 2012 at 11:26 PM, Bill Graham <[EMAIL PROTECTED]>wrote:
>
>> This seems to be the problem:
>>
>> Caused by: java.lang.NullPointerException
>>         at
>> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
>>
>> Which seems like the Conf is null, which is really odd.
>>
>> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKConfig.java?view=markup
>>
>> What version of Pig are you using? Does this happen when using a Pig build
>> from the trunk?
>>
>> I am using .9, strange thing is that when I run load job it works.
>
>>
>> On Sat, Aug 11, 2012 at 7:20 PM, Mohit Anchlia <[EMAIL PROTECTED]
>> >wrote:
>>
>> > I am wondering if my pig script is correct? I took it from some of the
>> > examples from the wiki:
>> >
>> > raw = LOAD 'hbase://SESSION_TIMELINE1'
>> >        USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
>> >        's_t_mtx:*', '-loadKey true -limit 5')
>> >        AS (id:bytearray, s_t_mtx_map:map[]);
>> > dump raw;
>> >
>> > On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <[EMAIL PROTECTED]
>> > >wrote:
>> >
>> > > I am running basic pig script but it's failing. There is other job
>> that
>> > > loads data that works.
>> > >
>> > >
>> > >  Pig Stack Trace
>> > > ---------------
>> > > ERROR 2017: Internal error creating job configuration.
>> > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066:
>> Unable to
>> > > open iterator for alias raw
>> > >         at org.apache.pig.PigServer.openIterator(PigServer.java:900)
>> > >         at
>> > >
>> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
>> > >         at
>> > >
>> >
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
>> > >         at
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
>> > >         at
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>> > >         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
>> > >         at org.apache.pig.Main.run(Main.java:427)
>> > >         at org.apache.pig.Main.main(Main.java:108)
>> > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
>> alias
>> > > raw
>> > >         at org.apache.pig.PigServer.storeEx(PigServer.java:999)
>> > >         at org.apache.pig.PigServer.store(PigServer.java:962)
>> > >         at org.apache.pig.PigServer.openIterator(PigServer.java:875)
>> > >         ... 7 more
>> > > Caused by:
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
>> > > ERROR 2017: Internal error creating job configuration.
>> > >         at
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
>> > >         at
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
>> > >         at
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
>> > >         at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
>> > >         at
>> > >
>> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
>> > >         at org.apache.pig.PigServer.storeEx(PigServer.java:995)
>> > >         ... 9 more
>> > > Caused by: java.lang.NullPointerException
>> > >         at
>> > >
>> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
>> > >         at
>> > >
>> org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
*Note that I'm no longer using my Yahoo! email address. Please email me at
[EMAIL PROTECTED] going forward.*