Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - pig with Hbase


Copy link to this message
-
Re: pig with Hbase
Bill Graham 2012-08-07, 05:45
What version of Pig are you using and does it work if you try setting
PIG_CLASSPATH with the HBase conf path?

On Mon, Aug 6, 2012 at 9:59 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

>
>
> On Mon, Aug 6, 2012 at 8:54 PM, Bill Graham <[EMAIL PROTECTED]> wrote:
>
>> Have you verified that the HBase confs point to the correct ZK nodes? Are
>> you able to run the hbase shell with those env settings?
>>
>>
> Yes HBase shell has no issues on those nodes.
>
>
>> On Mon, Aug 6, 2012 at 11:46 AM, Mohit Anchlia <[EMAIL PROTECTED]
>> >wrote:
>>
>> > On Mon, Aug 6, 2012 at 11:41 AM, Dmitriy Ryaboy <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Sounds like your hbase conf is not on the classpath.
>> > >
>> > I tried this too but didn't help
>> >
>> > # cat hbase_cp.sh
>> > HBASE_CONF_DIR=$HBASE_HOME/conf
>> > CLASSPATH=$HBASE_CONF_DIR:$CLASSPATH
>> > # ls $HBASE_CONF_DIR
>> > hadoop-metrics.properties  hbase-env.sh  hbase-site.xml
>>  log4j.properties
>> > regionservers
>> >
>> >
>> > > D
>> > >
>> > > On Mon, Aug 6, 2012 at 11:31 AM, Mohit Anchlia <
>> [EMAIL PROTECTED]>
>> > > wrote:
>> > > > I am trying to read records from HBase using HBaseStorage. When I
>> > execute
>> > > > simple load I get this error. I think I am missing some property,
>> but I
>> > > am
>> > > > running pig on the cluster where hadoop and hbase is there.
>> > > >
>> > > > I also have HBASE_HOME set:
>> > > >
>> > > > # env|grep HBASE
>> > > > HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
>> > > >
>> > > >  org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066:
>> Unable
>> > > to
>> > > > open iterator for alias raw
>> > > >         at org.apache.pig.PigServer.openIterator(PigServer.java:900)
>> > > >         at
>> > > >
>> > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>> > > >         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
>> > > >         at org.apache.pig.Main.run(Main.java:487)
>> > > >         at org.apache.pig.Main.main(Main.java:108)
>> > > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
>> > alias
>> > > > raw
>> > > >         at org.apache.pig.PigServer.storeEx(PigServer.java:999)
>> > > >         at org.apache.pig.PigServer.store(PigServer.java:962)
>> > > >         at org.apache.pig.PigServer.openIterator(PigServer.java:875)
>> > > >         ... 7 more
>> > > > Caused by:
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
>> > > > ERROR 2017: Internal error creating job configuration.
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
>> > > >         at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
>> > > >         at
>> > > >
>> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
>> > > >         at org.apache.pig.PigServer.storeEx(PigServer.java:995)
>> > > >         ... 9 more
>> > > > Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An
>> > error
>> > > > is preventing HBase from connecting to ZooKeeper
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
*Note that I'm no longer using my Yahoo! email address. Please email me at
[EMAIL PROTECTED] going forward.*