Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> pig with Hbase


Copy link to this message
-
Re: pig with Hbase
What version of Pig are you using and does it work if you try setting
PIG_CLASSPATH with the HBase conf path?

On Mon, Aug 6, 2012 at 9:59 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

>
>
> On Mon, Aug 6, 2012 at 8:54 PM, Bill Graham <[EMAIL PROTECTED]> wrote:
>
>> Have you verified that the HBase confs point to the correct ZK nodes? Are
>> you able to run the hbase shell with those env settings?
>>
>>
> Yes HBase shell has no issues on those nodes.
>
>
>> On Mon, Aug 6, 2012 at 11:46 AM, Mohit Anchlia <[EMAIL PROTECTED]
>> >wrote:
>>
>> > On Mon, Aug 6, 2012 at 11:41 AM, Dmitriy Ryaboy <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Sounds like your hbase conf is not on the classpath.
>> > >
>> > I tried this too but didn't help
>> >
>> > # cat hbase_cp.sh
>> > HBASE_CONF_DIR=$HBASE_HOME/conf
>> > CLASSPATH=$HBASE_CONF_DIR:$CLASSPATH
>> > # ls $HBASE_CONF_DIR
>> > hadoop-metrics.properties  hbase-env.sh  hbase-site.xml
>>  log4j.properties
>> > regionservers
>> >
>> >
>> > > D
>> > >
>> > > On Mon, Aug 6, 2012 at 11:31 AM, Mohit Anchlia <
>> [EMAIL PROTECTED]>
>> > > wrote:
>> > > > I am trying to read records from HBase using HBaseStorage. When I
>> > execute
>> > > > simple load I get this error. I think I am missing some property,
>> but I
>> > > am
>> > > > running pig on the cluster where hadoop and hbase is there.
>> > > >
>> > > > I also have HBASE_HOME set:
>> > > >
>> > > > # env|grep HBASE
>> > > > HBASE_HOME=/opt/mapr/hbase/hbase-0.90.6/
>> > > >
>> > > >  org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066:
>> Unable
>> > > to
>> > > > open iterator for alias raw
>> > > >         at org.apache.pig.PigServer.openIterator(PigServer.java:900)
>> > > >         at
>> > > >
>> > org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>> > > >         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:67)
>> > > >         at org.apache.pig.Main.run(Main.java:487)
>> > > >         at org.apache.pig.Main.main(Main.java:108)
>> > > > Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store
>> > alias
>> > > > raw
>> > > >         at org.apache.pig.PigServer.storeEx(PigServer.java:999)
>> > > >         at org.apache.pig.PigServer.store(PigServer.java:962)
>> > > >         at org.apache.pig.PigServer.openIterator(PigServer.java:875)
>> > > >         ... 7 more
>> > > > Caused by:
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
>> > > > ERROR 2017: Internal error creating job configuration.
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
>> > > >         at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
>> > > >         at
>> > > >
>> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
>> > > >         at org.apache.pig.PigServer.storeEx(PigServer.java:995)
>> > > >         ... 9 more
>> > > > Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: An
>> > error
>> > > > is preventing HBase from connecting to ZooKeeper
>> > > >         at
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1006)
*Note that I'm no longer using my Yahoo! email address. Please email me at
[EMAIL PROTECTED] going forward.*
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB