Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Zookeeper exception while trying to access HBase table using pig.


Copy link to this message
-
Re: Zookeeper exception while trying to access HBase table using pig.
I am using HBase 0.90.3

On Wed, Jul 6, 2011 at 2:45 AM, Dmitriy Ryaboy <[EMAIL PROTECTED]> wrote:

> What version of HBase are you running?
>
>
> On Tue, Jul 5, 2011 at 1:45 AM, praveenesh kumar <[EMAIL PROTECTED]>
> wrote:
> > Hi,
> > I have a latest pig build from trunk. I have configured it to run on
> 12-node
> > hadoop cluster.
> > I am trying to access a hbase table, the map job is running fine for
> > sometime...but after some time.. I am getting zookeeper exception
> >
> > hadoop@ub13:/usr/local/hadoop/hbase/conf$ pig
> > log4j:WARN No appenders could be found for logger
> > (org.apache.hadoop.conf.Configuration).
> > log4j:WARN Please initialize the log4j system properly.
> > 2011-07-05 12:40:23,737 [main] INFO  org.apache.pig.Main - Logging error
> > messages to: /usr/local/hadoop/hbase/conf/pig_1309849823721.log
> > 2011-07-05 12:40:24,047 [main] INFO
> > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting
> > to hadoop file system at: hdfs://ub13:54310
> > 2011-07-05 12:40:24,241 [main] INFO
> > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting
> > to map-reduce job tracker at: ub13:54311
> >
> > grunt> ht = load 'hbase://tweetinfo' using
> > org.apache.pig.backend.hadoop.hbase.HBaseStorage('prim_tweetinfo:name',
> > '-loadKey') as (id,name);
> > grunt> dump ht | HEAD 100;
> >
> > 2011-07-05 12:40:38,234 [main] INFO
> > org.apache.pig.tools.pigstats.ScriptState - Pig features used in the
> script:
> > UNKNOWN
> > 2011-07-05 12:40:38,481 [main] INFO
> > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler -
> > File concatenation threshold: 100 optimistic? false
> > 2011-07-05 12:40:38,513 [main] INFO
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
> > - MR plan size before optimization: 1
> > 2011-07-05 12:40:38,514 [main] INFO
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
> > - MR plan size after optimization: 1
> > 2011-07-05 12:40:38,559 [main] INFO
> > org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added
> to
> > the job
> > 2011-07-05 12:40:38,572 [main] INFO
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
> > - mapred.job.reduce.markreset.buffer.percent is not set, set to default
> 0.3
> > 2011-07-05 12:40:38,737 [main] INFO  org.apache.zookeeper.ZooKeeper -
> Client
> > environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
> GMT
> > 2011-07-05 12:40:38,737 [main] INFO  org.apache.zookeeper.ZooKeeper -
> Client
> > environment:host.name=ub13
> > 2011-07-05 12:40:38,737 [main] INFO  org.apache.zookeeper.ZooKeeper -
> Client
> > environment:java.version=1.6.0_20
> > 2011-07-05 12:40:38,737 [main] INFO  org.apache.zookeeper.ZooKeeper -
> Client
> > environment:java.vendor=Sun Microsystems Inc.
> > 2011-07-05 12:40:38,737 [main] INFO  org.apache.zookeeper.ZooKeeper -
> Client
> > environment:java.home=/usr/lib/jvm/java-6-openjdk/jre
> > 2011-07-05 12:40:38,737 [main] INFO  org.apache.zookeeper.ZooKeeper -
> Client
> >
> environment:java.class.path=/usr/local/hadoop/pig-0.10/bin/../conf:/usr/lib/jvm/java-6-openjdk/lib/tools.jar:/usr/local/hadoop/pig-0.10/bin/../build/classes:/usr/local/hadoop/pig-0.10/bin/../build/test/classes:/usr/local/hadoop/pig-0.10/bin/../pig-*-core.jar:/usr/local/hadoop/pig-0.10/bin/../build/pig-0.10.0-SNAPSHOT.jar:/usr/local/hadoop/pig-0.10/bin/../lib/automaton.jar:/usr/local/hadoop/hadoop/hadoop-0.20-append-for-hbase-core.jar:/usr/local/hadoop/hbase/hbase-0.90.3.jar:/usr/local/hadoop/hbase/hbase-0.90.3-tests.jar:/usr/local/hadoop/hbase/lib/zookeeper-3.3.2.jar:/usr/local/hadoop/hadoop:/usr/local/hadoop/hadoop/conf
> > 2011-07-05 12:40:38,737 [main] INFO  org.apache.zookeeper.ZooKeeper -
> Client
> >
> environment:java.library.path=/usr/lib/jvm/java-6-openjdk/jre/lib/i386/server:/usr/lib/jvm/java-6-openjdk/jre/lib/i386:/usr/lib/jvm/java-6-openjdk/jre/../lib/i386
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB