Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> hadoop jar in hbase lib?


Copy link to this message
-
RE: hadoop jar in hbase lib?
Hey Pete,

Ignore my other post, looks like you found the issue.

HBase ships with a hadoop jar because it needs to ship with all of its dependencies.  If we didn't, you would have to download the Hadoop release separately just to run the unit tests or a single-node test setup.

In the past, we have also had some client-side HBase-only patches applied to the hadoop jar with which we shipped.

Of course, when using a full Hadoop distribution, you need to ensure compatibility between the server and your client library as would be the case with anything else.

Glad to see things are working better!

JG

> -----Original Message-----
> From: Pete Haidinyak [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, December 21, 2010 11:07 PM
> To: [EMAIL PROTECTED]
> Subject: hadoop jar in hbase lib?
>
> Is there a reason there is a hadoop jar in the hbase lib directory?
> Couldn't hbase us the jar in the Hadoop directory?
>
> THanks
>
> -Pete
>
> On Tue, 21 Dec 2010 21:37:28 -0800, Pete Haidinyak <[EMAIL PROTECTED]>
> wrote:
>
> > Good call, looks like that might have been my problem. Seems simple now.
> > ;-)
> >
> > Thanks
> >
> > -Pete
> >
> >
> > On Tue, 21 Dec 2010 20:33:31 -0800, Claudio Martella
> > <[EMAIL PROTECTED]> wrote:
> >
> >> Could you check if you're using the same hadoop jar version on hdfs
> >> and hbase? I had a similar problem once.
> >>
> >>
> >> On 12/22/10 12:32 AM, Pete Haidinyak wrote:
> >>> After 11 hours I give up. I am trying to get a 5 node system up on
> >>> my ESXi server.
> >>> OS CentOS 5.5 x64
> >>> Hadoop Version 0.20.2+737
> >>> HBase Version 0.87.20100924+28
> >>>
> >>> Name Node - Zoo Keeper - HBase Master on one machine
> >>> 4 Region Server
> >>>
> >>> Hadoop starts up on every node without any problems. When I try to
> >>> start HBase on the Master server I get zookeeper coming up but no
> >>> HBase Master. When I do a hbase-stop.sh the zookeeper goes away and
> >>> then the HMaster appears in a 'JPS' command. Here is the log file
> >>>
> >>>
> >>> Tue Dec 21 18:17:35 EST 2010 Starting master on hadoop-name-node
> >>> ulimit -n 1024
> >>> 2010-12-21 18:17:36,380 INFO
> >>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper:
> Reconnecting to
> >>> zookeeper
> >>> 2010-12-21 18:17:36,462 INFO org.apache.zookeeper.ZooKeeper: Client
> >>> environment:zookeeper.version=3.3.1-942149, built on 05/07/2010
> >>> 17:14 GMT
> >>> 2010-12-21 18:17:36,462 INFO org.apache.zookeeper.ZooKeeper: Client
> >>> environment:host.name=hadoop-name-node
> >>> 2010-12-21 18:17:36,462 INFO org.apache.zookeeper.ZooKeeper: Client
> >>> environment:java.version=1.6.0_23
> >>> 2010-12-21 18:17:36,462 INFO org.apache.zookeeper.ZooKeeper: Client
> >>> environment:java.vendor=Sun Microsystems Inc.
> >>> 2010-12-21 18:17:36,462 INFO org.apache.zookeeper.ZooKeeper: Client
> >>> environment:java.home=/usr/java/jdk1.6.0_23/jre
> >>> 2010-12-21 18:17:36,462 INFO org.apache.zookeeper.ZooKeeper: Client
> >>> environment:java.class.path=/usr/local/hbase/conf:/usr/java/default/
> >>> lib/tools.jar::/usr/local/hbase:/usr/local/hbase/hbase-0.89.2010
> >>> 0924+28.jar:/usr/local/hbase/hbase-0.89.20100924+28-tests.jar:/usr/l
> >>> 0924+ocal/hbase/lib/activation-1.1.jar:/usr/local/hbase/lib/ant-1.6.
> >>> 0924+5.jar:/usr/local/hbase/lib/ant-1.7.1.jar:/usr/local/hbase/lib/a
> >>> 0924+nt-lau
> >>>
> >>> ncher-1.7.1.jar:/usr/local/hbase/lib/asm-3.1.jar:/usr/local/hbase/li
> >>> b/avro-1.3.2.jar:/usr/local/hbase/lib/commons-cli-1.2.jar:/usr/local
> >>> /hbase/lib/commons-codec-1.2.jar:/usr/local/hbase/lib/commons-el
> >>>
> >>> -1.0.jar:/usr/local/hbase/lib/commons-httpclient-3.1.jar:/usr/local/
> >>> hbase/lib/commons-lang-2.5.jar:/usr/local/hbase/lib/commons-logging-
> >>> 1.1.1.jar:/usr/local/hbase/lib/commons-net-1.4.1.jar:/usr/local/
> >>>
> >>> hbase/lib/core-3.1.1.jar:/usr/local/hbase/lib/guava-r05.jar:/usr/loc
> >>> al/hbase/lib/hadoop-core-0.20.2-737.jar:/usr/local/hbase/lib/hsqldb-
> >>> 1.8.0.10.jar:/usr/local/hbase/lib/jackson-core-asl-1.5.2.jar:/us