Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Using the Hadoop bundled in the lib directory of HBase

Copy link to this message
Re: Using the Hadoop bundled in the lib directory of HBase
After a few false starts, what I have done is: fetch the 0.20.2 release of
hadoop core (which appears to be common + dfs + mapred), install it,
delete hadoop/hadoop-core.jar, unpack the hbase distribution, copy its
lib/hadoop-core-...jar file to hadoop/hadoop-...-core.jar, configure, and
test.  It seems to be working.  Is that what you expected?  Should I
expect subtle problems?

If that was the right procedure, this could be explained a little more
clearly at (http://hbase.apache.org/notsoquick.html#hadoop).  The first
thing that set me on the wrong path was the statement that I have to
either build my own Hadoop or use Cloudera; apparently that's not right, I
can use a built release if I replace one jar in it.  That web page says "
If you want to run HBase on an Hadoop cluster that is other than a version
made from branch-0.20.append " (which is my case, using a standard
release) "you must replace the hadoop jar found in the HBase lib directory
with the hadoop jar you are running out on your cluster to avoid version
mismatch issues" --- but I think it's the other way around in my case.

Mike Spreitzer
SMTP: [EMAIL PROTECTED], Lotus Notes: Mike Spreitzer/Watson/IBM
Office phone: +1-914-784-6424 (IBM T/L 863-)
AOL Instant Messaging: M1k3Sprtzr

From:   Stack <[EMAIL PROTECTED]>
Date:   02/07/2011 12:07 PM
Subject:        Re: Using the Hadoop bundled in the lib directory of HBase
Sent by:        [EMAIL PROTECTED]

On Sun, Feb 6, 2011 at 9:31 PM, Vijay Raj <[EMAIL PROTECTED]> wrote:
> Hadoop core contained hdfs / mapreduce , all bundled together until
0.20.x .
>  Since 0.21, it got forked into common, hdfs and mapreduce sub-projects.

What Vijay said.

> In this case - what is needed is a 0.20.2 download from hadoop and
> the same. The hadoop-0.20.2.jar needs to be replaced by the patched
> hadoop-0.20.2-xxxx.jar available in HBASE_HOME/lib/*.jar directory, to
> things work .

This is a  little off.

Here is our Hadoop story for 0.90.0:

It links to the branch.   If you need instruction on how to check out
and build, just say (do we need to add pointers to book?)