hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike Spreitzer <mspre...@us.ibm.com>
Subject Re: Using the Hadoop bundled in the lib directory of HBase
Date Mon, 07 Feb 2011 17:17:22 GMT
After a few false starts, what I have done is: fetch the 0.20.2 release of 
hadoop core (which appears to be common + dfs + mapred), install it, 
delete hadoop/hadoop-core.jar, unpack the hbase distribution, copy its 
lib/hadoop-core-...jar file to hadoop/hadoop-...-core.jar, configure, and 
test.  It seems to be working.  Is that what you expected?  Should I 
expect subtle problems?

If that was the right procedure, this could be explained a little more 
clearly at (http://hbase.apache.org/notsoquick.html#hadoop).  The first 
thing that set me on the wrong path was the statement that I have to 
either build my own Hadoop or use Cloudera; apparently that's not right, I 
can use a built release if I replace one jar in it.  That web page says "
If you want to run HBase on an Hadoop cluster that is other than a version 
made from branch-0.20.append " (which is my case, using a standard 
release) "you must replace the hadoop jar found in the HBase lib directory 
with the hadoop jar you are running out on your cluster to avoid version 
mismatch issues" --- but I think it's the other way around in my case.

Mike Spreitzer
SMTP: mspreitz@us.ibm.com, Lotus Notes: Mike Spreitzer/Watson/IBM
Office phone: +1-914-784-6424 (IBM T/L 863-)
AOL Instant Messaging: M1k3Sprtzr

From:   Stack <stack@duboce.net>
To:     user@hbase.apache.org
Date:   02/07/2011 12:07 PM
Subject:        Re: Using the Hadoop bundled in the lib directory of HBase
Sent by:        saint.ack@gmail.com

On Sun, Feb 6, 2011 at 9:31 PM, Vijay Raj <vijayraj@sargasdata.com> wrote:
> Hadoop core contained hdfs / mapreduce , all bundled together until 
0.20.x .
>  Since 0.21, it got forked into common, hdfs and mapreduce sub-projects.

What Vijay said.

> In this case - what is needed is a 0.20.2 download from hadoop and 
> the same. The hadoop-0.20.2.jar needs to be replaced by the patched
> hadoop-0.20.2-xxxx.jar available in HBASE_HOME/lib/*.jar directory, to 
> things work .

This is a  little off.

Here is our Hadoop story for 0.90.0:

It links to the branch.   If you need instruction on how to check out
and build, just say (do we need to add pointers to book?)


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message