Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # dev - ycsb and hbase 0.95.1  hadoop2


Copy link to this message
-
ycsb and hbase 0.95.1  hadoop2
Paul Baclace 2013-07-29, 07:48
[This might look like a user list question, or a question for another
project, but people on the hbase dev list use ycsb to test hbase, and
the side effect of my progress on this benefits hbase more than any
other project... please indulge me.]

I have been unable to build ycsb for hbase 0.95.1  hadoop2, even though
I added the artifacts to my local repo like so:

mvn install:install-file
-Dfile=../hbase-0.95.1-hadoop2/lib/hadoop-mapreduce-client-core-2.0.2-alpha.jar
-DgroupId=org.apache.hadoop -DartifactId=hadoop-mapreduce-client-core
-Dversion=2.0.2-alpha -Dpackaging=jar

mvn install:install-file
-Dfile=../hbase-0.95.1-hadoop2/lib/hbase-client-0.95.1-hadoop2.jar
-DgroupId=org.apache.hbase -DartifactId=hbase-client
-Dversion=0.95.1-hadoop2 -Dpackaging=jar

I looked at the pom.xml in the jar files to determine the parameters,
modified ycsb pom.xml and hbase/pom.xml; ycsb  "mvn clean package" has
errors, not finding basic stuff:

[ERROR]
/Volumes/pebproject/ThirdEye/LSI/ws/YCSB/hbase/src/main/java/com/yahoo/ycsb/db/HBaseClient.java:[34,29]
package org.apache.hadoop.conf does not exist
[ERROR]
/Volumes/pebproject/ThirdEye/LSI/ws/YCSB/hbase/src/main/java/com/yahoo/ycsb/db/HBaseClient.java:[35,30]
cannot find symbol
symbol  : class KeyValue
location: package org.apache.hadoop.hbase
[ERROR]
/Volumes/pebproject/ThirdEye/LSI/ws/YCSB/hbase/src/main/java/com/yahoo/ycsb/db/HBaseClient.java:[46,35]
cannot find symbol
symbol  : class Bytes
location: package org.apache.hadoop.hbase.util
[ERROR]
/Volumes/pebproject/ThirdEye/LSI/ws/YCSB/hbase/src/main/java/com/yahoo/ycsb/db/HBaseClient.java:[47,30]
cannot find symbol
symbol  : class HBaseConfiguration
location: package org.apache.hadoop.hbase
[... more not shown for brevity ]

I suspect ycsb pom.xml [https://github.com/brianfrankcooper/YCSB] is not
ready for packaging changes made in hbase 0.95 OR could it be that
adding jars to a local maven repo, because they are not yet on a
centralized server, simply does not suffice because not all dependencies
are added?   HBaseConfiguration is in hbase-common-0.95.1-hadoop2.jar ,
but how to add all the turtles all the way down?

What's the secret to using ycsb for the latest HBase?