Accumulo, mail # user - Re: YCSB++ dbcompile

YCSB++ dbcompile

David Lynch 2013-03-05, 21:41

Hi,

I've recently started getting up to speed with Accumulo, I have it setup across 4 EC2 Instances with no issues. I am now trying to use the YCSB++ Client (https://github.com/MiloPolte/YCSB) to run some benchmarks.

I am able to compile the ycsb.jar just running ANT within the YCSB Directory;

root@xxxxxxxxxxx:/usr/local/YCSB-master# ant
Buildfile: /usr/local/YCSB-master/build.xml
compile:
   [mkdir] Created dir: /usr/local/YCSB-master/build/classes
   [javac] Compiling 47 source files to /usr/local/YCSB-master/build/classes
makejar:
   [jar] Building jar: /usr/local/YCSB-master/build/ycsb.jar
BUILD SUCCESSFUL
Total time: 4 seconds

However I am unable to compile when using ant dbcompile-accumulo, I have copied all jars from the Accumulo lib to the YCSB/db/accumulo/lib it makes the ycsb.jar however when it begins dbcompile it begins giving errors;
makejar:
   [jar] Building jar: /usr/local/YCSB-master/build/ycsb.jar

Thanks,
Dave

RE: YCSB++ dbcompile

David Lynch 2013-03-05, 21:52

Apologies, forgot to include errors; Any help appreciated.

Dave

dbcompile-accumulo: dbcompile: [javac] Compiling 6 source files to /usr/local/YCSB-master/build/classes [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:28:
error: package org.apache.hadoop.io does not exist [javac] import org.apache.hadoop.io.Text; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:29:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.KeeperException; [javac] ^ [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:48: error: cannot find symbol [javac] private Text _colFam = new Text(""); [javac] ^ [javac] symbol: class Text [javac] location: class AccumuloClient [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:7:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.CreateMode; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:8:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.KeeperException; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:9:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.WatchedEvent; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:10:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.Watcher; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:11:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.ZooKeeper; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:12:
error: package org.apache.zookeeper.ZooDefs does not exist [javac] import org.apache.zookeeper.ZooDefs.Ids; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:13:
error: package org.apache.zookeeper.data does not exist [javac] import org.apache.zookeeper.data.Stat; [javac] ^ [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:17: error: cannot find symbol [javac] public class ZKProducerConsumer implements Watcher { [javac] ^ [javac] symbol: class Watcher [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:156: error: cannot find symbol [javac] private Scanner getRow(Text row, Set<String> fields) [javac] ^ [javac] symbol: class Text [javac] location: class AccumuloClient [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:322: error: cannot find symbol [javac] private void deleteRow(Text row) throws TableNotFoundException { [javac] ^ [javac] symbol: class Text [javac] location: class AccumuloClient [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:19: error: cannot find symbol [javac] static ZooKeeper zk = null; [javac] ^ [javac] symbol: class ZooKeeper [javac] location: class ZKProducerConsumer [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:41: error: cannot find symbol [javac] synchronized public void process(WatchedEvent event) { [javac] ^ [javac] symbol: class WatchedEvent [javac] location: class ZKProducerConsumer [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:86: error: cannot find symbol [javac] boolean produce(String key) throws KeeperException, InterruptedException{ [javac] ^ [javac] symbol: class KeeperException [javac] location: class Queue [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:97: error: cannot find symbol [javac] String consume() throws KeeperException, InterruptedException { [javac] ^ [javac] symbol: class KeeperException [javac] location: class Queue [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientFilter.java:25:
warning: [deprecation] FilteringIterator in
org.apache.accumulo.core.iterators has been deprecated [javac] import org.apache.accumulo.core.iterators.FilteringIterator; [javac] ^ [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientFilter.java:43: error: cannot find symbol [javac] private Text _colFam = new Text(""); [javac] ^ [javac] symbol: class Text [javac] location: class AccumuloClientFilter [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientFilter.java:255: error: cannot find symbol [javac] private void deleteRow(String table, Text row) { [javac] ^ [javac] symbol: class Text [javac] location: class AccumuloClientFilter [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientFilter.java:291: error: cannot find symbol [javac] private Scanner getRow(String table, Text row, Set<String> fields) { [javac]

Re: YCSB++ dbcompile

Eric Newton 2013-03-05, 21:56

You need to provide the hadoop and zookeeper jar files, too.

-Eric

On Tue, Mar 5, 2013 at 4:52 PM, David Lynch <[EMAIL PROTECTED]> wrote:

> Apologies, forgot to include errors; Any help appreciated.
>
> Dave
>
>
> dbcompile-accumulo:
>
> dbcompile:
> [javac] Compiling 6 source files to
> /usr/local/YCSB-master/build/classes
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:28:
> error: package org.apache.hadoop.io does not exist
> [javac] import org.apache.hadoop.io.Text;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:29:
> error: package org.apache.zookeeper does not exist
> [javac] import org.apache.zookeeper.KeeperException;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:48:
> error: cannot find symbol
> [javac] private Text _colFam = new Text("");
> [javac] ^
> [javac] symbol: class Text
> [javac] location: class AccumuloClient
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:7:
> error: package org.apache.zookeeper does not exist
> [javac] import org.apache.zookeeper.CreateMode;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:8:
> error: package org.apache.zookeeper does not exist
> [javac] import org.apache.zookeeper.KeeperException;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:9:
> error: package org.apache.zookeeper does not exist
> [javac] import org.apache.zookeeper.WatchedEvent;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:10:
> error: package org.apache.zookeeper does not exist
> [javac] import org.apache.zookeeper.Watcher;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:11:
> error: package org.apache.zookeeper does not exist
> [javac] import org.apache.zookeeper.ZooKeeper;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:12:
> error: package org.apache.zookeeper.ZooDefs does not exist
> [javac] import org.apache.zookeeper.ZooDefs.Ids;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:13:
> error: package org.apache.zookeeper.data does not exist
> [javac] import org.apache.zookeeper.data.Stat;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:17:
> error: cannot find symbol
> [javac] public class ZKProducerConsumer implements Watcher {
> [javac] ^
> [javac] symbol: class Watcher
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:156:
> error: cannot find symbol
> [javac] private Scanner getRow(Text row, Set<String> fields)
> [javac] ^
> [javac] symbol: class Text
> [javac] location: class AccumuloClient
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:322:
> error: cannot find symbol
> [javac] private void deleteRow(Text row) throws
> TableNotFoundException {
> [javac] ^

RE: YCSB++ dbcompile

David Lynch 2013-03-05, 22:35

I had the zookeeper jar in YCSB-master/lib and the Hadoop and Accumulo jar in /YCSB-master/db/accumulo/lib however I did not have the Hadoop main directory jars from /usr/local/hadoop once I copied those the build was successful!

However it still gave some warning....that some files had been deprecated would this cause any further errors?

Thanks Again,
Dave
root@ip-10-48-242-6:/usr/local/YCSB-master# ant dbcompile-accumulo
Buildfile: /usr/local/YCSB-master/build.xml

compile:
   [mkdir] Created dir: /usr/local/YCSB-master/build/classes
   [javac] Compiling 47 source files to /usr/local/YCSB-master/build/classes

makejar:
   [jar] Building jar: /usr/local/YCSB-master/build/ycsb.jar

dbcompile-accumulo:

dbcompile:
   [javac] Compiling 6 source files to /usr/local/YCSB-master/build/classes
   [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientFilter.java:25: warning: [deprecation] FilteringIterator in org.apache.accumulo.core.iterators has been deprecated
   [javac] import org.apache.accumulo.core.iterators.FilteringIterator;
   [javac] ^
   [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientUniqueFamily.java:25: warning: [deprecation] FilteringIterator in org.apache.accumulo.core.iterators has been deprecated
   [javac] import org.apache.accumulo.core.iterators.FilteringIterator;
   [javac] ^
   [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientMatchPercentage.java:222: warning: [deprecation] setValueRegex(String) in ScannerBase has been deprecated
   [javac] _scanScanner.setValueRegex("a{"+(101-_matchPercentage)+"}");
   [javac] ^
   [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientMatchPercentage.java:385: warning: [deprecation] setValueRegex(String) in ScannerBase has been deprecated
   [javac] _singleScanner.setValueRegex("a{"+(101-_matchPercentage)+"}");
   [javac] ^
   [javac] 4 warnings

makejar:
   [jar] Building jar: /usr/local/YCSB-master/build/ycsb.jar

BUILD SUCCESSFUL

Date: Tue, 5 Mar 2013 16:56:33 -0500
Subject: Re: YCSB++ dbcompile
From: [EMAIL PROTECTED]
To: [EMAIL PROTECTED]

You need to provide the hadoop and zookeeper jar files, too.
-Eric
On Tue, Mar 5, 2013 at 4:52 PM, David Lynch <[EMAIL PROTECTED]> wrote:
Apologies, forgot to include errors; Any help appreciated.

Dave

dbcompile-accumulo: dbcompile: [javac] Compiling 6 source files to /usr/local/YCSB-master/build/classes
   [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:28:
error: package org.apache.hadoop.io does not exist [javac] import org.apache.hadoop.io.Text; [javac] ^
   [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:29:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.KeeperException; [javac] ^ [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:48: error: cannot find symbol
   [javac] private Text _colFam = new Text(""); [javac] ^ [javac] symbol: class Text [javac] location: class AccumuloClient [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:7:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.CreateMode; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:8:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.KeeperException; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:9:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.WatchedEvent; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:10:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.Watcher; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:11:
error: package org.apache.zookeeper does not exist [javac] import org.apache.zookeeper.ZooKeeper; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:12:
error: package org.apache.zookeeper.ZooDefs does not exist [javac] import org.apache.zookeeper.ZooDefs.Ids; [javac] ^ [javac]
/usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:13:
error: package org.apache.zookeeper.data does not exist [javac] import org.apache.zookeeper.data.Stat; [javac] ^ [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/ZKProducerConsumer.java:17: error: cannot find symbol
   [javac] public class ZKProducerConsumer implements Watcher { [javac] ^ [javac] symbol: class Watcher [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:156: error: cannot find symbol
   [javac] private Scanner getRow(Text row, Set<String> fields) [javac] ^ [javac] symbol: class Text [javac] location: class AccumuloClient
   [javac] /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:322: error: cannot find symbol [javac] private void deleteRow(Text row) throws TableNotFoundException {
   [javac] ^ [javac] symbol: class Text [javac] location:

Re: YCSB++ dbcompile

John Vines 2013-03-05, 22:42

Negative. We deprecate code for at least one release before taking it out,
while trying to keep the same behavior in place. So you should have no
issues with this release, but once 1.6 is released a lot of this code will
no longer work.
On Tue, Mar 5, 2013 at 5:35 PM, David Lynch <[EMAIL PROTECTED]> wrote:

> I had the zookeeper jar in *YCSB-master/lib* and the Hadoop and Accumulo
> jar in */YCSB-master/db/accumulo/lib* however I did not have the Hadoop
> main directory jars from */usr/local/hadoop* once I copied those the
> build was successful!
>
> However it still gave some warning....that some files had been deprecated
> would this cause any further errors?
>
> Thanks Again,
> Dave
>
>
> root@ip-10-48-242-6:/usr/local/YCSB-master# ant dbcompile-accumulo
>
> Buildfile: /usr/local/YCSB-master/build.xml
>
> compile:
> [mkdir] Created dir: /usr/local/YCSB-master/build/classes
> [javac] Compiling 47 source files to
> /usr/local/YCSB-master/build/classes
>
> makejar:
> [jar] Building jar: /usr/local/YCSB-master/build/ycsb.jar
>
> dbcompile-accumulo:
>
> dbcompile:
> [javac] Compiling 6 source files to
> /usr/local/YCSB-master/build/classes
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientFilter.java:25:
> warning: [deprecation] FilteringIterator in
> org.apache.accumulo.core.iterators has been deprecated
> [javac] import org.apache.accumulo.core.iterators.FilteringIterator;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientUniqueFamily.java:25:
> warning: [deprecation] FilteringIterator in
> org.apache.accumulo.core.iterators has been deprecated
> [javac] import org.apache.accumulo.core.iterators.FilteringIterator;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientMatchPercentage.java:222:
> warning: [deprecation] setValueRegex(String) in ScannerBase has been
> deprecated
> [javac]
> _scanScanner.setValueRegex("a{"+(101-_matchPercentage)+"}");
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClientMatchPercentage.java:385:
> warning: [deprecation] setValueRegex(String) in ScannerBase has been
> deprecated
> [javac]
> _singleScanner.setValueRegex("a{"+(101-_matchPercentage)+"}");
> [javac] ^
> [javac] 4 warnings
>
>
> makejar:
> [jar] Building jar: /usr/local/YCSB-master/build/ycsb.jar
>
> BUILD SUCCESSFUL
>
>
>
> ------------------------------
> Date: Tue, 5 Mar 2013 16:56:33 -0500
> Subject: Re: YCSB++ dbcompile
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
>
> You need to provide the hadoop and zookeeper jar files, too.
>
> -Eric
>
>
>
> On Tue, Mar 5, 2013 at 4:52 PM, David Lynch <[EMAIL PROTECTED]>wrote:
>
> Apologies, forgot to include errors; Any help appreciated.
>
> Dave
>
>
> dbcompile-accumulo:
>
> dbcompile:
> [javac] Compiling 6 source files to
> /usr/local/YCSB-master/build/classes
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:28:
> error: package org.apache.hadoop.io does not exist
> [javac] import org.apache.hadoop.io.Text;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:29:
> error: package org.apache.zookeeper does not exist
> [javac] import org.apache.zookeeper.KeeperException;
> [javac] ^
> [javac]
> /usr/local/YCSB-master/db/accumulo/src/com/yahoo/ycsb/db/AccumuloClient.java:48:
> error: cannot find symbol
> [javac] private Text _colFam = new Text("");
> [javac] ^
> [javac] symbol: class Text
> [javac] location: class AccumuloClient
> [javac]