Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> importdirectory in accumulo


Copy link to this message
-
Re: importdirectory in accumulo
On Thu, Apr 4, 2013 at 10:27 AM, Aji Janis <[EMAIL PROTECTED]> wrote:

> I thought about the permissions issue too. All the accumulo stuff is under
> accumulo user so I started running the commands as accumulo ... only to get
> the same result.
> -The errors happen right away
> -the box has both accumulo and hadoop on it
> -the jar contains the instance class. But note that the instance class is
> part of accumulo-core and not examples-simple-1.4.2.jar .... (can this be
> the issue?)
>

No, that isn't the issue.  tool.sh is finding the accumulo-core jar and
putting it on the HADOOP_CLASSPATH and in the libjars.

I wonder if your hadoop environment is set up to override the
HADOOP_CLASSPATH.  Check in your hadoop-env.sh to see if HADOOP_CLASSPATH
is set there.

The reason your commands of the form "tool.sh lib/*jar" aren't working is
that the regex is finding multiple jars and putting them all on the command
line.  tool.sh expects at most one jar followed by a class name, so
whatever jar comes second when the regex is expanded is being interpreted
as a class name.

Billie

>
> Commands I ran:
>
> *[accumulo@node accumulo]$ whoami*
> accumulo
> *[accumulo@node accumulo]$ ls -l*
> total 184
> drwxr-xr-x 2 accumulo accumulo  4096 Apr  4 10:25 bin
> -rwxr-xr-x 1 accumulo accumulo 24263 Oct 22 15:30 CHANGES
> drwxr-xr-x 3 accumulo accumulo  4096 Apr  3 10:17 conf
> drwxr-xr-x 2 accumulo accumulo  4096 Jan 15 13:35 contrib
> -rwxr-xr-x 1 accumulo accumulo   695 Nov 18  2011 DISCLAIMER
> drwxr-xr-x 5 accumulo accumulo  4096 Jan 15 13:35 docs
> drwxr-xr-x 4 accumulo accumulo  4096 Jan 15 13:35 lib
> -rwxr-xr-x 1 accumulo accumulo 56494 Mar 21  2012 LICENSE
> drwxr-xr-x 2 accumulo accumulo 12288 Apr  3 14:43 logs
> -rwxr-xr-x 1 accumulo accumulo  2085 Mar 21  2012 NOTICE
> -rwxr-xr-x 1 accumulo accumulo 27814 Oct 17 08:32 pom.xml
> -rwxr-xr-x 1 accumulo accumulo 12449 Oct 17 08:32 README
> drwxr-xr-x 9 accumulo accumulo  4096 Nov  8 13:40 src
> drwxr-xr-x 5 accumulo accumulo  4096 Nov  8 13:40 test
> drwxr-xr-x 2 accumulo accumulo  4096 Apr  4 09:09 walogs
> *[accumulo@node accumulo]$ ls bin/*
> accumulo           check-slaves  etc_initd_accumulo  start-all.sh
> start-server.sh  stop-here.sh    tdown.sh  tup.sh
> catapultsetup.acc  config.sh     LogForwarder.sh     start-here.sh
>  stop-all.sh      stop-server.sh  tool.sh   upgrade.sh
> *[accumulo@node accumulo]$ ls lib/*
> accumulo-core-1.4.2.jar            accumulo-start-1.4.2.jar
>  commons-collections-3.2.jar    commons-logging-1.0.4.jar
>  jline-0.9.94.jar
> accumulo-core-1.4.2-javadoc.jar    accumulo-start-1.4.2-javadoc.jar
>  commons-configuration-1.5.jar  commons-logging-api-1.0.4.jar
>  libthrift-0.6.1.jar
> accumulo-core-1.4.2-sources.jar    accumulo-start-1.4.2-sources.jar
>  commons-io-1.4.jar             examples-simple-1.4.2.jar
>  log4j-1.2.16.jar
> accumulo-server-1.4.2.jar          cloudtrace-1.4.2.jar
>  commons-jci-core-1.0.jar       examples-simple-1.4.2-javadoc.jar  native
> accumulo-server-1.4.2-javadoc.jar  cloudtrace-1.4.2-javadoc.jar
>  commons-jci-fam-1.0.jar        examples-simple-1.4.2-sources.jar
>  wikisearch-ingest-1.4.2-javadoc.jar
> accumulo-server-1.4.2-sources.jar  cloudtrace-1.4.2-sources.jar
>  commons-lang-2.4.jar           ext
>  wikisearch-query-1.4.2-javadoc.jar
>
> *[accumulo@node accumulo]$ jar -tf
> /opt/accumulo/lib/accumulo-core-1.4.2.jar | grep
> org/apache/accumulo/core/client/Instance*
> org/apache/accumulo/core/client/Instance.class
>
> *[accumulo@node accumulo]$ jar -tf
> /opt/accumulo/lib/examples-simple-1.4.2.jar | grep
> org/apache/accumulo/core/client/Instance*
> *
> *
> *[accumulo@node accumulo]$ ./bin/tool.sh lib/*[^cs].jar
> org.apache.accumulo.examples.simple.mapreduce.bulk.BulkIngestExample
> myinstance zookeepers user pswd tableName inputDir tmp/bulkWork*
> USERJARS> CLASSNAME=lib/accumulo-server-1.4.2.jar
>
> HADOOP_CLASSPATH=/opt/accumulo/lib/libthrift-0.6.1.jar:/opt/accumulo/lib/accumulo-core-1.4.2.jar:/opt/zookeeper/zookeeper-3.3.3.jar:/opt/accumulo/lib/cloudtrace-1.4.2.jar:/opt/accumulo/lib/commons-collections-3.2.jar:/opt/accumulo/lib/commons-configuration-1.5.jar:/opt/accumulo/lib/commons-io-1.4.jar:/opt/accumulo/lib/commons-jci-core-1.0.jar:/opt/accumulo/lib/commons-jci-fam-1.0.jar:/opt/accumulo/lib/commons-lang-2.4.jar:/opt/accumulo/lib/commons-logging-1.0.4.jar:/opt/accumulo/lib/commons-logging-api-1.0.4.jar:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB