Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo, mail # user - importdirectory in accumulo


+
Aji Janis 2013-04-03, 18:04
+
Aji Janis 2013-04-03, 18:15
+
John Vines 2013-04-03, 18:17
+
Eric Newton 2013-04-03, 18:19
+
Aji Janis 2013-04-03, 18:29
+
Eric Newton 2013-04-03, 18:36
+
Aji Janis 2013-04-03, 20:11
+
Christopher 2013-04-03, 20:16
+
Billie Rinaldi 2013-04-03, 20:57
+
Aji Janis 2013-04-04, 13:33
+
Eric Newton 2013-04-04, 13:55
+
Aji Janis 2013-04-04, 13:59
+
Aji Janis 2013-04-04, 14:14
+
John Vines 2013-04-04, 14:18
+
Aji Janis 2013-04-04, 14:46
+
Billie Rinaldi 2013-04-04, 15:55
+
Aji Janis 2013-04-04, 17:27
+
Billie Rinaldi 2013-04-04, 18:25
+
Aji Janis 2013-04-04, 18:41
+
Aji Janis 2013-04-04, 18:49
+
Billie Rinaldi 2013-04-04, 18:51
Copy link to this message
-
Re: importdirectory in accumulo
Aji Janis 2013-04-04, 19:26
I haven't tried the classpath option yet, but I executed the below command
as hadoop user ... this seemed to be the command that accumulo was trying
to execute anyway and I am not sure but I would think this should have
avoided the custom classpath issue... Right/Wrong?
Got the same error:
*[hadoop@node]$ /opt/hadoop/bin/hadoop jar
/opt/accumulo/lib/examples-simple-1.4.2.jar
org.apache.accumulo.examples.simple.mapreduce.bulk.BulkIngestExample
-libjars
"/opt/accumulo/lib/libthrift-0.6.1.jar,/opt/accumulo/lib/accumulo-core-1.4.2.jar,/opt/zookeeper/zookeeper-3.3.3.jar,/opt/accumulo/lib/cloudtrace-1.4.2.jar,/opt/accumulo/lib/commons-collections-3.2.jar,/opt/accumulo/lib/commons-configuration-1.5.jar,/opt/accumulo/lib/commons-io-1.4.jar,/opt/accumulo/lib/commons-jci-core-1.0.jar,/opt/accumulo/lib/commons-jci-fam-1.0.jar,/opt/accumulo/lib/commons-lang-2.4.jar,/opt/accumulo/lib/commons-logging-1.0.4.jar,/opt/accumulo/lib/commons-logging-api-1.0.4.jar"
*
*
*
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/accumulo/core/client/Instance
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:149)
Caused by: java.lang.ClassNotFoundException:
org.apache.accumulo.core.client.Instance
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
        ... 3 more

On Thu, Apr 4, 2013 at 2:51 PM, Billie Rinaldi <[EMAIL PROTECTED]> wrote:

> On Thu, Apr 4, 2013 at 11:41 AM, Aji Janis <[EMAIL PROTECTED]> wrote:
>
>> *[accumulo@node accumulo]$ cat /opt/hadoop/conf/hadoop-env.sh | grep
>> HADOOP_CLASSPATH*
>> export HADOOP_CLASSPATH=./:/conf:/build/*:
>>
>
> To preserve custom HADOOP_CLASSPATHs, this line should be:
> export HADOOP_CLASSPATH=./:/conf:/build/*:$HADOOP_CLASSPATH
>
> Billie
>
>
>
>>
>> looks like it is overwriting everything. Isn't this the default behavior?
>> Is you hadoop-env.sh missing that line?
>>
>>
>>
>>
>> On Thu, Apr 4, 2013 at 2:25 PM, Billie Rinaldi <[EMAIL PROTECTED]> wrote:
>>
>>> On Thu, Apr 4, 2013 at 10:27 AM, Aji Janis <[EMAIL PROTECTED]> wrote:
>>>
>>>> I thought about the permissions issue too. All the accumulo stuff is
>>>> under accumulo user so I started running the commands as accumulo ... only
>>>> to get the same result.
>>>> -The errors happen right away
>>>> -the box has both accumulo and hadoop on it
>>>> -the jar contains the instance class. But note that the instance class
>>>> is part of accumulo-core and not examples-simple-1.4.2.jar .... (can this
>>>> be the issue?)
>>>>
>>>
>>> No, that isn't the issue.  tool.sh is finding the accumulo-core jar and
>>> putting it on the HADOOP_CLASSPATH and in the libjars.
>>>
>>> I wonder if your hadoop environment is set up to override the
>>> HADOOP_CLASSPATH.  Check in your hadoop-env.sh to see if HADOOP_CLASSPATH
>>> is set there.
>>>
>>> The reason your commands of the form "tool.sh lib/*jar" aren't working
>>> is that the regex is finding multiple jars and putting them all on the
>>> command line.  tool.sh expects at most one jar followed by a class name, so
>>> whatever jar comes second when the regex is expanded is being interpreted
>>> as a class name.
>>>
>>> Billie
>>>
>>>
>>>
>>>>
>>>> Commands I ran:
>>>>
>>>> *[accumulo@node accumulo]$ whoami*
>>>> accumulo
>>>> *[accumulo@node accumulo]$ ls -l*
>>>> total 184
>>>> drwxr-xr-x 2 accumulo accumulo  4096 Apr  4 10:25 bin
>>>> -rwxr-xr-x 1 accumulo accumulo 24263 Oct 22 15:30 CHANGES
>>>> drwxr-xr-x 3 accumulo accumulo  4096 Apr  3 10:17 conf
>>>> drwxr-xr-x 2 accumulo accumulo  4096 Jan 15 13:35 contrib
>>>> -rwxr-xr-x 1 accumulo accumulo   695 Nov 18  2011 DISCLAIMER
+
Billie Rinaldi 2013-04-04, 19:51
+
Aji Janis 2013-04-05, 15:36
+
David Medinets 2013-04-05, 22:01
+
Keith Turner 2013-04-08, 18:14
+
David Medinets 2013-04-08, 19:03
+
Billie Rinaldi 2013-04-05, 20:06
+
Billie Rinaldi 2013-04-04, 14:09
+
Aji Janis 2013-04-03, 20:23