Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> can't initialize on hadoop 2.0


Copy link to this message
-
Re: can't initialize on hadoop 2.0
I've been working on this against cdh4 (with MR1)

Here's the updated accumulo site values I've been using against a CM
deployed Hadoop2:

 <property>
      <name>general.classpaths</name>
      <value>
    $ACCUMULO_HOME/src/server/target/classes/,
    $ACCUMULO_HOME/src/core/target/classes/,
    $ACCUMULO_HOME/src/start/target/classes/,
    $ACCUMULO_HOME/src/examples/target/classes/,
        $ACCUMULO_HOME/lib/[^.].$ACCUMULO_VERSION.jar,
        $ACCUMULO_HOME/lib/[^.].*.jar,
        $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
        $HADOOP_HOME/conf,
        $HADOOP_HOME/[^.].*.jar,
        $HADOOP_HOME/lib/[^.].*.jar,
        $HADOOP_CONF_DIR,
        /etc/hadoop/conf,
        /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/[^.].*.jar,
        /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/lib/[^.].*.jar,
        /opt/cloudera/parcels/CDH/lib/hadoop/client-0.20/[^.].*.jar,
        /opt/cloudera/parcels/CDH/lib/hadoop/client-0.20/lib/[^.].*.jar,
      </value>

Hope it helps.

Jon.
On Fri, Jun 28, 2013 at 4:06 PM, Chris Retford <[EMAIL PROTECTED]>wrote:

> Yeah, thanks, that was the ticket. In the general.classpaths section of
> accumulo-site.xml, I added /usr/lib/hadoop-hdfs/.*.jar and
> /usr/lib/hadoop-hdfs/lib/.*.jar. I assume I'll have to add the hadoop-yarn
> and -mapreduce folders as well if I want to run jobs.
>
>
> On Fri, Jun 28, 2013 at 4:45 PM, John Vines <[EMAIL PROTECTED]> wrote:
>
>> IIRC, there's a bit of craziness with the packaging for some of the
>> releases of hadoop2. I believe in them there is a separate hadoop-hdfs in
>> /usr/lib. Add that, with the appropriate expression to the general
>> classpaths option in the accumulo-site.xml file. I don't have the VMs in
>> front of me, so I apologize for not being able to give clearer instructions.
>>
>>
>> On Fri, Jun 28, 2013 at 6:29 PM, Chris Retford <[EMAIL PROTECTED]>wrote:
>>
>>> I have performed the following steps:
>>>
>>> 1) Downloaded the just-released Hortonworks 2 sandbox VM (I have also
>>> tried CDH4 VM, and get the same error). Verified HDFS and ZK up and usable.
>>> 2) Downloaded the Accumulo 1.5.0 binary tgz and copied the 512 MB
>>> example conf.
>>> 3) Modified accumulo-env.sh with
>>>      HADOOP_HOME=/usr/lib/hadoop,
>>>      HADOOP_CONF_DIR=/etc/hadoop/conf,
>>>      ZOOKEEPER_HOME=/usr/lib/zookeeper
>>> 4) ./bin/accumulo init
>>>
>>> Got the following error:
>>> Thread "init" died null
>>> java.lang.reflect.InvocationTargetException
>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>         at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>         at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>         at org.apache.accumulo.start.Main$1.run(Main.java:101)
>>>         at java.lang.Thread.run(Thread.java:662)
>>> Caused by: java.lang.RuntimeException: java.io.IOException: No
>>> FileSystem for scheme: hdfs
>>>         at
>>> org.apache.accumulo.server.util.Initialize.main(Initialize.java:498)
>>>         ... 6 more
>>> Caused by: java.io.IOException: No FileSystem for scheme: hdfs
>>>         at
>>> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2345)
>>>         at
>>> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2352)
>>>         at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:87)
>>>         at
>>> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2391)
>>>         at
>>> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2373)
>>>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:352)
>>>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:164)
>>>         at
>>> org.apache.accumulo.core.file.FileUtil.getFileSystem(FileUtil.java:550)
>>>         at
>>> org.apache.accumulo.server.util.Initialize.main(Initialize.java:485)
>>>         ... 6 more
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]