Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> can't initialize on hadoop 2.0


+
Chris Retford 2013-06-28, 22:29
+
John Vines 2013-06-28, 22:45
+
Chris Retford 2013-06-28, 23:06
Copy link to this message
-
Re: can't initialize on hadoop 2.0
I've been working on this against cdh4 (with MR1)

Here's the updated accumulo site values I've been using against a CM
deployed Hadoop2:

 <property>
      <name>general.classpaths</name>
      <value>
    $ACCUMULO_HOME/src/server/target/classes/,
    $ACCUMULO_HOME/src/core/target/classes/,
    $ACCUMULO_HOME/src/start/target/classes/,
    $ACCUMULO_HOME/src/examples/target/classes/,
        $ACCUMULO_HOME/lib/[^.].$ACCUMULO_VERSION.jar,
        $ACCUMULO_HOME/lib/[^.].*.jar,
        $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
        $HADOOP_HOME/conf,
        $HADOOP_HOME/[^.].*.jar,
        $HADOOP_HOME/lib/[^.].*.jar,
        $HADOOP_CONF_DIR,
        /etc/hadoop/conf,
        /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/[^.].*.jar,
        /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/lib/[^.].*.jar,
        /opt/cloudera/parcels/CDH/lib/hadoop/client-0.20/[^.].*.jar,
        /opt/cloudera/parcels/CDH/lib/hadoop/client-0.20/lib/[^.].*.jar,
      </value>

Hope it helps.

Jon.
On Fri, Jun 28, 2013 at 4:06 PM, Chris Retford <[EMAIL PROTECTED]>wrote:

> Yeah, thanks, that was the ticket. In the general.classpaths section of
> accumulo-site.xml, I added /usr/lib/hadoop-hdfs/.*.jar and
> /usr/lib/hadoop-hdfs/lib/.*.jar. I assume I'll have to add the hadoop-yarn
> and -mapreduce folders as well if I want to run jobs.
>
>
> On Fri, Jun 28, 2013 at 4:45 PM, John Vines <[EMAIL PROTECTED]> wrote:
>
>> IIRC, there's a bit of craziness with the packaging for some of the
>> releases of hadoop2. I believe in them there is a separate hadoop-hdfs in
>> /usr/lib. Add that, with the appropriate expression to the general
>> classpaths option in the accumulo-site.xml file. I don't have the VMs in
>> front of me, so I apologize for not being able to give clearer instructions.
>>
>>
>> On Fri, Jun 28, 2013 at 6:29 PM, Chris Retford <[EMAIL PROTECTED]>wrote:
>>
>>> I have performed the following steps:
>>>
>>> 1) Downloaded the just-released Hortonworks 2 sandbox VM (I have also
>>> tried CDH4 VM, and get the same error). Verified HDFS and ZK up and usable.
>>> 2) Downloaded the Accumulo 1.5.0 binary tgz and copied the 512 MB
>>> example conf.
>>> 3) Modified accumulo-env.sh with
>>>      HADOOP_HOME=/usr/lib/hadoop,
>>>      HADOOP_CONF_DIR=/etc/hadoop/conf,
>>>      ZOOKEEPER_HOME=/usr/lib/zookeeper
>>> 4) ./bin/accumulo init
>>>
>>> Got the following error:
>>> Thread "init" died null
>>> java.lang.reflect.InvocationTargetException
>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>         at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>         at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>         at org.apache.accumulo.start.Main$1.run(Main.java:101)
>>>         at java.lang.Thread.run(Thread.java:662)
>>> Caused by: java.lang.RuntimeException: java.io.IOException: No
>>> FileSystem for scheme: hdfs
>>>         at
>>> org.apache.accumulo.server.util.Initialize.main(Initialize.java:498)
>>>         ... 6 more
>>> Caused by: java.io.IOException: No FileSystem for scheme: hdfs
>>>         at
>>> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2345)
>>>         at
>>> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2352)
>>>         at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:87)
>>>         at
>>> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2391)
>>>         at
>>> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2373)
>>>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:352)
>>>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:164)
>>>         at
>>> org.apache.accumulo.core.file.FileUtil.getFileSystem(FileUtil.java:550)
>>>         at
>>> org.apache.accumulo.server.util.Initialize.main(Initialize.java:485)
>>>         ... 6 more
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB