Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo, mail # user - Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings


+
Carlos Mundi 2013-08-04, 02:01
Copy link to this message
-
Re: Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings
Josh Elser 2013-08-04, 02:21
Hi Carlos,

I pulled down the Apache Hadoop 1.2.0 source release and took a look at
src/hdfs/hdfs-default.xml. Reading the description on the
dfs.support.append property, dfs.support.append isn't supported and
dfs.durable.sync is enabled by default. Looks like we need to change
that check in the TabletServer code.

In the mean time, you can likely set that property in your hdfs-site.xml
to be true to fake out the tablet server and make it think that it's set.

Thanks for letting us know!

- Josh

On 08/03/2013 10:01 PM, Carlos Mundi wrote:
> Hi.
>
> This is my first time setting up accumulo.  So I'm starting with a
> single node "cluster" on Ubuntu 13.04.  My setup is...
>
> hadoop      1.2.0 (prebuilt tarball from Apache) -- The version will
> turn out to be important!
> zookeeper   3.4.5 (prebuilt tarball from Apache)
> accumulo    1.5.0 (custom build, to target hadoop 1.2)
>
> As I understand, because I am running hadoop 1.2, I need to do a
> custom build.  So I did, following the README for Accumulo.
>
> So I fire up hadoop, then zookeeper and then accumulo. Looks good so far:
>
> $ jps
> 21231 SecondaryNameNode
> 20733 NameNode
> 24274 Jps
> 22556 Main
> 21994 Main
> 20978 DataNode
> 22306 Main
> 21764 QuorumPeerMain
> 21570 TaskTracker
> 22409 Main
> 21322 JobTracker
>
> Then I try to fire up an accumulo shell (still following the README)
> and I am told that there are no tablet servers!  Here is what I get in
> /usr/local/accumulo/logs/tracer_mybox.log:
>
> 2013-08-03 18:32:44,918 [impl.ServerClient] WARN : There are no tablet
> servers: check that zookeeper and accumulo are running.
>
> I check jps, and everything is still running.  And here is what I have
> in /usr/local/accumulo/logs/tserver_mybox.log:
>
> 2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL: Must set
> dfs.durable.sync OR dfs.support.append to true.  Which one needs to be
> set depends on your version of HDFS.  See ACCUMULO-623.
>   HADOOP RELEASE          VERSION           SYNC NAME DEFAULT
>   Apache Hadoop           0.20.205          dfs.support.append false
>   Apache Hadoop            0.23.x           dfs.support.append true
>   Apache Hadoop             1.0.x           dfs.support.append false
>   Apache Hadoop             1.1.x           dfs.durable.sync true
>   Apache Hadoop          2.0.0-2.0.2        dfs.support.append true
>   Cloudera CDH             3u0-3u3             ????               true
>   Cloudera CDH               3u4            dfs.support.append    true
>   Hortonworks HDP           `1.0            dfs.support.append    false
>   Hortonworks HDP           `1.1            dfs.support.append    false
>
> And, yes, I remember seeing that in the README.  But now you see my
> problem.  Hadoop 1.2 is not on the list!
>
> At least, I assume that's my only problem.  :)
>
> Can someone please tell me which of the two dfs options I need?
>
> Thanks very much!
>
> Carlos
>
>
+
Carlos Mundi 2013-08-04, 02:27
+
Josh Elser 2013-08-04, 02:31
+
Carlos Mundi 2013-08-04, 02:49
+
Josh Elser 2013-08-04, 02:55