-Re: Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings
Josh Elser 2013-08-04, 02:21
I pulled down the Apache Hadoop 1.2.0 source release and took a look at
src/hdfs/hdfs-default.xml. Reading the description on the
dfs.support.append property, dfs.support.append isn't supported and
dfs.durable.sync is enabled by default. Looks like we need to change
that check in the TabletServer code.
In the mean time, you can likely set that property in your hdfs-site.xml
to be true to fake out the tablet server and make it think that it's set.
Thanks for letting us know!
On 08/03/2013 10:01 PM, Carlos Mundi wrote:
> This is my first time setting up accumulo. So I'm starting with a
> single node "cluster" on Ubuntu 13.04. My setup is...
> hadoop 1.2.0 (prebuilt tarball from Apache) -- The version will
> turn out to be important!
> zookeeper 3.4.5 (prebuilt tarball from Apache)
> accumulo 1.5.0 (custom build, to target hadoop 1.2)
> As I understand, because I am running hadoop 1.2, I need to do a
> custom build. So I did, following the README for Accumulo.
> So I fire up hadoop, then zookeeper and then accumulo. Looks good so far:
> $ jps
> 21231 SecondaryNameNode
> 20733 NameNode
> 24274 Jps
> 22556 Main
> 21994 Main
> 20978 DataNode
> 22306 Main
> 21764 QuorumPeerMain
> 21570 TaskTracker
> 22409 Main
> 21322 JobTracker
> Then I try to fire up an accumulo shell (still following the README)
> and I am told that there are no tablet servers! Here is what I get in
> 2013-08-03 18:32:44,918 [impl.ServerClient] WARN : There are no tablet
> servers: check that zookeeper and accumulo are running.
> I check jps, and everything is still running. And here is what I have
> in /usr/local/accumulo/logs/tserver_mybox.log:
> 2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL: Must set
> dfs.durable.sync OR dfs.support.append to true. Which one needs to be
> set depends on your version of HDFS. See ACCUMULO-623.
> HADOOP RELEASE VERSION SYNC NAME DEFAULT
> Apache Hadoop 0.20.205 dfs.support.append false
> Apache Hadoop 0.23.x dfs.support.append true
> Apache Hadoop 1.0.x dfs.support.append false
> Apache Hadoop 1.1.x dfs.durable.sync true
> Apache Hadoop 2.0.0-2.0.2 dfs.support.append true
> Cloudera CDH 3u0-3u3 ???? true
> Cloudera CDH 3u4 dfs.support.append true
> Hortonworks HDP `1.0 dfs.support.append false
> Hortonworks HDP `1.1 dfs.support.append false
> And, yes, I remember seeing that in the README. But now you see my
> problem. Hadoop 1.2 is not on the list!
> At least, I assume that's my only problem. :)
> Can someone please tell me which of the two dfs options I need?
> Thanks very much!