-Re: Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings
Carlos Mundi 2013-08-04, 02:27
Thanks for your reply! I set dfs.durable.sync to 1 in my hdfs-site.xml
And then I stopped and restarted the whole chain: hadoop, zookeeper,
Same results! So I'm not sure what's going on. Maybe hadoop needs 'true'
instead of '1'.
I'm tinkering with it and will report any new info.
On Sat, Aug 3, 2013 at 7:21 PM, Josh Elser <[EMAIL PROTECTED]> wrote:
> Hi Carlos,
> I pulled down the Apache Hadoop 1.2.0 source release and took a look at
> src/hdfs/hdfs-default.xml. Reading the description on the
> dfs.support.append property, dfs.support.append isn't supported and
> dfs.durable.sync is enabled by default. Looks like we need to change that
> check in the TabletServer code.
> In the mean time, you can likely set that property in your hdfs-site.xml
> to be true to fake out the tablet server and make it think that it's set.
> Thanks for letting us know!
> - Josh
> On 08/03/2013 10:01 PM, Carlos Mundi wrote:
>> This is my first time setting up accumulo. So I'm starting with a single
>> node "cluster" on Ubuntu 13.04. My setup is...
>> hadoop 1.2.0 (prebuilt tarball from Apache) -- The version will turn
>> out to be important!
>> zookeeper 3.4.5 (prebuilt tarball from Apache)
>> accumulo 1.5.0 (custom build, to target hadoop 1.2)
>> As I understand, because I am running hadoop 1.2, I need to do a custom
>> build. So I did, following the README for Accumulo.
>> So I fire up hadoop, then zookeeper and then accumulo. Looks good so far:
>> $ jps
>> 21231 SecondaryNameNode
>> 20733 NameNode
>> 24274 Jps
>> 22556 Main
>> 21994 Main
>> 20978 DataNode
>> 22306 Main
>> 21764 QuorumPeerMain
>> 21570 TaskTracker
>> 22409 Main
>> 21322 JobTracker
>> Then I try to fire up an accumulo shell (still following the README) and
>> I am told that there are no tablet servers! Here is what I get in
>> 2013-08-03 18:32:44,918 [impl.ServerClient] WARN : There are no tablet
>> servers: check that zookeeper and accumulo are running.
>> I check jps, and everything is still running. And here is what I have in
>> 2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL: Must set
>> dfs.durable.sync OR dfs.support.append to true. Which one needs to be set
>> depends on your version of HDFS. See ACCUMULO-623.
>> HADOOP RELEASE VERSION SYNC NAME DEFAULT
>> Apache Hadoop 0.20.205 dfs.support.append false
>> Apache Hadoop 0.23.x dfs.support.append true
>> Apache Hadoop 1.0.x dfs.support.append false
>> Apache Hadoop 1.1.x dfs.durable.sync true
>> Apache Hadoop 2.0.0-2.0.2 dfs.support.append true
>> Cloudera CDH 3u0-3u3 ???? true
>> Cloudera CDH 3u4 dfs.support.append true
>> Hortonworks HDP `1.0 dfs.support.append false
>> Hortonworks HDP `1.1 dfs.support.append false
>> And, yes, I remember seeing that in the README. But now you see my
>> problem. Hadoop 1.2 is not on the list!
>> At least, I assume that's my only problem. :)
>> Can someone please tell me which of the two dfs options I need?
>> Thanks very much!