-Re: Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings
Carlos Mundi 2013-08-04, 02:49
You are exactly correct. It needed 'true'. I'm i the accumulo shell now!
On Sat, Aug 3, 2013 at 7:31 PM, Josh Elser <[EMAIL PROTECTED]> wrote:
> Yes, I believe the value used to be "true".
> On 08/03/2013 10:27 PM, Carlos Mundi wrote:
>> Hi Josh,
>> Thanks for your reply! I set dfs.durable.sync to 1 in my hdfs-site.xml
>> like this:
>> And then I stopped and restarted the whole chain: hadoop, zookeeper,
>> Same results! So I'm not sure what's going on. Maybe hadoop needs
>> 'true' instead of '1'.
>> I'm tinkering with it and will report any new info.
>> On Sat, Aug 3, 2013 at 7:21 PM, Josh Elser <[EMAIL PROTECTED] <mailto:
>> [EMAIL PROTECTED]>> wrote:
>> Hi Carlos,
>> I pulled down the Apache Hadoop 1.2.0 source release and took a
>> look at src/hdfs/hdfs-default.xml. Reading the description on the
>> dfs.support.append property, dfs.support.append isn't supported
>> and dfs.durable.sync is enabled by default. Looks like we need to
>> change that check in the TabletServer code.
>> In the mean time, you can likely set that property in your
>> hdfs-site.xml to be true to fake out the tablet server and make it
>> think that it's set.
>> Thanks for letting us know!
>> - Josh
>> On 08/03/2013 10:01 PM, Carlos Mundi wrote:
>> This is my first time setting up accumulo. So I'm starting
>> with a single node "cluster" on Ubuntu 13.04. My setup is...
>> hadoop 1.2.0 (prebuilt tarball from Apache) -- The
>> version will turn out to be important!
>> zookeeper 3.4.5 (prebuilt tarball from Apache)
>> accumulo 1.5.0 (custom build, to target hadoop 1.2)
>> As I understand, because I am running hadoop 1.2, I need to do
>> a custom build. So I did, following the README for Accumulo.
>> So I fire up hadoop, then zookeeper and then accumulo. Looks
>> good so far:
>> $ jps
>> 21231 SecondaryNameNode
>> 20733 NameNode
>> 24274 Jps
>> 22556 Main
>> 21994 Main
>> 20978 DataNode
>> 22306 Main
>> 21764 QuorumPeerMain
>> 21570 TaskTracker
>> 22409 Main
>> 21322 JobTracker
>> Then I try to fire up an accumulo shell (still following the
>> README) and I am told that there are no tablet servers! Here
>> is what I get in /usr/local/accumulo/logs/**tracer_mybox.log:
>> 2013-08-03 18:32:44,918 [impl.ServerClient] WARN : There are
>> no tablet servers: check that zookeeper and accumulo are running.
>> I check jps, and everything is still running. And here is
>> what I have in /usr/local/accumulo/logs/**tserver_mybox.log:
>> 2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL:
>> Must set dfs.durable.sync OR dfs.support.append to true.
>> Which one needs to be set depends on your version of HDFS.
>> See ACCUMULO-623.
>> HADOOP RELEASE VERSION SYNC NAME DEFAULT
>> Apache Hadoop 0.20.205 dfs.support.append false
>> Apache Hadoop 0.23.x dfs.support.append true
>> Apache Hadoop 1.0.x dfs.support.append false
>> Apache Hadoop 1.1.x dfs.durable.sync true
>> Apache Hadoop 2.0.0-2.0.2 dfs.support.append true
>> Cloudera CDH 3u0-3u3 ????
>> Cloudera CDH 3u4 dfs.support.append true
>> Hortonworks HDP `1.0 dfs.support.append false
>> Hortonworks HDP `1.1 dfs.support.append false
>> And, yes, I remember seeing that in the README. But now you