Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # user - Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings


Copy link to this message
-
Re: Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings
Carlos Mundi 2013-08-04, 02:49
Josh,

You are exactly correct.  It needed 'true'.  I'm i the accumulo shell now!

Yeah! Thanks!
Carlos
On Sat, Aug 3, 2013 at 7:31 PM, Josh Elser <[EMAIL PROTECTED]> wrote:

> Yes, I believe the value used to be "true".
>
>
> On 08/03/2013 10:27 PM, Carlos Mundi wrote:
>
>> Hi Josh,
>>
>> Thanks for your reply!  I set dfs.durable.sync to 1 in my hdfs-site.xml
>> like this:
>>
>> <property>
>>   <name>dfs.durable.sync</name>
>>   <value>1</value>
>> </property>
>>
>>
>> And then I stopped and restarted the whole chain: hadoop, zookeeper,
>> accumulo.
>>
>> Same results!  So I'm not sure what's going on.  Maybe hadoop needs
>> 'true' instead of '1'.
>>
>> I'm tinkering with it and will report any new info.
>>
>> Cheers!
>> Carlos
>>
>>
>>
>>
>> On Sat, Aug 3, 2013 at 7:21 PM, Josh Elser <[EMAIL PROTECTED] <mailto:
>> [EMAIL PROTECTED]>> wrote:
>>
>>     Hi Carlos,
>>
>>     I pulled down the Apache Hadoop 1.2.0 source release and took a
>>     look at src/hdfs/hdfs-default.xml. Reading the description on the
>>     dfs.support.append property, dfs.support.append isn't supported
>>     and dfs.durable.sync is enabled by default. Looks like we need to
>>     change that check in the TabletServer code.
>>
>>     In the mean time, you can likely set that property in your
>>     hdfs-site.xml to be true to fake out the tablet server and make it
>>     think that it's set.
>>
>>     Thanks for letting us know!
>>
>>     - Josh
>>
>>
>>     On 08/03/2013 10:01 PM, Carlos Mundi wrote:
>>
>>         Hi.
>>
>>         This is my first time setting up accumulo.  So I'm starting
>>         with a single node "cluster" on Ubuntu 13.04.  My setup is...
>>
>>         hadoop      1.2.0 (prebuilt tarball from Apache) -- The
>>         version will turn out to be important!
>>         zookeeper   3.4.5 (prebuilt tarball from Apache)
>>         accumulo    1.5.0 (custom build, to target hadoop 1.2)
>>
>>         As I understand, because I am running hadoop 1.2, I need to do
>>         a custom build.  So I did, following the README for Accumulo.
>>
>>         So I fire up hadoop, then zookeeper and then accumulo. Looks
>>         good so far:
>>
>>         $ jps
>>         21231 SecondaryNameNode
>>         20733 NameNode
>>         24274 Jps
>>         22556 Main
>>         21994 Main
>>         20978 DataNode
>>         22306 Main
>>         21764 QuorumPeerMain
>>         21570 TaskTracker
>>         22409 Main
>>         21322 JobTracker
>>
>>         Then I try to fire up an accumulo shell (still following the
>>         README) and I am told that there are no tablet servers!  Here
>>         is what I get in /usr/local/accumulo/logs/**tracer_mybox.log:
>>
>>         2013-08-03 18:32:44,918 [impl.ServerClient] WARN : There are
>>         no tablet servers: check that zookeeper and accumulo are running.
>>
>>         I check jps, and everything is still running.  And here is
>>         what I have in /usr/local/accumulo/logs/**tserver_mybox.log:
>>
>>         2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL:
>>         Must set dfs.durable.sync OR dfs.support.append to true.
>>          Which one needs to be set depends on your version of HDFS.
>>          See ACCUMULO-623.
>>           HADOOP RELEASE          VERSION           SYNC NAME DEFAULT
>>           Apache Hadoop           0.20.205  dfs.support.append false
>>           Apache Hadoop            0.23.x dfs.support.append true
>>           Apache Hadoop             1.0.x dfs.support.append false
>>           Apache Hadoop             1.1.x dfs.durable.sync true
>>           Apache Hadoop          2.0.0-2.0.2  dfs.support.append true
>>           Cloudera CDH             3u0-3u3             ????
>>      true
>>           Cloudera CDH               3u4  dfs.support.append    true
>>           Hortonworks HDP           `1.0  dfs.support.append    false
>>           Hortonworks HDP           `1.1  dfs.support.append    false
>>
>>         And, yes, I remember seeing that in the README.  But now you