Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings


+
Carlos Mundi 2013-08-04, 02:01
+
Josh Elser 2013-08-04, 02:21
Copy link to this message
-
Re: Accumulo with Hadoop 1.2.0 -- no tablet servers & dfs settings
Hi Josh,

Thanks for your reply!  I set dfs.durable.sync to 1 in my hdfs-site.xml
like this:

<property>
  <name>dfs.durable.sync</name>
  <value>1</value>
</property>
And then I stopped and restarted the whole chain: hadoop, zookeeper,
accumulo.

Same results!  So I'm not sure what's going on.  Maybe hadoop needs 'true'
instead of '1'.

I'm tinkering with it and will report any new info.

Cheers!
Carlos
On Sat, Aug 3, 2013 at 7:21 PM, Josh Elser <[EMAIL PROTECTED]> wrote:

> Hi Carlos,
>
> I pulled down the Apache Hadoop 1.2.0 source release and took a look at
> src/hdfs/hdfs-default.xml. Reading the description on the
> dfs.support.append property, dfs.support.append isn't supported and
> dfs.durable.sync is enabled by default. Looks like we need to change that
> check in the TabletServer code.
>
> In the mean time, you can likely set that property in your hdfs-site.xml
> to be true to fake out the tablet server and make it think that it's set.
>
> Thanks for letting us know!
>
> - Josh
>
>
> On 08/03/2013 10:01 PM, Carlos Mundi wrote:
>
>> Hi.
>>
>> This is my first time setting up accumulo.  So I'm starting with a single
>> node "cluster" on Ubuntu 13.04.  My setup is...
>>
>> hadoop      1.2.0 (prebuilt tarball from Apache) -- The version will turn
>> out to be important!
>> zookeeper   3.4.5 (prebuilt tarball from Apache)
>> accumulo    1.5.0 (custom build, to target hadoop 1.2)
>>
>> As I understand, because I am running hadoop 1.2, I need to do a custom
>> build.  So I did, following the README for Accumulo.
>>
>> So I fire up hadoop, then zookeeper and then accumulo. Looks good so far:
>>
>> $ jps
>> 21231 SecondaryNameNode
>> 20733 NameNode
>> 24274 Jps
>> 22556 Main
>> 21994 Main
>> 20978 DataNode
>> 22306 Main
>> 21764 QuorumPeerMain
>> 21570 TaskTracker
>> 22409 Main
>> 21322 JobTracker
>>
>> Then I try to fire up an accumulo shell (still following the README) and
>> I am told that there are no tablet servers!  Here is what I get in
>> /usr/local/accumulo/logs/**tracer_mybox.log:
>>
>> 2013-08-03 18:32:44,918 [impl.ServerClient] WARN : There are no tablet
>> servers: check that zookeeper and accumulo are running.
>>
>> I check jps, and everything is still running.  And here is what I have in
>> /usr/local/accumulo/logs/**tserver_mybox.log:
>>
>> 2013-08-03 18:32:41,292 [tabletserver.TabletServer] FATAL: Must set
>> dfs.durable.sync OR dfs.support.append to true.  Which one needs to be set
>> depends on your version of HDFS.  See ACCUMULO-623.
>>   HADOOP RELEASE          VERSION           SYNC NAME DEFAULT
>>   Apache Hadoop           0.20.205          dfs.support.append false
>>   Apache Hadoop            0.23.x           dfs.support.append true
>>   Apache Hadoop             1.0.x           dfs.support.append false
>>   Apache Hadoop             1.1.x           dfs.durable.sync true
>>   Apache Hadoop          2.0.0-2.0.2        dfs.support.append true
>>   Cloudera CDH             3u0-3u3             ????               true
>>   Cloudera CDH               3u4            dfs.support.append    true
>>   Hortonworks HDP           `1.0            dfs.support.append    false
>>   Hortonworks HDP           `1.1            dfs.support.append    false
>>
>> And, yes, I remember seeing that in the README.  But now you see my
>> problem.  Hadoop 1.2 is not on the list!
>>
>> At least, I assume that's my only problem.  :)
>>
>> Can someone please tell me which of the two dfs options I need?
>>
>> Thanks very much!
>>
>> Carlos
>>
>>
>>
>
+
Josh Elser 2013-08-04, 02:31
+
Carlos Mundi 2013-08-04, 02:49
+
Josh Elser 2013-08-04, 02:55