Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> Problem Running 1.5.0 on Amazon EMR - dfs.support.append not true.


+
David Medinets 2013-05-27, 11:20
+
David Lyle 2013-05-27, 11:44
+
David Lyle 2013-05-27, 11:45
Copy link to this message
-
Re: Problem Running 1.5.0 on Amazon EMR - dfs.support.append not true.
Thanks for the info. Just one dash is needed. It looks like this:

--bootstrap-action s3://elasticmapreduce/bootstrap-actions/configure-hadoop
--args "-h,dfs.support.append=true"

On Mon, May 27, 2013 at 7:45 AM, David Lyle <[EMAIL PROTECTED]> wrote:

> Or even --h,dfs.support.append=true (sorry for the spam, kinda early for
> me).
>
> -D...
>
>
>
> On Mon, May 27, 2013 at 7:44 AM, David Lyle <[EMAIL PROTECTED]> wrote:
>
>> Have you tried a configure hadoop bootstrap action?
>>
>> Try* *--h,dfs.support.append****-key-value=false
>>
>> http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-plan-bootstrap.html#PredefinedbootstrapActions_ConfigureHadoop
>>
>>
>> On Mon, May 27, 2013 at 7:20 AM, David Medinets <[EMAIL PROTECTED]
>> > wrote:
>>
>>> When trying to start tserver on Amazon EMR, you'll see the following
>>> message in the logs:
>>>
>>> 2013-05-27 00:04:43,593 [tabletserver.TabletServer] FATAL: Must set
>>> dfs.durable.sync OR dfs.support.append to true.  Which one needs to be set
>>> depends on your version of HDFS.  See ACCUMULO-623.
>>> HADOOP RELEASE          VERSION           SYNC NAME             DEFAULT
>>> Apache Hadoop           0.20.205          dfs.support.append    false
>>> Apache Hadoop            0.23.x           dfs.support.append    true
>>> Apache Hadoop             1.0.x           dfs.support.append    false
>>> Apache Hadoop             1.1.x           dfs.durable.sync      true
>>> Apache Hadoop          2.0.0-2.0.2        dfs.support.append    true
>>> Cloudera CDH             3u0-3u3             ????               true
>>> Cloudera CDH               3u4            dfs.support.append    true
>>> Hortonworks HDP           `1.0            dfs.support.append    false
>>> Hortonworks HDP           `1.1            dfs.support.append    false
>>>
>>> To resolve this, the property needs to be present when hadoop is
>>> configured so that both slave and master are initialized correctly. I have
>>> not discovered how to correct this issue.
>>>
>>
>>
>