Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> Problem Running 1.5.0 on Amazon EMR - dfs.support.append not true.


Copy link to this message
-
Re: Problem Running 1.5.0 on Amazon EMR - dfs.support.append not true.
Thanks for the info. Just one dash is needed. It looks like this:

--bootstrap-action s3://elasticmapreduce/bootstrap-actions/configure-hadoop
--args "-h,dfs.support.append=true"

On Mon, May 27, 2013 at 7:45 AM, David Lyle <[EMAIL PROTECTED]> wrote:

> Or even --h,dfs.support.append=true (sorry for the spam, kinda early for
> me).
>
> -D...
>
>
>
> On Mon, May 27, 2013 at 7:44 AM, David Lyle <[EMAIL PROTECTED]> wrote:
>
>> Have you tried a configure hadoop bootstrap action?
>>
>> Try* *--h,dfs.support.append****-key-value=false
>>
>> http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-plan-bootstrap.html#PredefinedbootstrapActions_ConfigureHadoop
>>
>>
>> On Mon, May 27, 2013 at 7:20 AM, David Medinets <[EMAIL PROTECTED]
>> > wrote:
>>
>>> When trying to start tserver on Amazon EMR, you'll see the following
>>> message in the logs:
>>>
>>> 2013-05-27 00:04:43,593 [tabletserver.TabletServer] FATAL: Must set
>>> dfs.durable.sync OR dfs.support.append to true.  Which one needs to be set
>>> depends on your version of HDFS.  See ACCUMULO-623.
>>> HADOOP RELEASE          VERSION           SYNC NAME             DEFAULT
>>> Apache Hadoop           0.20.205          dfs.support.append    false
>>> Apache Hadoop            0.23.x           dfs.support.append    true
>>> Apache Hadoop             1.0.x           dfs.support.append    false
>>> Apache Hadoop             1.1.x           dfs.durable.sync      true
>>> Apache Hadoop          2.0.0-2.0.2        dfs.support.append    true
>>> Cloudera CDH             3u0-3u3             ????               true
>>> Cloudera CDH               3u4            dfs.support.append    true
>>> Hortonworks HDP           `1.0            dfs.support.append    false
>>> Hortonworks HDP           `1.1            dfs.support.append    false
>>>
>>> To resolve this, the property needs to be present when hadoop is
>>> configured so that both slave and master are initialized correctly. I have
>>> not discovered how to correct this issue.
>>>
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB