Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # dev >> HDFS durable sync

Copy link to this message
Re: HDFS durable sync
It's related, in that it reduces data loss, but it's a different setting.

We're constantly syncing the WALog, but not data in RFiles.  To get
datanodes to sync when a file is closed, you should use

On Fri, Nov 8, 2013 at 3:32 PM, Miguel Pereira <[EMAIL PROTECTED]>wrote:

> Alright guys, with Accumulo 1.5.0 and CDH4.4 we are getting this warning:
> 2013-11-08 15:11:02,672 [tabletserver.TabletServer] WARN :
> > dfs.datanode.synconclose set to false: data loss is possible on system
> > reset or power loss
> >
> I was wondering if this is related to the durable sync and the recommended
> way to change the config settings ( xml files, Cloudera manager ).
> Cheers,
> Miguel