Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # dev - another HDFS configuration for scribeH


Copy link to this message
-
another HDFS configuration for scribeH
Hairong Kuang 2011-12-02, 04:22
Hi Eric,

I was debugging a bizar data corruption case in the silver cluster today and realized that there is a very important configuration that scribeH cluster should set. Could you please set dfs.datanode.synconclose to be true in ScribeH for next week's push? This is will guarantee that block data get persisted to disk on close, so preventing data loss when datanodes get rebooted.

Thanks,
Hairong

+
Eric Hwang 2011-12-02, 04:26
+
Uma Maheswara Rao G 2011-12-02, 05:27