Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Does hadoop depends on ecc memory to generate checksum for data stored in HDFS


+
reena upadhyay 2014-03-28, 09:45
Copy link to this message
-
Re: Does hadoop depends on ecc memory to generate checksum for data stored in HDFS
While the HDFS functionality of computing, storing and validating
checksums for block files does not specifically _require_ ECC, you do
_want_ ECC to avoid frequent checksum failures.

This is noted in Tom's book as well, in the chapter that discusses
setting up your own cluster:
"ECC memory is strongly recommended, as several Hadoop users have
reported seeing many checksum errors when using non-ECC memory on
Hadoop clusters."

On Fri, Mar 28, 2014 at 3:15 PM, reena upadhyay <[EMAIL PROTECTED]> wrote:

Harsh J