Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Does hadoop depends on ecc memory to generate checksum for data stored in HDFS


Copy link to this message
-
Re: Does hadoop depends on ecc memory to generate checksum for data stored in HDFS
Harsh J 2014-03-28, 10:00
While the HDFS functionality of computing, storing and validating
checksums for block files does not specifically _require_ ECC, you do
_want_ ECC to avoid frequent checksum failures.

This is noted in Tom's book as well, in the chapter that discusses
setting up your own cluster:
"ECC memory is strongly recommended, as several Hadoop users have
reported seeing many checksum errors when using non-ECC memory on
Hadoop clusters."

On Fri, Mar 28, 2014 at 3:15 PM, reena upadhyay <[EMAIL PROTECTED]> wrote:

Harsh J