Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - hdfs system crashes when loading files bigger than local space left


Copy link to this message
-
Re: hdfs system crashes when loading files bigger than local space left
Allen Wittenauer 2010-07-14, 15:23

On Jul 14, 2010, at 4:16 AM, Vitaliy Semochkin wrote:
> Sometimes hadoop allows to load amount of data bigger than local space on the node.
> Sometimes hadoop crashes and I have to reformat hdfs.

a) Have you set a reserved size for hdfs?

b) Are you loading data from the datanode?