Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Block is not getting deleting which is not present in Memory in following scenario
Amith D K
2012-06-18, 11:55
Copy link to this message
-
Block is not getting deleting which is not present in Memory in following scenario
Brahma Reddy Battula 2012-06-18, 11:39
Hi

Started Name Node and Data Node by configuring multiple DataDirs
Written one file
copied same block to another dataDir

What I expect is,Block will be removed from copied Dir since it's not present memory.

But here it's keep on logging following for every directory scan ...Please let me know the behavior...

2012-06-18 16:30:55,152 WARN org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Block file /opt/dfs12/current/BP-1134724852-*********-1339770849071/current/finalized/blk_92866283154406728 does not match file found by scan /opt/dfs12/current/BP-1134724852-*********-1339770849071/current/finalized/subdir9/blk_92866283154406728
2012-06-18 16:35:55,152 INFO org.apache.hadoop.hdfs.server.datanode.DirectoryScanner: BlockPool BP-1134724852-*********-1339770849071 Total blocks: 389, missing metadata files:0, missing block files:0, missing blocks in memory:1, mismatched blocks:0
2012-06-18 16:35:55,152 WARN org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Block file /opt/dfs12/current/BP-1134724852-*********-1339770849071/current/finalized/blk_92866283154406728 does not match file found by scan /opt/dfs12/current/BP-1134724852-*********-1339770849071/current/finalized/subdir9/blk_92866283154406728
+
Amith D K 2012-06-18, 11:55