Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Unexpected problem in creating temporary file


Copy link to this message
-
Unexpected problem in creating temporary file
Hi,

I am seeing many such errors on a datanode -

2013-07-18 22:10:49,473 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.254.0.40:50010, storageID=DS-595314104-10.254.0.40-50010-1374154266946, infoPort=50075, ipcPort=50020):DataXceiver
java.io.IOException: Unexpected problem in creating temporary file for blk_-395633752903233591_3721.  File /data/hadoop-admin/tmp/blk_-395633752903233591 should not be present, but is.
        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:429)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:407)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.createTmpFile(FSDataset.java:1242)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1131)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:305)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:113)
        at java.lang.Thread.run(Unknown Source)

What could be the reason behind it ? It is causing system to slow down.
Before these errors, there were few exceptions with "connection reset by peer" which I guess are harmless.
Regards,
Ajay Srivastava
+
Ajay Srivastava 2013-07-20, 01:20