Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Unexpected problem in creating temporary file


Copy link to this message
-
Unexpected problem in creating temporary file
Hi,

I am seeing many such errors on a datanode -

2013-07-18 22:10:49,473 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.254.0.40:50010, storageID=DS-595314104-10.254.0.40-50010-1374154266946, infoPort=50075, ipcPort=50020):DataXceiver
java.io.IOException: Unexpected problem in creating temporary file for blk_-395633752903233591_3721.  File /data/hadoop-admin/tmp/blk_-395633752903233591 should not be present, but is.
        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:429)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset$FSVolume.createTmpFile(FSDataset.java:407)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.createTmpFile(FSDataset.java:1242)
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1131)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:305)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:113)
        at java.lang.Thread.run(Unknown Source)

What could be the reason behind it ? It is causing system to slow down.
Before these errors, there were few exceptions with "connection reset by peer" which I guess are harmless.
Regards,
Ajay Srivastava
+
Ajay Srivastava 2013-07-20, 01:20
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB