Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> RE: could not sink exception

Copy link to this message
RE: could not sink exception
At what load you are running the cluster?

Looks NN not able to choose the targets for block.

When choosing the targets NN will check many conditions like what is the thread count in DNs and allocated space for the node, ...etc.

If NN finds any of the nodes in that situation it will not choose the targets. That logs were debug logs. If you are getting this error frequently, you can just enable the debug log and check the reason once.



From: Jayaseelan E [[EMAIL PROTECTED]]
Sent: Thursday, December 22, 2011 11:58 AM
Subject: REG:could not sink exception
When we tried to run the hadoop flows we got the following exception for all the tasks and it is failed.error is little bit confusing.I have two data nodes,but both are healthy and nodes are
Up and running.
com.ericsson.cim.base.core.exception.CimProcessingException: Could not sink. Got an IOException with message: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /data/processing/events/usage/Processed_at_20111215100837/_temporary/_attempt_201112150454_0036_m_000000_0/ServiceUsageChargedAccBalCS4_20111001-m-00000 could only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1282)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:469)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:512)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:968)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:964)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:962)

Thanks indeed
Jayaseelan E 2011-12-22, 06:43