At what load you are running the cluster?

Looks NN not able to choose the targets for block.

When choosing the targets NN will check many conditions like what is the thread count in DNs and allocated space for the node, ...etc.

If NN finds any of the nodes in that situation it will not choose the targets. That logs were debug logs. If you are getting this error frequently, you can just enable the debug log and check the reason once.

Regards,

Uma

________________________________
From: Jayaseelan E [[EMAIL PROTECTED]]
Sent: Thursday, December 22, 2011 11:58 AM
To: Harsh J; [EMAIL PROTECTED]
Subject: REG:could not sink exception
Hi
When we tried to run the hadoop flows we got the following exception for all the tasks and it is failed.error is little bit confusing.I have two data nodes,but both are healthy and nodes are
Up and running.
com.ericsson.cim.base.core.exception.CimProcessingException: Could not sink. Got an IOException with message: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /data/processing/events/usage/Processed_at_20111215100837/_temporary/_attempt_201112150454_0036_m_000000_0/ServiceUsageChargedAccBalCS4_20111001-m-00000 could only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1282)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:469)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:512)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:968)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:964)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:962)

Thanks indeed
jayaseelan

Hi
Total size of the source data is aproximately 20GB when we run the cluster.
Let me identify how to enable the debug logs

thanks indeed
jayaseelan

________________________________
From: Uma Maheswara Rao G [mailto:[EMAIL PROTECTED]]
Sent: Thursday, December 22, 2011 12:06 PM
To: [EMAIL PROTECTED]
Subject: RE: could not sink exception
At what load you are running the cluster?

Looks NN not able to choose the targets for block.

When choosing the targets NN will check many conditions like what is the thread count in DNs and allocated space for the node, ...etc.

If NN finds any of the nodes in that situation it will not choose the targets. That logs were debug logs. If you are getting this error frequently, you can just enable the debug log and check the reason once.

Regards,

Uma

________________________________
From: Jayaseelan E [[EMAIL PROTECTED]]
Sent: Thursday, December 22, 2011 11:58 AM
To: Harsh J; [EMAIL PROTECTED]
Subject: REG:could not sink exception
Hi
When we tried to run the hadoop flows we got the following exception for all the tasks and it is failed.error is little bit confusing.I have two data nodes,but both are healthy and nodes are
Up and running.
com.ericsson.cim.base.core.exception.CimProcessingException: Could not sink. Got an IOException with message: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /data/processing/events/usage/Processed_at_20111215100837/_temporary/_attempt_201112150454_0036_m_000000_0/ServiceUsageChargedAccBalCS4_20111001-m-00000 could only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1282)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:469)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:512)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:968)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:964)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:962)

Thanks indeed
jayaseelan