We are running a hadoop cluster and many of our hive queries are failing in the reduce phase with the following error
java.io.IOException: All datanodes *.*.*.*:50230 are bad. Aborting... at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:3290) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2200(DFSClient.java:2783) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2987)
Any IDead why this might be happening ? Sreenath S Kamath Bangalore Ph No:+91-9590989106
No the data nodes are not dead and the HDFS is almost 70% free. Is it related to some network Issues? On Thu, May 22, 2014 at 11:58 AM, Shengjun Xin <[EMAIL PROTECTED]> wrote: Sreenath S Kamath Bangalore Ph No:+91-9590989106
I think your hdfs memory is filled. Type the following command and check it once hadoop dfsadmin -report. On Thu, May 22, 2014 at 11:58 AM, Shengjun Xin <[EMAIL PROTECTED]> wrote: With Thanks & Regards Nagarjuna Vissarapu 9052179339
Thats the summary of i'm getting when i run the command DFS Used%: 27% Under replicated blocks: 0 Blocks with corrupt replicas: 0 Missing blocks: 0
On Thu, May 22, 2014 at 12:22 PM, Nagarjuna Vissarapu < [EMAIL PROTECTED]> wrote:
Sreenath S Kamath Bangalore Ph No:+91-9590989106
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext