Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Caused by: java.io.EOFException


Copy link to this message
-
Re: Caused by: java.io.EOFException

It could be like the file corresponding to the partition dt='20120731' got corrupted.

This file as pointed in the error logs should be the culprit.
hdfs://ares-nn/apps/hdmi-technology/b_apdpds/real-time_new/20120731/PDS_HADOOP_REALTIME_EXPORT-part-3-2
 
Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Techy Teck <[EMAIL PROTECTED]>
Date: Mon, 6 Aug 2012 14:53:57
To: <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Caused by: java.io.EOFException

I am writing a simple query on our hive table and I am getting some
exception-

select count(*) from table1 where dt='20120731';

java.io.IOException: IO error in map input file
hdfs://ares-nn/apps/hdmi-technology/b_apdpds/real-time_new/20120731/PDS_HADOOP_REALTIME_EXPORT-part-3-2

        at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:220)

        at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:197)

        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)

        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:403)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:337)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:242)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:236)

*Caused by: java.io.EOFException*

        at java.io.DataInputStream.readFully(DataInputStream.java:180)

        at
org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:63)

        at
org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:101)

        at
org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1646)

        at
org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1712)

        at
org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1787)

        at
org.apache.hadoop.mapred.SequenceFileRecordReader.getCurrentValue(SequenceFileRecordReader.java:103)

        at
org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:78)

        at
org.apache.hadoop.hive.ql.io.HiveRecordReader.next(HiveRecordReader.java:67)

        at
org.apache.hadoop.hive.ql.io.HiveRecordReader.next(HiveRecordReader.java:33)

        at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:215)

        ... 9 more
Can anyone suggest me what does *Caused by: java.io.EOFException *means
here? And when I ran the same query for different date (dt), then it works
fine.

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB