Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - Caused by: java.io.EOFException


+
Techy Teck 2012-08-06, 21:53
Copy link to this message
-
Re: Caused by: java.io.EOFException
Bejoy KS 2012-08-07, 00:27

It could be like the file corresponding to the partition dt='20120731' got corrupted.

This file as pointed in the error logs should be the culprit.
hdfs://ares-nn/apps/hdmi-technology/b_apdpds/real-time_new/20120731/PDS_HADOOP_REALTIME_EXPORT-part-3-2
 
Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Techy Teck <[EMAIL PROTECTED]>
Date: Mon, 6 Aug 2012 14:53:57
To: <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Caused by: java.io.EOFException

I am writing a simple query on our hive table and I am getting some
exception-

select count(*) from table1 where dt='20120731';

java.io.IOException: IO error in map input file
hdfs://ares-nn/apps/hdmi-technology/b_apdpds/real-time_new/20120731/PDS_HADOOP_REALTIME_EXPORT-part-3-2

        at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:220)

        at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:197)

        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)

        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:403)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:337)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:242)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)

        at org.apache.hadoop.mapred.Child.main(Child.java:236)

*Caused by: java.io.EOFException*

        at java.io.DataInputStream.readFully(DataInputStream.java:180)

        at
org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:63)

        at
org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:101)

        at
org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1646)

        at
org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1712)

        at
org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1787)

        at
org.apache.hadoop.mapred.SequenceFileRecordReader.getCurrentValue(SequenceFileRecordReader.java:103)

        at
org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:78)

        at
org.apache.hadoop.hive.ql.io.HiveRecordReader.next(HiveRecordReader.java:67)

        at
org.apache.hadoop.hive.ql.io.HiveRecordReader.next(HiveRecordReader.java:33)

        at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:215)

        ... 9 more
Can anyone suggest me what does *Caused by: java.io.EOFException *means
here? And when I ran the same query for different date (dt), then it works
fine.

+
Techy Teck 2012-08-07, 00:31
+
shashwat shriparv 2012-08-07, 04:51
+
Techy Teck 2012-08-07, 05:41