Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Mapside join exeception


+
Viraj Bhat 2010-06-24, 18:21
Copy link to this message
-
Mapside join exeception
Hi all,

 Here is the larger stack trace:

java.lang.RuntimeException: Hive Runtime Error: Map local work failed

            at
org.apache.hadoop.hive.ql.exec.ExecMapper.processMapLocalWork(ExecMapper
.java:291)

            at
org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:188)

            at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)

            at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)

            at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)

            at org.apache.hadoop.mapred.Child.main(Child.java:159)

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.io.IOException: java.io.EOFException

            at
org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper.get(HashMapWra
pper.java:139)

            at
org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator
.java:213)

            at
org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:456)

            at
org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:696)

            at
org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOper
ator.java:45)

            at
org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:456)

            at
org.apache.hadoop.hive.ql.exec.ExecMapper.processMapLocalWork(ExecMapper
.java:269)

            ... 5 more

Caused by: java.io.IOException: java.io.EOFException

            at
org.apache.hadoop.hive.ql.exec.persistence.MapJoinObjectValue.readExtern
al(MapJoinObjectValue.java:109)

            at
java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:1792)

            at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1751
)

            at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1329)

            at
java.io.ObjectInputStream.readObject(ObjectInputStream.java:351)

            at
org.apache.hadoop.hive.ql.util.jdbm.htree.HashBucket.readExternal(HashBu
cket.java:284)

            at
java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:1792)

            at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1751
)

            at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1329)

            at
java.io.ObjectInputStream.readObject(ObjectInputStream.java:351)

            at
org.apache.hadoop.hive.ql.util.jdbm.helper.Serialization.deserialize(Ser
ialization.java:106)

            at
org.apache.hadoop.hive.ql.util.jdbm.helper.DefaultSerializer.deserialize
(DefaultSerializer.java:106)

            at
org.apache.hadoop.hive.ql.util.jdbm.recman.BaseRecordManager.fetch(BaseR
ecordManager.java:360)

            at
org.apache.hadoop.hive.ql.util.jdbm.recman.BaseRecordManager.fetch(BaseR
ecordManager.java:332)

            at
org.apache.hadoop.hive.ql.util.jdbm.htree.HashDirectory.get(HashDirector
y.java:195)

            at
org.apache.hadoop.hive.ql.util.jdbm.htree.HTree.get(HTree.java:155)

            at
org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper.get(HashMapWra
pper.java:114)

            ... 11 more

Caused by: java.io.EOFException

            at java.io.DataInputStream.readInt(DataInputStream.java:375)

            at
java.io.ObjectInputStream$BlockDataInputStream.readInt(ObjectInputStream
.java:2776)

            at
java.io.ObjectInputStream.readInt(ObjectInputStream.java:950)

            at
org.apache.hadoop.io.BytesWritable.readFields(BytesWritable.java:153)

            at
org.apache.hadoop.hive.ql.exec.persistence.MapJoinObjectValue.readExtern
al(MapJoinObjectValue.java:98)

            ... 27 more

 

Thanks in advance

Viraj

________________________________

From: Viraj Bhat [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 24, 2010 11:22 AM
To: [EMAIL PROTECTED]
Subject: Mapside join exeception

 

Hi all,

 Do anyone of you have an idea of what the following error means when I
run a Mapside join.

 

 

java.lang.RuntimeException: Error while reading from task log url

        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLog
Processor.java:130)

        at
org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDrive
r.java:919)

        at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:702)

        at
org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)

        at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:
55)

        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:631)

        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)

        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)

        at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)

        at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)

        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:39)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Caused by: java.io.FileNotFoundException:
http://machine:50060/tasklog?taskid=attempt_201006110238_100196_m_002925
_3&all=true

        at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnec
tion.java:1288)

        at java.net.URL.openStream(URL.java:1009)

        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLog
Processor.java:120)

        ... 15 more

 

Thanks Viraj
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB