Hi all,

 Do anyone of you have an idea of what the following error means when I
run a Mapside join.

 

 

java.lang.RuntimeException: Error while reading from task log url

        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLog
Processor.java:130)

        at
org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDrive
r.java:919)

        at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:702)

        at
org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)

        at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:
55)

        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:631)

        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)

        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)

        at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)

        at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)

        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:39)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Caused by: java.io.FileNotFoundException:
http://machine:50060/tasklog?taskid=attempt_201006110238_100196_m_002925
_3&all=true

        at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnec
tion.java:1288)

        at java.net.URL.openStream(URL.java:1009)

        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLog
Processor.java:120)

        ... 15 more

 

Thanks Viraj

Hi all,

 Here is the larger stack trace:

java.lang.RuntimeException: Hive Runtime Error: Map local work failed

            at
org.apache.hadoop.hive.ql.exec.ExecMapper.processMapLocalWork(ExecMapper
.java:291)

            at
org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:188)

            at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)

            at
org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)

            at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)

            at org.apache.hadoop.mapred.Child.main(Child.java:159)

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.io.IOException: java.io.EOFException

            at
org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper.get(HashMapWra
pper.java:139)

            at
org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator
.java:213)

            at
org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:456)

            at
org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:696)

            at
org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOper
ator.java:45)

            at
org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:456)

            at
org.apache.hadoop.hive.ql.exec.ExecMapper.processMapLocalWork(ExecMapper
.java:269)

            ... 5 more

Caused by: java.io.IOException: java.io.EOFException

            at
org.apache.hadoop.hive.ql.exec.persistence.MapJoinObjectValue.readExtern
al(MapJoinObjectValue.java:109)

            at
java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:1792)

            at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1751
)

            at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1329)

            at
java.io.ObjectInputStream.readObject(ObjectInputStream.java:351)

            at
org.apache.hadoop.hive.ql.util.jdbm.htree.HashBucket.readExternal(HashBu
cket.java:284)

            at
java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:1792)

            at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1751
)

            at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1329)

            at
java.io.ObjectInputStream.readObject(ObjectInputStream.java:351)

            at
org.apache.hadoop.hive.ql.util.jdbm.helper.Serialization.deserialize(Ser
ialization.java:106)

            at
org.apache.hadoop.hive.ql.util.jdbm.helper.DefaultSerializer.deserialize
(DefaultSerializer.java:106)

            at
org.apache.hadoop.hive.ql.util.jdbm.recman.BaseRecordManager.fetch(BaseR
ecordManager.java:360)

            at
org.apache.hadoop.hive.ql.util.jdbm.recman.BaseRecordManager.fetch(BaseR
ecordManager.java:332)

            at
org.apache.hadoop.hive.ql.util.jdbm.htree.HashDirectory.get(HashDirector
y.java:195)

            at
org.apache.hadoop.hive.ql.util.jdbm.htree.HTree.get(HTree.java:155)

            at
org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper.get(HashMapWra
pper.java:114)

            ... 11 more

Caused by: java.io.EOFException

            at java.io.DataInputStream.readInt(DataInputStream.java:375)

            at
java.io.ObjectInputStream$BlockDataInputStream.readInt(ObjectInputStream
.java:2776)

            at
java.io.ObjectInputStream.readInt(ObjectInputStream.java:950)

            at
org.apache.hadoop.io.BytesWritable.readFields(BytesWritable.java:153)

            at
org.apache.hadoop.hive.ql.exec.persistence.MapJoinObjectValue.readExtern
al(MapJoinObjectValue.java:98)

            ... 27 more

 

Thanks in advance

Viraj

________________________________

From: Viraj Bhat [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 24, 2010 11:22 AM
To: [EMAIL PROTECTED]
Subject: Mapside join exeception

 

Hi all,

 Do anyone of you have an idea of what the following error means when I
run a Mapside join.

 

 

java.lang.RuntimeException: Error while reading from task log url

        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLog
Processor.java:130)

        at
org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDrive
r.java:919)

        at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:702)

        at
org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)

        at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:
55)

        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:631)

        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:504)

        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:382)

        at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)

        at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)

        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:39)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Caused by: java.io.FileNotFoundException:
http://machine:50060/tasklog?taskid=attempt_201006110238_100196_m_002925
_3&all=true

        at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnec
tion.java:1288)

        at java.net.URL.openStream(URL.java:1009)

        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLog
Processor.java:120)

        ... 15 more

 

Thanks Viraj