Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> error running hive job


Copy link to this message
-
Re: error running hive job
Hi Chung,

>From my short experience on Hive this may happen due to various reasons. To
find the real root cause you may need to dig in to hadoop tasktracker logs
and see what's present there. Also have a look at the task log from the web
UI (it gets printed to the console at the start of the Hive job) and it may
reveal the real cause for your issue. (e.g: I once encountered this error
due to one of my custom mapper scripts no being included properly).

Regards
Buddhika

On Mon, Feb 13, 2012 at 3:00 AM, Weishung Chung <[EMAIL PROTECTED]> wrote:

> Hi Hive Users,
>
> I was running a hive job but got the following error. Does it mean I need
> a bigger instance ?
>
> 2012-02-12 20:49:58,653 Stage-0 map = 100%,  reduce = 0%
> 2012-02-12 20:50:08,709 Stage-0 map = 100%,  reduce = 22%
> 2012-02-12 20:50:14,744 Stage-0 map = 100%,  reduce = 0%
> 2012-02-12 20:50:20,777 Stage-0 map = 100%,  reduce = 100%
> Ended Job = job_201202122031_0004 with errors
> java.lang.RuntimeException: Error while reading from task log url
> at
> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
>  at
> org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDriver.java:937)
> at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:709)
>  at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
>  at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
>  at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>  at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:171)
> at
> org.apache.hadoop.hive.cli.CliDriver.processLineInternal(CliDriver.java:253)
>  at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:234)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:487)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>  at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: java.io.IOException: Server returned HTTP response code: 400
> for URL:
> http://10.8.70.79:9103/tasklog?taskid=attempt_201202122031_0004_r_000000_1&all=true
>  at
> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
> at java.net.URL.openStream(URL.java:1010)
>  at
> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
> ... 17 more
> Ended Job = job_201202122031_0004 with exception
> 'java.lang.RuntimeException(Error while reading from task log url)'
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.MapRedTask
>
> Thank you so much,
> Wei Shung
>