Hi
  I am able to run certain hive commands e.g. create table and select.. but
not others ..    Also my hadoop pseudo disributed cluster is working fine -
i can run the examples.

Examples of commands that fail:

insert overwrite table demographics select * from demographics_local;
Control-C  (killing a task ends up with the same error with the "Error
while reading from task log url"
Hadoop job information for Stage-0: number of mappers: 1; number of
reducers: 0
2012-03-29 08:05:40,699 Stage-0 map = 0%,  reduce = 0%
2012-03-29 08:06:10,868 Stage-0 map = 100%,  reduce = 100%
Ended Job = job_201203231956_0010 with errors
Error during job, obtaining debugging information...
Examining task ID: task_201203231956_0010_m_000002 (and more) from job
job_201203231956_0010
Exception in thread "Thread-160" java.lang.RuntimeException: Error while
reading from task log url
at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
at
org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for
URL:
http://localhost:50060/tasklog?taskid=attempt_201203231956_0010_m_000000_3&start=-8193
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
at java.net.URL.openStream(URL.java:1010)
at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
... 3 more
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask

I am running hive-0.8.1  aagainst hadoop-1.0.0

When I go to that url here is the result:

HTTP ERROR 400

Problem accessing /tasklog. Reason:

    Argument attemptid is required

------------------------------
*Powered by Jetty://
*
2012/3/29 Stephen Boesch <[EMAIL PROTECTED]>

> Hi
>   I am able to run certain hive commands e.g. create table and select..
> but not others ..    Also my hadoop pseudo disributed cluster is working
> fine - i can run the examples.
>
> Examples of commands that fail:
>
> insert overwrite table demographics select * from demographics_local;
> Control-C  (killing a task ends up with the same error with the "Error
> while reading from task log url"
>
>
> Hadoop job information for Stage-0: number of mappers: 1; number of
> reducers: 0
> 2012-03-29 08:05:40,699 Stage-0 map = 0%,  reduce = 0%
> 2012-03-29 08:06:10,868 Stage-0 map = 100%,  reduce = 100%
> Ended Job = job_201203231956_0010 with errors
> Error during job, obtaining debugging information...
> Examining task ID: task_201203231956_0010_m_000002 (and more) from job
> job_201203231956_0010
> Exception in thread "Thread-160" java.lang.RuntimeException: Error while
> reading from task log url
>  at
> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
> at
> org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
>  at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
>  at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: Server returned HTTP response code: 400
> for URL:
> http://localhost:50060/tasklog?taskid=attempt_201203231956_0010_m_000000_3&start=-8193
>  at
> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
>  at java.net.URL.openStream(URL.java:1010)
> at
> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
>  ... 3 more
> FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedTask
>
>
>
> I am running hive-0.8.1  aagainst hadoop-1.0.0
>

You are running into: https://issues.apache.org/jira/browse/HIVE-1579

I've been meaning to submit a patch for this. I emailed the dev list
concerning a patch for it but got no reply...

Hive is crashing because it can't pull the debug logs for the failed
task, because it's trying to pull them from the url. If you change
taskid to attemptid in the url then you'll get the error logs you need
to debug the root cause.

I'll try and submit a patch at some point.

Phil.

On 29 March 2012 17:36, Stephen Boesch <[EMAIL PROTECTED]> wrote:
> When I go to that url here is the result:
>
> HTTP ERROR 400
>
> Problem accessing /tasklog. Reason:
>
>     Argument attemptid is required
>
> ________________________________
> Powered by Jetty://
>
>
>
> 2012/3/29 Stephen Boesch <[EMAIL PROTECTED]>
>>
>> Hi
>>   I am able to run certain hive commands e.g. create table and select..
>> but not others ..    Also my hadoop pseudo disributed cluster is working
>> fine - i can run the examples.
>>
>> Examples of commands that fail:
>>
>> insert overwrite table demographics select * from demographics_local;
>> Control-C  (killing a task ends up with the same error with the "Error
>> while reading from task log url"
>>
>>
>> Hadoop job information for Stage-0: number of mappers: 1; number of
>> reducers: 0
>> 2012-03-29 08:05:40,699 Stage-0 map = 0%,  reduce = 0%
>> 2012-03-29 08:06:10,868 Stage-0 map = 100%,  reduce = 100%
>> Ended Job = job_201203231956_0010 with errors
>> Error during job, obtaining debugging information...
>> Examining task ID: task_201203231956_0010_m_000002 (and more) from job
>> job_201203231956_0010
>> Exception in thread "Thread-160" java.lang.RuntimeException: Error while
>> reading from task log url
>> at
>> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
>> at
>> org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
>> at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
>> at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.io.IOException: Server returned HTTP response code: 400
>> for URL:
>> http://localhost:50060/tasklog?taskid=attempt_201203231956_0010_m_000000_3&start=-8193
>> at
>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
>> at java.net.URL.openStream(URL.java:1010)
>> at
>> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
>> ... 3 more
>> FAILED: Execution Error, return code 2 from
>> org.apache.hadoop.hive.ql.exec.MapRedTask
>>
>>
>>
>> I am running hive-0.8.1  aagainst hadoop-1.0.0
>
>

Thanks a lot Philip, when i did that substitution I can see the log. and
now the root cause is obvious (and v fixable !)

old url:

http://localhost:50060/tasklog?taskid=attempt_201203231956_0010_m_000000_3&start=-8193

corrected url:

http://localhost:50060/tasklog?attemptid=attempt_201203231956_0010_m_000000_3&start=-8193

Root cause of the problem:

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
org.apache.hadoop.hive.serde2.SerDeException: HBase row key cannot be
NULL
2012/3/29 Philip Tromans <[EMAIL PROTECTED]>

> You are running into: https://issues.apache.org/jira/browse/HIVE-1579
>
> I've been meaning to submit a patch for this. I emailed the dev list
> concerning a patch for it but got no reply...
>
> Hive is crashing because it can't pull the debug logs for the failed
> task, because it's trying to pull them from the url. If you change
> taskid to attemptid in the url then you'll get the error logs you need
> to debug the root cause.
>
> I'll try and submit a patch at some point.
>
> Phil.
>
> On 29 March 2012 17:36, Stephen Boesch <[EMAIL PROTECTED]> wrote:
> > When I go to that url here is the result:
> >
> > HTTP ERROR 400
> >
> > Problem accessing /tasklog. Reason:
> >
> >     Argument attemptid is required
> >
> > ________________________________
> > Powered by Jetty://
> >
> >
> >
> > 2012/3/29 Stephen Boesch <[EMAIL PROTECTED]>
> >>
> >> Hi
> >>   I am able to run certain hive commands e.g. create table and select..
> >> but not others ..    Also my hadoop pseudo disributed cluster is working
> >> fine - i can run the examples.
> >>
> >> Examples of commands that fail:
> >>
> >> insert overwrite table demographics select * from demographics_local;
> >> Control-C  (killing a task ends up with the same error with the "Error
> >> while reading from task log url"
> >>
> >>
> >> Hadoop job information for Stage-0: number of mappers: 1; number of
> >> reducers: 0
> >> 2012-03-29 08:05:40,699 Stage-0 map = 0%,  reduce = 0%
> >> 2012-03-29 08:06:10,868 Stage-0 map = 100%,  reduce = 100%
> >> Ended Job = job_201203231956_0010 with errors
> >> Error during job, obtaining debugging information...
> >> Examining task ID: task_201203231956_0010_m_000002 (and more) from job
> >> job_201203231956_0010
> >> Exception in thread "Thread-160" java.lang.RuntimeException: Error while
> >> reading from task log url
> >> at
> >>
> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
> >> at
> >>
> org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
> >> at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
> >> at java.lang.Thread.run(Thread.java:662)
> >> Caused by: java.io.IOException: Server returned HTTP response code: 400
> >> for URL:
> >>
> http://localhost:50060/tasklog?taskid=attempt_201203231956_0010_m_000000_3&start=-8193
> >> at
> >>
> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
> >> at java.net.URL.openStream(URL.java:1010)
> >> at
> >>
> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
> >> ... 3 more
> >> FAILED: Execution Error, return code 2 from
> >> org.apache.hadoop.hive.ql.exec.MapRedTask
> >>
> >>
> >>
> >> I am running hive-0.8.1  aagainst hadoop-1.0.0
> >
> >
>

Whenever I run the below query-
*
*
*SELECT buyer_id, item_id, ranknew(buyer_id, item_id), created_time*
*FROM (*
*    SELECT buyer_id, item_id, created_time*
*    FROM testingtable1*
*    DISTRIBUTE BY buyer_id, item_id*
*    SORT BY buyer_id, item_id, created_time desc*
*) a*
*WHERE ranknew(buyer_id, item_id) %  2 == 0;*
I always get the below error, I have no clue what does this error means? Is
there any problem with my query or something wrong with the system?

*Total MapReduce jobs = 1*
*Launching Job 1 out of 1*
*Number of reduce tasks not specified. Estimated from input data size: 1*
*In order to change the average load for a reducer (in bytes):*
*  set hive.exec.reducers.bytes.per.reducer=<number>*
*In order to limit the maximum number of reducers:*
*  set hive.exec.reducers.max=<number>*
*In order to set a constant number of reducers:*
*  set mapred.reduce.tasks=<number>*
*Starting Job = job_201207172005_14407, Tracking URL http://ares-jt.vip.ebay.com:50030/jobdetails.jsp?jobid=job_201207172005_14407
*
*Kill Command = /home/hadoop/latest/bin/../bin/hadoop job
 -Dmapred.job.tracker=ares-jt:8021 -kill job_201207172005_14407*
*2012-07-21 02:07:15,917 Stage-1 map = 0%,  reduce = 0%*
*2012-07-21 02:07:27,211 Stage-1 map = 100%,  reduce = 0%*
*2012-07-21 02:07:38,700 Stage-1 map = 100%,  reduce = 33%*
*2012-07-21 02:07:48,517 Stage-1 map = 100%,  reduce = 0%*
*2012-07-21 02:08:49,566 Stage-1 map = 100%,  reduce = 0%*
*2012-07-21 02:09:08,640 Stage-1 map = 100%,  reduce = 100%*
*Ended Job = job_201207172005_14407 with errors*
*java.lang.RuntimeException: Error while reading from task log url*
*        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
*
*        at
org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDriver.java:931)
*
*        at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:716)*
*        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)*
*        at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)*
*        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:621)*
*        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:495)*
*        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:374)*
*        at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)*
*        at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)*
*        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:302)*
*        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*
*        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
*
*        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
*
*        at java.lang.reflect.Method.invoke(Method.java:597)*
*        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)*
*Caused by: java.io.IOException: Server returned HTTP response code: 400
for URL:
http://lvsaishdc3dn0857.lvs.ebay.com:50060/tasklog?taskid=attempt_201207172005_14407_r_000000_1&all=true
*
*        at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1313)
*
*        at java.net.URL.openStream(URL.java:1010)*
*        at
org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
*
*        ... 15 more*
*Ended Job = job_201207172005_14407 with exception
'java.lang.RuntimeException(Error while reading from task log url)'*
*Raihan Jamal*