Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched:


+
yogesh.kumar13@... 2012-07-24, 08:25
+
Mohammad Tariq 2012-07-24, 08:30
+
yogesh.kumar13@... 2012-07-24, 08:39
Copy link to this message
-
Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched:
Nitin Pawar 2012-07-24, 08:43
yogesh,
is your network setup with proxy authentication? normally the error
which you are getting is, when a node tries to connect to another node
but then after some time, the connection needs to be reauthorized.

when you do a select * from table, it does not launch a MR, it just
does a dfs -cat of the hdfs file

you will need to check the cluster health of your hadoop cluster. Also
make sure that on all the nodes the default linux security is off
(iptables )

On Tue, Jul 24, 2012 at 2:09 PM,  <[EMAIL PROTECTED]> wrote:
> Thanks Mohammad :-),
>
> I didn't get regarding which proxy settings Please explain it,
>
> If i do operations like.
> select * from dummysite,
> or
> select * from dummysite where id=10;
>
> such command shows proper result and doesn't through any error.
>
> Please suggest.
>
> Regards
> Yogesh Kumar
> ________________________________________
> From: Mohammad Tariq [[EMAIL PROTECTED]]
> Sent: Tuesday, July 24, 2012 2:00 PM
> To: [EMAIL PROTECTED]
> Subject: Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched:
>
> Hello Yogesh,
>
>         Are any proxy settings involved??Error code 407 indicates that
> the client must first authenticate itself with the proxy in order to
> proceed further. Just make sure everything is in place.
>
> Regards,
>     Mohammad Tariq
>
>
> On Tue, Jul 24, 2012 at 1:55 PM,  <[EMAIL PROTECTED]> wrote:
>> Hi All,
>>
>> even If if perform count(*) operation on table it shows error,
>>
>> select count(*) from dummysite;
>>
>>
>> Total MapReduce jobs = 1
>> Launching Job 1 out of 1
>> Number of reduce tasks determined at compile time: 1
>> In order to change the average load for a reducer (in bytes):
>>   set hive.exec.reducers.bytes.per.reducer=<number>
>> In order to limit the maximum number of reducers:
>>   set hive.exec.reducers.max=<number>
>> In order to set a constant number of reducers:
>>   set mapred.reduce.tasks=<number>
>> Starting Job = job_201207231123_0011, Tracking URL >> http://localhost:50030/jobdetails.jsp?jobid=job_201207231123_0011
>> Kill Command = /HADOOP/hadoop-0.20.2/bin/../bin/hadoop job
>> -Dmapred.job.tracker=localhost:9001 -kill job_201207231123_0011
>> Hadoop job information for Stage-1: number of mappers: 1; number of
>> reducers: 1
>> 2012-07-24 13:38:18,928 Stage-1 map = 0%,  reduce = 0%
>> 2012-07-24 13:38:21,938 Stage-1 map = 100%,  reduce = 0%
>> 2012-07-24 13:39:22,170 Stage-1 map = 100%,  reduce = 0%
>> 2012-07-24 13:39:25,181 Stage-1 map = 100%,  reduce = 100%
>> Ended Job = job_201207231123_0011 with errors
>> Error during job, obtaining debugging information...
>> Examining task ID: task_201207231123_0011_m_000002 (and more) from job
>> job_201207231123_0011
>> Exception in thread "Thread-93" java.lang.RuntimeException: Error while
>> reading from task log url
>>     at
>> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
>>     at
>> org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
>>     at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
>>     at java.lang.Thread.run(Thread.java:680)
>> Caused by: java.io.IOException: Server returned HTTP response code: 407 for
>> URL:
>> http://10.203.33.81:50060/tasklog?taskid=attempt_201207231123_0011_r_000000_0&start=-8193
>>     at
>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
>>     at java.net.URL.openStream(URL.java:1010)
>>     at
>> org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
>>     ... 3 more
>> FAILED: Execution Error, return code 2 from
>> org.apache.hadoop.hive.ql.exec.MapRedTask
>> MapReduce Jobs Launched:
>> Job 0: Map: 1  Reduce: 1   HDFS Read: 24 HDFS Write: 0 FAIL
>> Total MapReduce CPU Time Spent: 0 msec
>>
>>
>> Please suggest why this error is comming :-(
>>
>> Regards
>> Yogesh Kumar
>>
>> Please do not print this email unless it is absolutely necessary.

Nitin Pawar
+
yogesh.kumar13@... 2012-07-24, 09:04
+
yogesh.kumar13@... 2012-07-24, 10:49
+
Nitin Pawar 2012-07-24, 11:51
+
Mohammad Tariq 2012-07-24, 11:59
+
yogesh.kumar13@... 2012-07-24, 12:45
+
yogesh.kumar13@... 2012-07-24, 10:29