Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - Regression in trunk? (RE: Insert overwrite error using hive trunk)


+
Pradeep Kamath 2010-09-27, 16:10
+
Ning Zhang 2010-09-27, 16:25
+
Ashutosh Chauhan 2010-09-27, 16:25
+
Ning Zhang 2010-09-27, 16:31
+
yongqiang he 2010-09-27, 16:44
+
Pradeep Kamath 2010-09-27, 17:38
+
Ning Zhang 2010-09-27, 17:52
+
Pradeep Kamath 2010-09-27, 18:22
+
Ning Zhang 2010-09-27, 18:33
+
Pradeep Kamath 2010-09-27, 19:33
+
Steven Wong 2010-09-27, 20:11
+
Ning Zhang 2010-09-27, 20:37
+
Pradeep Kamath 2010-09-28, 00:58
+
Amareshwari Sri Ramadasu 2010-09-28, 08:03
Copy link to this message
-
Re: Regression in trunk? (RE: Insert overwrite error using hive trunk)
Pradeep Kamath 2010-09-28, 16:31
With "hive -hiveconf hive.root.logger=DEBUG,DRFA -e ... "
/tmp/<username>/hive.log seems to have pretty detailed log messages
including debug msgs. I don't see the "initialization failed" message
and the stack trace mentioned in HADOOP-5759 - is there any other place
I need to check. On the UI I only see map task in pending state and no
further information (this is with hadoop-0.20.1). With a more recent
hadoop I see no tasks launched at all. This used to work a month before
- am wondering if any changes in hive caused this.

Thanks,
Pradeep
Amareshwari Sri Ramadasu wrote:
> Pradeep, you might be hitting HADOOP-5759 and the job is not getting
> initialized at all. Look in JobTracker logs for the jobid to confirm
> the same.
>
> On 9/28/10 6:28 AM, "Pradeep Kamath" <[EMAIL PROTECTED]> wrote:
>
>     Here is some relevant stuff from /tmp/pradeepk/hive.logs - can't
>     make much out of it:
>
>     2010-09-27 17:40:01,081 INFO  exec.MapRedTask
>     (SessionState.java:printInfo(268)) - Starting Job >     job_201009251752_1341, Tracking URL >     http://<hostname>:50030/jobdetails.jsp?jobid=job_201009251752_1341
>     <http://%3Chostname%3E:50030/jobdetails.jsp?jobid=job_201009251752_1341>
>     2010-09-27 17:40:01,081 INFO  exec.MapRedTask
>     (SessionState.java:printInfo(268)) - Kill Command >     /homes/pradeepk/hadoopcluster/hadoop/bin/../bin/hadoop job
>     -Dmapred.job.tracker=<hostname>:50020 -kill job_201009251752_1341
>     2010-09-27 17:40:01,081 DEBUG ipc.Client
>     (Client.java:sendParam(469)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk sending #129
>     2010-09-27 17:40:01,083 DEBUG ipc.Client
>     (Client.java:receiveResponse(504)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk got value #129
>     2010-09-27 17:40:01,083 DEBUG ipc.RPC (RPC.java:invoke(225)) -
>     Call: getJobStatus 2
>     2010-09-27 17:40:02,086 DEBUG ipc.Client
>     (Client.java:sendParam(469)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk sending #130
>     2010-09-27 17:40:02,090 DEBUG ipc.Client
>     (Client.java:receiveResponse(504)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk got value #130
>     2010-09-27 17:40:02,091 DEBUG ipc.RPC (RPC.java:invoke(225)) -
>     Call: getJobStatus 5
>     2010-09-27 17:40:02,092 DEBUG ipc.Client
>     (Client.java:sendParam(469)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk sending #131
>     2010-09-27 17:40:02,093 DEBUG ipc.Client
>     (Client.java:receiveResponse(504)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk got value #131
>     2010-09-27 17:40:02,094 DEBUG ipc.RPC (RPC.java:invoke(225)) -
>     Call: getJobStatus 2
>     2010-09-27 17:40:02,094 DEBUG ipc.Client
>     (Client.java:sendParam(469)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk sending #132
>     2010-09-27 17:40:02,096 DEBUG ipc.Client
>     (Client.java:receiveResponse(504)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk got value #132
>     2010-09-27 17:40:02,096 DEBUG ipc.RPC (RPC.java:invoke(225)) -
>     Call: getJobProfile 2
>     2010-09-27 17:40:02,096 DEBUG ipc.Client
>     (Client.java:sendParam(469)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk sending #133
>     2010-09-27 17:40:02,100 DEBUG ipc.Client
>     (Client.java:receiveResponse(504)) - IPC Client (47) connection to
>     <hostname>/216.252.118.203:50020 from pradeepk got value #133
>     2010-09-27 17:40:02,100 DEBUG ipc.RPC (RPC.java:invoke(225)) -
>     Call: getJobCounters 4
>     2010-09-27 17:40:02,101 DEBUG mapred.Counters
>     (Counters.java:<init>(151)) - Creating group
>     org.apache.hadoop.hive.ql.exec.Operator$ProgressCounter with nothing
>     2010-09-27 17:40:02,101 DEBUG mapred.Counters
+
Pradeep Kamath 2010-09-28, 17:30
+
Ning Zhang 2010-09-28, 18:23
+
Pradeep Kamath 2010-09-28, 19:30
+
Ning Zhang 2010-09-28, 20:43