Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Regression in trunk? (RE: Insert overwrite error using hive trunk)


Copy link to this message
-
Regression in trunk? (RE: Insert overwrite error using hive trunk)
Hi,
  Any help in debugging the issue I am seeing below will be greatly appreciated. Unless I am doing something wrong, this seems to be a regression in trunk.

Thanks,
Pradeep

________________________________
From: Pradeep Kamath [mailto:[EMAIL PROTECTED]]
Sent: Friday, September 24, 2010 1:41 PM
To: [EMAIL PROTECTED]
Subject: Insert overwrite error using hive trunk

Hi,
   I am trying to insert overwrite into a partitioned table reading data from a non partitioned table and seeing a failure in the second map reduce job - wonder if I am doing something wrong - any pointers appreciated (I am using latest trunk code against hadoop 20 cluster). Details below[1].

Thanks,
Pradeep

[1]
Details:
bin/hive -e "describe numbers_text;"
col_name                data_type               comment
id                      int                     None
num                     int                     None

bin/hive -e "describe numbers_text_part;"
col_name                data_type               comment
id                      int                     None
num                     int                     None
# Partition Information
col_name                data_type               comment
part                    string                  None

bin/hive -e "select * from numbers_text;"
1       10
2       20

bin/hive -e "insert overwrite table numbers_text_part partition(part='p1') select id, num from numbers_text;"
Total MapReduce jobs = 2
Launching Job 1 out of 2
Number of reduce tasks is set to 0 since there's no reduce operator
...
2010-09-24 13:28:55,649 Stage-1 map = 0%,  reduce = 0%
2010-09-24 13:28:58,687 Stage-1 map = 100%,  reduce = 0%
2010-09-24 13:29:01,726 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201009241059_0281
Ended Job = -1897439470, job is filtered out (removed at runtime).
Launching Job 2 out of 2
Number of reduce tasks is set to 0 since there's no reduce operator
...
2010-09-24 13:29:03,504 Stage-2 map = 100%,  reduce = 100%
Ended Job = job_201009241059_0282 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask

tail /tmp/pradeepk/hive.log:
2010-09-24 13:29:01,888 WARN  mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2010-09-24 13:29:01,903 WARN  fs.FileSystem (FileSystem.java:fixName(153)) - "wilbur21.labs.corp.sp1.yahoo.com:8020" is a deprecated filesystem name. Use "hdfs://wilbur21.labs.corp.sp1.yahoo.com:8020/" instead.
2010-09-24 13:29:03,512 ERROR exec.MapRedTask (SessionState.java:printError(277)) - Ended Job = job_201009241059_0282 with errors
2010-09-24 13:29:03,537 ERROR ql.Driver (SessionState.java:printError(277)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
+
Ning Zhang 2010-09-27, 16:25
+
Ashutosh Chauhan 2010-09-27, 16:25
+
Ning Zhang 2010-09-27, 16:31
+
yongqiang he 2010-09-27, 16:44
+
Pradeep Kamath 2010-09-27, 17:38
+
Ning Zhang 2010-09-27, 17:52
+
Pradeep Kamath 2010-09-27, 18:22
+
Ning Zhang 2010-09-27, 18:33
+
Pradeep Kamath 2010-09-27, 19:33
+
Steven Wong 2010-09-27, 20:11
+
Ning Zhang 2010-09-27, 20:37
+
Pradeep Kamath 2010-09-28, 00:58
+
Amareshwari Sri Ramadasu 2010-09-28, 08:03
+
Pradeep Kamath 2010-09-28, 16:31
+
Pradeep Kamath 2010-09-28, 17:30
+
Ning Zhang 2010-09-28, 18:23
+
Pradeep Kamath 2010-09-28, 19:30
+
Ning Zhang 2010-09-28, 20:43
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB