Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >>


Hi hive users

  This is my first time to post a question here.

I have gotten an exception when I count the rows of  my hive table after I
have loaded the data:

hive>create EXTERNAL TABLE  NMS_CMTS_CPU_CDX_TEST (CMTSID INT,MSEQ
INT,GOTTIME BIGINT,CMTSINDEX INT,CPUTOTAL INT,DESCR STRING) ROW FORMAT
 DELIMITED FIELDS TERMINATED BY '|' LINES TERMINATED BY '\n'  STORED AS
TEXTFILE;

hive>load data inpath '/user/sqoop/NMS_CMTS_CPU_CDX3/NMS_CMTS_CPU_CDX3'
 into table NMS_CMTS_CPU_CDX_TEST;

hive> select count(1) from NMS_CMTS_CPU_CDX_TEST;
I get an exception on step 3,logs are as follows.

Any helps will be gratefull.

Regards
-----------------------------------------------------------------------------------
....
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
files.
Execution log at:
/tmp/hive/hive_20130422162020_791a7b61-6ba0-466d-99ba-5c2556bafaa4.log
Job running in-process (local Hadoop)
Hadoop job information for null: number of mappers: 1; number of reducers: 1
2013-04-22 16:24:21,604 null map = 0%,  reduce = 0%
2013-04-22 16:25:21,965 null map = 0%,  reduce = 0%
2013-04-22 16:26:22,902 null map = 0%,  reduce = 0%
2013-04-22 16:26:27,312 null map = 100%,  reduce = 0%
Ended Job = job_1364348895095_0055 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1364348895095_0055_m_000000 (and more) from job
job_1364348895095_0055
Unable to retrieve URL for Hadoop Task logs. Does not contain a valid
host:port authority: local

Task with the most failures(4):
-----
Task ID:
  task_1364348895095_0055_m_000000

URL:
  Unavailable
-----
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException: java.io.FileNotFoundException:
/tmp/hive/hive_2013-04-22_16-20-45_720_3839682514463028560/-mr-10001/89dd576e-fb9d-409a-8b46-2e46b7d21160
(No such file or directory)
at
org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:224)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:536)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:160)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:381)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:334)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.io.FileNotFoundException:
/tmp/hive/hive_2013-04-22_16-20-45_720_3839682514463028560/-mr-10001/89dd576e-fb9d-409a-8b46-2e46b7d21160
(No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:120)
at java.io.FileInputStream.<init>(FileInputStream.java:79)
at
org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:215)
... 12 more
Execution failed with exit status: 2
13/04/22 16:26:28 ERROR exec.Task: Execution failed with exit status: 2
Obtaining error information
13/04/22 16:26:28 ERROR exec.Task: Obtaining error information

Task failed!
Task ID:
  Stage-1

Logs:

13/04/22 16:26:28 ERROR exec.Task:
Task failed!
Task ID:
  Stage-1

Logs:

13/04/22 16:26:28 ERROR exec.ExecDriver: Execution failed with exit status:
2
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
13/04/22 16:26:28 ERROR ql.Driver: FAILED: Execution Error, return code 2
from org.apache.hadoop.hive.ql.exec.MapRedTask
13/04/22 16:26:28 INFO ql.Driver: </PERFLOG method=Driver.execute
start=1366618840573 end=1366619188646 duration=348073>
13/04/22 16:26:28 INFO ql.Driver: <PERFLOG method=releaseLocks>
13/04/22 16:26:28 INFO ql.Driver: </PERFLOG method=releaseLocks
start=1366619188646 end=1366619188646 duration=0>