Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Exception comes out when counting the rows


Copy link to this message
-
Re: Exception comes out when counting the rows
Normally, you do not use load data when you use external table. You either
specify location in the create external table query or use alter table
<tablename> set location syntax to set the location of the files that the
external table stores the data.

In this case, try describe extended NMS_CMTS_CPU_CDX_TEST and see what is
the value for location.

It is better to use the location as I mentioned above for external tables
instead of using load data. This way there is no confusion between managed
tables and external tables locations.

Regards,
Ramki.
On Mon, Apr 22, 2013 at 2:01 AM, YouPeng Yang <[EMAIL PROTECTED]>wrote:

>
> Hi hive users
>
>   Sorry for missing the title on the previous mail.
>
>   This is my first time to post a question here.
>
> I have gotten an exception when I count the rows of  my hive table after I
> have loaded the data:
>
> hive>create EXTERNAL TABLE  NMS_CMTS_CPU_CDX_TEST (CMTSID INT,MSEQ
> INT,GOTTIME BIGINT,CMTSINDEX INT,CPUTOTAL INT,DESCR STRING) ROW FORMAT
>  DELIMITED FIELDS TERMINATED BY '|' LINES TERMINATED BY '\n'  STORED AS
> TEXTFILE;
>
> hive>load data inpath '/user/sqoop/NMS_CMTS_CPU_CDX3/NMS_CMTS_CPU_CDX3'
>  into table NMS_CMTS_CPU_CDX_TEST;
>
> hive> select count(1) from NMS_CMTS_CPU_CDX_TEST;
> I get an exception on step 3,logs are as follows.
>
> Any helps will be gratefull.
>
> Regards
>
> -----------------------------------------------------------------------------------
> ....
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
> use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
> files.
> Execution log at:
> /tmp/hive/hive_20130422162020_791a7b61-6ba0-466d-99ba-5c2556bafaa4.log
> Job running in-process (local Hadoop)
> Hadoop job information for null: number of mappers: 1; number of reducers:
> 1
> 2013-04-22 16:24:21,604 null map = 0%,  reduce = 0%
> 2013-04-22 16:25:21,965 null map = 0%,  reduce = 0%
> 2013-04-22 16:26:22,902 null map = 0%,  reduce = 0%
> 2013-04-22 16:26:27,312 null map = 100%,  reduce = 0%
> Ended Job = job_1364348895095_0055 with errors
> Error during job, obtaining debugging information...
> Examining task ID: task_1364348895095_0055_m_000000 (and more) from job
> job_1364348895095_0055
> Unable to retrieve URL for Hadoop Task logs. Does not contain a valid
> host:port authority: local
>
> Task with the most failures(4):
> -----
> Task ID:
>   task_1364348895095_0055_m_000000
>
> URL:
>   Unavailable
> -----
> Diagnostic Messages for this Task:
> Error: java.lang.RuntimeException: java.io.FileNotFoundException:
> /tmp/hive/hive_2013-04-22_16-20-45_720_3839682514463028560/-mr-10001/89dd576e-fb9d-409a-8b46-2e46b7d21160
> (No such file or directory)
> at
> org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:224)
>  at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381)
>  at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374)
> at
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:536)
>  at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:160)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:381)
>  at org.apache.hadoop.mapred.MapTask.run(MapTask.java:334)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
>  at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
>  at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
> Caused by: java.io.FileNotFoundException:
> /tmp/hive/hive_2013-04-22_16-20-45_720_3839682514463028560/-mr-10001/89dd576e-fb9d-409a-8b46-2e46b7d21160
> (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
>  at java.io.FileInputStream.<init>(FileInputStream.java:120)