Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - Hive can't see a DFS file


Copy link to this message
-
RE: Hive can't see a DFS file
Ashish Thusoo 2009-07-28, 19:17
Can you put out the contents of

/tmp/<username>/hive.log

>From the machine where you launched the hive cli from.

Ashish

-----Original Message-----
From: Vijay Kumar Adhikari [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, July 28, 2009 7:42 AM
To: [EMAIL PROTECTED]
Subject: Hive can't see a DFS file

Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,

+++++++++
hive> select 1 from netflow;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver
+++++++++

but I can see that the files are there,

+++++++++
$HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
Found 1 items
-rw-r--r--   2 viadhi supergroup         87 2009-07-28 09:37 /tmp/hive-viadhi/1
+++++++++

Please help.
--
Vijay