Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive can't see a DFS file

Copy link to this message
RE: Hive can't see a DFS file
Can you put out the contents of


>From the machine where you launched the hive cli from.


-----Original Message-----
From: Vijay Kumar Adhikari [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, July 28, 2009 7:42 AM
Subject: Hive can't see a DFS file

Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,

hive> select 1 from netflow;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver

but I can see that the files are there,

$HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
Found 1 items
-rw-r--r--   2 viadhi supergroup         87 2009-07-28 09:37 /tmp/hive-viadhi/1

Please help.