|
|
-
Hive can't see a DFS file
Vijay Kumar Adhikari 2009-07-28, 14:41
Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,
+++++++++ hive> select 1 from netflow; Total MapReduce jobs = 1 Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver +++++++++
but I can see that the files are there,
+++++++++ $HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1 Found 1 items -rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1 +++++++++
Please help. -- Vijay
-
RE: Hive can't see a DFS file
Ashish Thusoo 2009-07-28, 19:17
Can you put out the contents of
/tmp/<username>/hive.log
>From the machine where you launched the hive cli from.
Ashish
-----Original Message----- From: Vijay Kumar Adhikari [mailto:[EMAIL PROTECTED]] Sent: Tuesday, July 28, 2009 7:42 AM To: [EMAIL PROTECTED] Subject: Hive can't see a DFS file
Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,
+++++++++ hive> select 1 from netflow; Total MapReduce jobs = 1 Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver +++++++++
but I can see that the files are there,
+++++++++ $HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1 Found 1 items -rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1 +++++++++
Please help. -- Vijay
-
Re: Hive can't see a DFS file
Vijay Kumar Adhikari 2009-07-28, 21:25
Attached.
On Tue, Jul 28, 2009 at 2:17 PM, Ashish Thusoo<[EMAIL PROTECTED]> wrote: > Can you put out the contents of > > /tmp/<username>/hive.log > > From the machine where you launched the hive cli from. > > Ashish > > -----Original Message----- > From: Vijay Kumar Adhikari [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, July 28, 2009 7:42 AM > To: [EMAIL PROTECTED] > Subject: Hive can't see a DFS file > > Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException, > > +++++++++ > hive> select 1 from netflow; > Total MapReduce jobs = 1 > Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)' > FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver > +++++++++ > > but I can see that the files are there, > > +++++++++ > $HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1 > Found 1 items > -rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1 > +++++++++ > > Please help. > -- > Vijay >
-- Vijay
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext