Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive can't see a DFS file


Copy link to this message
-
RE: Hive can't see a DFS file
Can you put out the contents of

/tmp/<username>/hive.log

>From the machine where you launched the hive cli from.

Ashish

-----Original Message-----
From: Vijay Kumar Adhikari [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, July 28, 2009 7:42 AM
To: [EMAIL PROTECTED]
Subject: Hive can't see a DFS file

Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,

+++++++++
hive> select 1 from netflow;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver
+++++++++

but I can see that the files are there,

+++++++++
$HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
Found 1 items
-rw-r--r--   2 viadhi supergroup         87 2009-07-28 09:37 /tmp/hive-viadhi/1
+++++++++

Please help.
--
Vijay
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB