Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> No such file or directory error on simple query


Copy link to this message
-
No such file or directory error on simple query
I am struggling with a "no such file or directory exception " when running
a simple query in hive.   It is unfortunate that the actual path  were not
included with the stacktrace: the following is all that is provided.

I have a query that fails with the following error when done as   hive -e
"select * from <table>'". But it works properly when done within the hive
shell.  But at the same time, doing hive> select * from <table2>;" fails
with the same error message.

I am also seeing this error both for hdfs files and for s3 files.  Without
any path information it is  very difficult and time consuming to track this
down.

Any pointers appreciated.
Automatically selecting local only mode for query
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
files.
Execution log at:
/tmp/impala/impala_20130302095252_79ce9404-6af7-405b-8b06-849fe6c5328d.log
ENOENT: No such file or directory
at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:568)
at
org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:411)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:501)
at
org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:733)
at
org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:692)
at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:172)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:910)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:895)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:895)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:869)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:435)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:677)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
Job Submission failed with exception
'org.apache.hadoop.io.nativeio.NativeIOException(No such file or directory)'
Execution failed with exit status: 1
Obtaining error information