Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Staging directory ENOTDIR error.


Copy link to this message
-
Re: Staging directory ENOTDIR error.
This was a very odd error - it turns out that i had created a file, called
"tmp" in my fs root directory, which meant that
when the jobs were trying to write to the tmp directory, they ran into the
not-a-dir exception.

In any case, I think the error reporting in NativeIO class should be
revised.

On Thu, Jul 11, 2013 at 10:24 PM, Devaraj k <[EMAIL PROTECTED]> wrote:

>  Hi Jay,****
>
> ** **
>
>    Here client is trying to create a staging directory in local file
> system,  which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
>     ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:[EMAIL PROTECTED]]
> *Sent:* 12 July 2013 04:12
> *To:* [EMAIL PROTECTED]
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
>     at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
>     at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
>     at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
>     at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
>     at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
>     at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
>     at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>

--
Jay Vyas
http://jayunit100.blogspot.com