Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> JobSubmissionFiles: past , present, and future?

Copy link to this message
Re: JobSubmissionFiles: past , present, and future?
To update on this, it was just pointed out to me by matt farrallee
that the auto fix of permissions is for a failsafe
in case of a race condition, and not meant to mend bad permissions in all cases:


Something to keep in mind - if you see the "fixing staging permissions" error message alot
Then there might be a more systemic problem in your fs... At least, that was the case for us.

On Apr 12, 2013, at 6:11 AM, Jay Vyas <[EMAIL PROTECTED]> wrote:

> Hi guys:
> I'm curious about the changes and future of the JobSubmissionFiles class.
> Grepping around on the web I'm finding some code snippets that suggest that hadoop security is not handled the same way on the staging directory as before:
> http://javasourcecode.org/html/open-source/hadoop/hadoop-
> http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-user/201210.mbox/%3CCAOcnVr0EYLSckXaOCPNm7kBZWpHvCdjBBX5A+[EMAIL PROTECTED]%3E
> But I'm having trouble definitively pinning this to versions.
> Why the difference in the if/else logic here and what is the future
> Of permissions on .staging?