Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> YARN jobs takes too long to start


Copy link to this message
-
YARN jobs takes too long to start
I noticed that after some update on branch 0.23 yarn jobs are about 4
minutes in PREP stage. I tried to track source of problem at it seems
that chmod 0700 is called on every class file unpacked from job JAR.

Can you point me to code which is doing it, hadoop also supports
recursive chmod which should be used instead of fork/exec chmod