Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - issue about running hive MR job in hadoop


+
ch huang 2014-01-03, 07:44
Copy link to this message
-
Re: issue about running hive MR job in hadoop
Bing Jiang 2014-01-03, 07:52
Could you check your yarn-local directory authority? From the diagnosis,
error occurs at mkdir in local directory.
I guess something wrong with  local direcotry which is set as yarn local
dir.

2014/1/3 ch huang <[EMAIL PROTECTED]>

> hi, i submit a MR job through hive ,but when it run stage-2 ,it failed why?
>
>  it seems permission problem ,but i do not know which dir cause the problem
>
> Application application_1388730279827_0035 failed 1 times due to AM
> Container for appattempt_1388730279827_0035_000001 exited with exitCode:
> -1000 due to: EPERM: Operation not permitted at
> org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method) at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:581)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:388)
> at org.apache.hadoop.fs.FileSystem.primitiveMkdir(FileSystem.java:1041) at
> org.apache.hadoop.fs.DelegateToFileSystem.mkdir(DelegateToFileSystem.java:150)
> at org.apache.hadoop.fs.FilterFs.mkdir(FilterFs.java:190) at
> org.apache.hadoop.fs.FileContext$4.next(FileContext.java:698) at
> org.apache.hadoop.fs.FileContext$4.next(FileContext.java:695) at
> org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2325)
> at org.apache.hadoop.fs.FileContext.mkdir(FileContext.java:695) at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.initDirs(ContainerLocalizer.java:385)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:130)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:103)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:861)
> .Failing this attempt.. Failing the application.
>

--
Bing Jiang
Tel:(86)134-2619-1361
weibo: http://weibo.com/jiangbinglover
BLOG: www.binospace.com
BLOG: http://blog.sina.com.cn/jiangbinglover
Focus on distributed computing, HDFS/HBase
+
ch huang 2014-01-03, 08:40