Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Re: Issues Running Hadoop 1.1.2 on multi-node cluster


+
Leonid Fedotov 2013-07-10, 16:06
Copy link to this message
-
Re: Issues Running Hadoop 1.1.2 on multi-node cluster
Ram 2013-07-11, 05:43
Hi,
   Please check all directories/files are existed in local system
configured mapres-site.xml and permissions to the files/directories as
mapred as user and hadoop as a group.

Hi,

From,
P.Ramesh Babu,
+91-7893442722.

On Wed, Jul 10, 2013 at 9:36 PM, Leonid Fedotov <[EMAIL PROTECTED]>wrote:

> Make sure your mapred.local.dir (check it in mapred-site.xml) is actually
> exists and writable by your mapreduce usewr.
>
> *Thank you!*
> *
> *
> *Sincerely,*
> *Leonid Fedotov*
>
>
> On Jul 9, 2013, at 6:09 PM, Kiran Dangeti wrote:
>
> Hi Siddharth,
>
> While running the multi-node we need to take care of the local host of the
> slave machine from the error messages the task tracker root directory not
> able to get to the masters. Please check and rerun it.
>
> Thanks,
> Kiran
>
>
> On Tue, Jul 9, 2013 at 10:26 PM, siddharth mathur <[EMAIL PROTECTED]>wrote:
>
>> Hi,
>>
>> I have installed Hadoop 1.1.2 on a 5 nodes cluster. I installed it
>> watching this tutorial *
>> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/
>> *
>>
>> When I startup the hadoop, I get the folloing error in *all* the
>> tasktrackers.
>>
>> "
>> 2013-07-09 12:15:22,301 INFO org.apache.hadoop.mapred.UserLogCleaner:
>> Adding job_201307051203_0001 for user-log deletion with
>> retainTimeStamp:1373472921775
>> 2013-07-09 12:15:22,301 INFO org.apache.hadoop.mapred.UserLogCleaner:
>> Adding job_201307051611_0001 for user-log deletion with
>> retainTimeStamp:1373472921775
>> 2013-07-09 12:15:22,601 INFO org.apache.hadoop.mapred.TaskTracker:*Failed to get system directory
>> *...
>> 2013-07-09 12:15:25,164 INFO org.apache.hadoop.mapred.TaskTracker: Failed
>> to get system directory...
>> 2013-07-09 12:15:27,901 INFO org.apache.hadoop.mapred.TaskTracker: Failed
>> to get system directory...
>> 2013-07-09 12:15:30,144 INFO org.apache.hadoop.mapred.TaskTracker: Failed
>> to get system directory...
>> "
>>
>> *But everything looks fine in the webUI. *
>>
>> When I run a job, I get the following error but the job completes
>> anyways. I have* attached the* *screenshots* of the maptask failed error
>> log in the UI.
>>
>> *"*
>> 13/07/09 12:29:37 INFO input.FileInputFormat: Total input paths to
>> process : 2
>> 13/07/09 12:29:37 INFO util.NativeCodeLoader: Loaded the native-hadoop
>> library
>> 13/07/09 12:29:37 WARN snappy.LoadSnappy: Snappy native library not loaded
>> 13/07/09 12:29:37 INFO mapred.JobClient: Running job:
>> job_201307091215_0001
>> 13/07/09 12:29:38 INFO mapred.JobClient:  map 0% reduce 0%
>> 13/07/09 12:29:41 INFO mapred.JobClient: Task Id :
>> attempt_201307091215_0001_m_000001_0, Status : FAILED
>> Error initializing attempt_201307091215_0001_m_000001_0:
>> ENOENT: No such file or directory
>>     at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
>>     at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
>>     at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
>>     at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
>>     at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
>>     at
>> org.apache.hadoop.mapred.JobLocalizer.initializeJobLogDir(JobLocalizer.java:240)
>>     at
>> org.apache.hadoop.mapred.DefaultTaskController.initializeJob(DefaultTaskController.java:205)
>>     at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1331)
>>     at java.security.AccessController.doPrivileged(Native Method)
>>     at javax.security.auth.Subject.doAs(Subject.java:415)
>>     at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
>>     at
>> org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1306)
>>     at
>> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1221)
>>     at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2581)
>>     at java.lang.Thread.run(Thread.java:724)
>>
>> 13/07/09 12:29:41 WARN mapred.JobClient: Error reading task
+
siddharth mathur 2013-07-12, 00:16