Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Why this problem is not solved yet ?


Copy link to this message
-
Re: Why this problem is not solved yet ?
Hi Ravishankar,

I don't see two very important processes in your jps output. Just like
there's JobTracker and NameNode, you should also have "TaskTracker" and
"DataNode". The JobTracker only schedules jobs. To actually run the map
reduce tasks, it needs TaskTrackers. This is why you see the jobtracker
accepting your jobs and then getting stuck: because it doesn't have
TaskTrackers to run that job on.

If I were you, I'd first check why the Datanode is not coming up. All 4
daemons are necessary for running jobs. The logs for those two should be in
the same directory in which you find the JT's logs.

Hope this helps.
Ravi.

On Fri, May 18, 2012 at 5:17 AM, Ravishankar Nair <
[EMAIL PROTECTED]> wrote:

> Additionally, attached is the output of the job that I run( I mean the
> example program named grep)
>
>
> On Fri, May 18, 2012 at 6:15 AM, Ravishankar Nair <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Ravi,
>>
>> Yes , it Running. Here is the output:-
>> rn13067@WSUSJXLHRN13067 /home/hadoop-1.0.3
>> $ jps
>> 5068 NameNode
>> 5836 Jps
>> 3516 JobTracker
>>
>>
>> Here are the logs from JOBTRACKER:-
>>
>> 2012-05-17 21:41:31,772 INFO org.apache.hadoop.mapred.TaskTracker:
>> STARTUP_MSG:
>> /************************************************************
>> STARTUP_MSG: Starting TaskTracker
>>
>> STARTUP_MSG:   host = WSUSJXLHRN13067/192.168.0.16
>> STARTUP_MSG:   args = []
>> STARTUP_MSG:   version = 1.0.3
>> STARTUP_MSG:   build >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> ************************************************************/
>> 2012-05-17 21:41:31,944 INFO
>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>> hadoop-metrics2.properties
>> 2012-05-17 21:41:31,990 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> MetricsSystem,sub=Stats registered.
>> 2012-05-17 21:41:31,990 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>> period at 10 second(s).
>> 2012-05-17 21:41:31,990 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>> system started
>> 2012-05-17 21:41:32,256 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
>> registered.
>> 2012-05-17 21:41:32,256 WARN
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
>> exists!
>> 2012-05-17 21:41:32,365 INFO org.mortbay.log: Logging to
>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> org.mortbay.log.Slf4jLog
>> 2012-05-17 21:41:32,412 INFO org.apache.hadoop.http.HttpServer: Added
>> global filtersafety
>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> 2012-05-17 21:41:32,428 INFO org.apache.hadoop.mapred.TaskLogsTruncater:
>> Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> 2012-05-17 21:41:32,444 INFO org.apache.hadoop.mapred.TaskTracker:
>> Starting tasktracker with owner as SYSTEM
>> 2012-05-17 21:41:32,444 INFO org.apache.hadoop.mapred.TaskTracker: Good
>> mapred local directories are: /tmp/hadoop-SYSTEM/mapred/local
>> 2012-05-17 21:41:32,459 WARN org.apache.hadoop.util.NativeCodeLoader:
>> Unable to load native-hadoop library for your platform... using
>> builtin-java classes where applicable
>> 2012-05-17 21:41:32,459 ERROR org.apache.hadoop.mapred.TaskTracker: Can
>> not start task tracker because java.io.IOException: Failed to set
>> permissions of path: \tmp\hadoop-SYSTEM\mapred\local\ttprivate to 0700
>>     at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
>>     at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
>>     at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
>>     at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
>>     at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
>>     at
>> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:728)