Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Re: Job tracker service start issue.


Copy link to this message
-
Re: Job tracker service start issue.
Marcos Ortiz 2012-03-23, 15:57


On 03/23/2012 06:57 AM, kasi subrahmanyam wrote:
> Hi Oliver,
>
> I am not sure my suggestion might solve your problem or it might be already
> solved on your side.
> It seems the task tracker is having a problem accessing the tmp directory.
> Try going to the core and mapred site xml and change the tmp directory to a
> new one.
> If this is not yet working then manually change the permissions of theat
> directory  using :
> chmod -R 777 tmp
Please, don�t do chmod -R 777 in tmp directory. It�s not recommendable
for production servers.
The first option is more wise:
1- change the tmp directory in the core and mapreduce files
2- chown this new directory to group hadoop, where are the mapred and
hdfs users
>
> On Fri, Mar 23, 2012 at 3:33 PM, Olivier Sallou<[EMAIL PROTECTED]>wrote:
>
>>
>> Le 3/23/12 8:50 AM, Manish Bhoge a �crit :
>>> I have Hadoop running on Standalone box. When I am starting deamon for
>>> namenode, secondarynamenode, job tracker, task tracker and data node, it
>> is starting gracefully. But soon after it start job tracker it doesn't
>>> show up job tracker service. when i run 'jps' it is showing me all the
>>> services including task tracker except Job Tracker.
>>>
>>> Is there any time limit that need to set up or is it going into the safe
>>> mode. Because when i saw job tracker log this what it is showing, looks
>>> like it is starting the namenode but soon after it shutdown:
>>>
>>> 2012-03-22 23:26:04,061 INFO org.apache.hadoop.mapred.JobTracker:
>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting JobTracker
>>> STARTUP_MSG:   host = manish/10.131.18.119
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 0.20.2-cdh3u3
>>> STARTUP_MSG:   build >> file:///data/1/tmp/nightly_2012-02-16_09-46-24_3/hadoop-0.20-0.20.2+923.195-1~maverick
>> -r 217a3767c48ad11d4632e19a22897677268c40c4; compiled by 'root' on Thu Feb
>> 16 10:22:53 PST 2012
>>> ************************************************************/
>>> 2012-03-22 23:26:04,140 INFO
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Updating the current master key for generating delegation tokens
>>> 2012-03-22 23:26:04,141 INFO
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Starting expired delegation token remover thread,
>> tokenRemoverScanInterval=60 min(s)
>>> 2012-03-22 23:26:04,141 INFO
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Updating the current master key for generating delegation tokens
>>> 2012-03-22 23:26:04,142 INFO org.apache.hadoop.mapred.JobTracker:
>> Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
>> limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
>>> 2012-03-22 23:26:04,143 INFO org.apache.hadoop.util.HostsFileReader:
>> Refreshing hosts (include/exclude) list
>>> 2012-03-22 23:26:04,186 INFO org.apache.hadoop.mapred.JobTracker:
>> Starting jobtracker with owner as mapred
>>> 2012-03-22 23:26:04,201 INFO org.apache.hadoop.ipc.Server: Starting
>> Socket Reader #1 for port 54311
>>> 2012-03-22 23:26:04,203 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
>> Initializing RPC Metrics with hostName=JobTracker, port=54311
>>> 2012-03-22 23:26:04,206 INFO
>> org.apache.hadoop.ipc.metrics.RpcDetailedMetrics: Initializing RPC Metrics
>> with hostName=JobTracker, port=54311
>>> 2012-03-22 23:26:09,250 INFO org.mortbay.log: Logging to
>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> org.mortbay.log.Slf4jLog
>>> 2012-03-22 23:26:09,298 INFO org.apache.hadoop.http.HttpServer: Added
>> global filtersafety
>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-03-22 23:26:09,318 INFO org.apache.hadoop.http.HttpServer: Port
>> returned by webServer.getConnectors()[0].getLocalPort() before open() is
>> -1. Opening the listener on 50030
>>> 2012-03-22 23:26:09,318 INFO org.apache.hadoop.http.HttpServer:

Marcos Luis Ort�z Valmaseda (@marcosluis2186)
  Data Engineer at UCI
  http://marcosluis2186.posterous.com
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci