Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: Job tracker service start issue.


Copy link to this message
-
Re: Job tracker service start issue.


On 03/23/2012 06:57 AM, kasi subrahmanyam wrote:
> Hi Oliver,
>
> I am not sure my suggestion might solve your problem or it might be already
> solved on your side.
> It seems the task tracker is having a problem accessing the tmp directory.
> Try going to the core and mapred site xml and change the tmp directory to a
> new one.
> If this is not yet working then manually change the permissions of theat
> directory  using :
> chmod -R 777 tmp
Please, don�t do chmod -R 777 in tmp directory. It�s not recommendable
for production servers.
The first option is more wise:
1- change the tmp directory in the core and mapreduce files
2- chown this new directory to group hadoop, where are the mapred and
hdfs users
>
> On Fri, Mar 23, 2012 at 3:33 PM, Olivier Sallou<[EMAIL PROTECTED]>wrote:
>
>>
>> Le 3/23/12 8:50 AM, Manish Bhoge a �crit :
>>> I have Hadoop running on Standalone box. When I am starting deamon for
>>> namenode, secondarynamenode, job tracker, task tracker and data node, it
>> is starting gracefully. But soon after it start job tracker it doesn't
>>> show up job tracker service. when i run 'jps' it is showing me all the
>>> services including task tracker except Job Tracker.
>>>
>>> Is there any time limit that need to set up or is it going into the safe
>>> mode. Because when i saw job tracker log this what it is showing, looks
>>> like it is starting the namenode but soon after it shutdown:
>>>
>>> 2012-03-22 23:26:04,061 INFO org.apache.hadoop.mapred.JobTracker:
>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting JobTracker
>>> STARTUP_MSG:   host = manish/10.131.18.119
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 0.20.2-cdh3u3
>>> STARTUP_MSG:   build >> file:///data/1/tmp/nightly_2012-02-16_09-46-24_3/hadoop-0.20-0.20.2+923.195-1~maverick
>> -r 217a3767c48ad11d4632e19a22897677268c40c4; compiled by 'root' on Thu Feb
>> 16 10:22:53 PST 2012
>>> ************************************************************/
>>> 2012-03-22 23:26:04,140 INFO
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Updating the current master key for generating delegation tokens
>>> 2012-03-22 23:26:04,141 INFO
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Starting expired delegation token remover thread,
>> tokenRemoverScanInterval=60 min(s)
>>> 2012-03-22 23:26:04,141 INFO
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Updating the current master key for generating delegation tokens
>>> 2012-03-22 23:26:04,142 INFO org.apache.hadoop.mapred.JobTracker:
>> Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
>> limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
>>> 2012-03-22 23:26:04,143 INFO org.apache.hadoop.util.HostsFileReader:
>> Refreshing hosts (include/exclude) list
>>> 2012-03-22 23:26:04,186 INFO org.apache.hadoop.mapred.JobTracker:
>> Starting jobtracker with owner as mapred
>>> 2012-03-22 23:26:04,201 INFO org.apache.hadoop.ipc.Server: Starting
>> Socket Reader #1 for port 54311
>>> 2012-03-22 23:26:04,203 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
>> Initializing RPC Metrics with hostName=JobTracker, port=54311
>>> 2012-03-22 23:26:04,206 INFO
>> org.apache.hadoop.ipc.metrics.RpcDetailedMetrics: Initializing RPC Metrics
>> with hostName=JobTracker, port=54311
>>> 2012-03-22 23:26:09,250 INFO org.mortbay.log: Logging to
>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> org.mortbay.log.Slf4jLog
>>> 2012-03-22 23:26:09,298 INFO org.apache.hadoop.http.HttpServer: Added
>> global filtersafety
>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-03-22 23:26:09,318 INFO org.apache.hadoop.http.HttpServer: Port
>> returned by webServer.getConnectors()[0].getLocalPort() before open() is
>> -1. Opening the listener on 50030
>>> 2012-03-22 23:26:09,318 INFO org.apache.hadoop.http.HttpServer:

Marcos Luis Ort�z Valmaseda (@marcosluis2186)
  Data Engineer at UCI
  http://marcosluis2186.posterous.com
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB