Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> [yarn] job is not getting assigned


+
Andre Kelpe 2013-08-29, 14:52
Copy link to this message
-
Re: [yarn] job is not getting assigned

This usually means there are no available resources as seen by the ResourceManager. Do you see "Active Nodes" on the RM web UI first page? If not, you'll have to check the NodeManager logs to see if they crashed for some reason.

Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/

On Aug 29, 2013, at 7:52 AM, Andre Kelpe wrote:

> Hi,
>
> I am in the middle of setting up a hadoop 2 cluster. I am using the hadoop 2.1-beta tarball.
>
> My cluster has 1 master node running the hdfs namenode, the resourcemanger and the job history server. Next to that I have  3 nodes acting as datanodes and nodemanagers.
>
> In order to test, if everything is working, I submitted the teragen job from the hadoop-examples jar like this:
>
> $ hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.1.0-beta.jar teragen 1000 /user/vagrant/teragen
>
> The job starts up and I  get the following output:
>
> 13/08/29 14:42:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 13/08/29 14:42:47 INFO client.RMProxy: Connecting to ResourceManager at master.local/192.168.7.10:8032
> 13/08/29 14:42:48 INFO terasort.TeraSort: Generating 1000 using 2
> 13/08/29 14:42:48 INFO mapreduce.JobSubmitter: number of splits:2
> 13/08/29 14:42:48 WARN conf.Configuration: user.name is deprecated. Instead, use mapreduce.job.user.name
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 13/08/29 14:42:48 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 13/08/29 14:42:49 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1377787324271_0001
> 13/08/29 14:42:50 INFO impl.YarnClientImpl: Submitted application application_1377787324271_0001 to ResourceManager at master.local/192.168.7.10:8032
> 13/08/29 14:42:50 INFO mapreduce.Job: The url to track the job: http://master.local:8088/proxy/application_1377787324271_0001/
> 13/08/29 14:42:50 INFO mapreduce.Job: Running job: job_1377787324271_0001
>
> and then it stops. If I check the UI, I see this:
>
> application_1377787324271_0001 vagrant TeraGen MAPREDUCE default Thu, 29 Aug 2013 14:42:49 GMT N/A ACCEPTED UNDEFINED
>
> UNASSIGNED
>
> I have no idea, why it is not starting, nor what to look for. Any pointers are more than welcome!
>
> Thanks!
>
> - André
>
> --
> André Kelpe
> [EMAIL PROTECTED]
> http://concurrentinc.com
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
+
Andre Kelpe 2013-08-30, 09:07