Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> java.lang.IllegalStateException: Invalid shuffle port number -1


Copy link to this message
-
java.lang.IllegalStateException: Invalid shuffle port number -1
Hi,

I am trying to run mapreduce with yarn (mrv2). Kicked off with word count
example but failed with the below exception. Can some one help me out.

Container launch failed for container_1384558555627_0001_01_000002 :
java.lang.IllegalStateException: Invalid shuffle port number -1 returned
for attempt_1384558555627_0001_m_000000_0
        at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:170)
        at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:396)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)

mapred-site.xml
========================
<configuration>
     <property>
         <name>mapred.job.tracker</name>
         <value>localhost:9001</value>
     </property>
 <property>
      <name>mapreduce.framework.name</name>
      <value>yarn</value>
   </property>
 <property>
      <name>mapreduce.shuffle.port</name>
      <value>8081</value>
   </property>
</configuration>

yarn-site.xml
====================<!-- Site specific YARN configuration properties -->
<!--
<property>
   <name>yarn.nodemanager.aux-services</name>
   <value>mapreduce_shuffle</value>
</property>
-->
<property>
   <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
   <value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>
Regards,
Nagarjuna K
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB