Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> java.lang.IllegalStateException: Invalid shuffle port number -1


Copy link to this message
-
java.lang.IllegalStateException: Invalid shuffle port number -1
Hi,

I am trying to run mapreduce with yarn (mrv2). Kicked off with word count
example but failed with the below exception. Can some one help me out.

Container launch failed for container_1384558555627_0001_01_000002 :
java.lang.IllegalStateException: Invalid shuffle port number -1 returned
for attempt_1384558555627_0001_m_000000_0
        at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:170)
        at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:396)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)

mapred-site.xml
========================
<configuration>
     <property>
         <name>mapred.job.tracker</name>
         <value>localhost:9001</value>
     </property>
 <property>
      <name>mapreduce.framework.name</name>
      <value>yarn</value>
   </property>
 <property>
      <name>mapreduce.shuffle.port</name>
      <value>8081</value>
   </property>
</configuration>

yarn-site.xml
====================<!-- Site specific YARN configuration properties -->
<!--
<property>
   <name>yarn.nodemanager.aux-services</name>
   <value>mapreduce_shuffle</value>
</property>
-->
<property>
   <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
   <value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>
Regards,
Nagarjuna K