Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - issue launching mapreduce job with kerberos secured hadoop


+
Neeraj Chaplot 2013-05-28, 13:06
Copy link to this message
-
Re: issue launching mapreduce job with kerberos secured hadoop
Rahul Bhattacharjee 2013-05-29, 02:58
The error looks a little low level , network level . The http server for
some reason couldn't bind to the port.
Might have nothing to do with Kerborose.

Thanks,
Rahul
On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <[EMAIL PROTECTED]> wrote:

> Hi All,
>
> When hadoop started with Kerberos authentication hadoop fs commands work
> well but MR job fails.
>
> Simple wordcount program fails at reducer stage giving follwoing exception
> :
> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
> java.net.ConnectException: Connection refused
>     at java.net.PlainSocketImpl.socketConnect(Native Method)
>     at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>     at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>     at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>     at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>     at java.net.Socket.connect(Socket.java:529)
>     at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
>     at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>     at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>     at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>     at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>     at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>     at
> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>     at
> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>     at
> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>     at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
>     at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
>     at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
>     at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
>     at
> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>
> Please provide some inputs to fix the issue.
>
> Thanks
>
>
+
Robert Molina 2013-05-30, 02:48