Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> issue launching mapreduce job with kerberos secured hadoop


+
Neeraj Chaplot 2013-05-28, 13:06
+
Rahul Bhattacharjee 2013-05-29, 02:58
Copy link to this message
-
Re: issue launching mapreduce job with kerberos secured hadoop
Hi Neeraj,
This error doesn't look to be kerberos related initially. Can you
verify if 192.168.49.51
has the tasktracker process running?

Regards,
Robert
On Tue, May 28, 2013 at 7:58 PM, Rahul Bhattacharjee <
[EMAIL PROTECTED]> wrote:

> The error looks a little low level , network level . The http server for
> some reason couldn't bind to the port.
> Might have nothing to do with Kerborose.
>
> Thanks,
> Rahul
>
>
> On Tue, May 28, 2013 at 6:36 PM, Neeraj Chaplot <[EMAIL PROTECTED]> wrote:
>
>> Hi All,
>>
>> When hadoop started with Kerberos authentication hadoop fs commands work
>> well but MR job fails.
>>
>> Simple wordcount program fails at reducer stage giving follwoing
>> exception :
>> 013-05-28 17:43:58,896 WARN org.apache.hadoop.mapred.
>> ReduceTask: attempt_201305281729_0003_r_000000_1 copy failed:
>> attempt_201305281729_0003_m_000000_0 from 192.168.49.51
>> 2013-05-28 17:43:58,897 WARN org.apache.hadoop.mapred.ReduceTask:
>> java.net.ConnectException: Connection refused
>>     at java.net.PlainSocketImpl.socketConnect(Native Method)
>>     at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>>     at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>>     at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>>     at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>>     at java.net.Socket.connect(Socket.java:529)
>>     at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
>>     at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>>     at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>>     at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>>     at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>>     at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>>     at
>> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>>     at
>> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>>     at
>> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>>     at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getInputStream(ReduceTask.java:1618)
>>     at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.setupSecureConnection(ReduceTask.java:1575)
>>     at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.getMapOutput(ReduceTask.java:1483)
>>     at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.copyOutput(ReduceTask.java:1394)
>>     at
>> org.apache.hadoop.mapred.ReduceTask$ReduceCopier$MapOutputCopier.run(ReduceTask.java:1326)
>>
>> Please provide some inputs to fix the issue.
>>
>> Thanks
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB