Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Problem with RPC encryption over wire


+
rab ra 2013-11-13, 12:05
+
Daryn Sharp 2013-11-13, 14:40
+
rab ra 2013-11-14, 06:15
Copy link to this message
-
Re: Problem with RPC encryption over wire
rab ra 2013-11-14, 07:56
Any hint ?
On 14 Nov 2013 11:45, "rab ra" <[EMAIL PROTECTED]> wrote:

> Thank for the response.
>
> I have removed rpc.protection parameter in all of my configuration and now
> I am getting an error as below:-
>
>
>
> Any Hint on whats going on here
>
>
>
> 13/11/14 10:10:47 INFO mapreduce.Job: Task Id :
> attempt_1384339616944_0002_m_000026_0, Status : FAILED
>
> Container launch failed for container_1384339616944_0002_01_000029 :
> java.net.SocketTimeoutException: Call From U1204D32/40.221.95.97 to
> U1204D32.blr.in.as.airbus.corp:45003 failed on socket timeout exception:
> java.net.SocketTimeoutException: 60000 millis timeout while waiting for
> channel to be ready for read. ch :
> java.nio.channels.SocketChannel[connected local=/40.221.95.97:48268remote=U1204D32.blr.in.as.airbus.corp/
> 40.221.95.97:45003]; For more details see:
> http://wiki.apache.org/hadoop/SocketTimeout
>
>       at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>
>       at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>
>       at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>
>       at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>
>       at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)
>
>       at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:749)
>
>       at org.apache.hadoop.ipc.Client.call(Client.java:1351)
>
>       at org.apache.hadoop.ipc.Client.call(Client.java:1300)
>
>       at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
>
>       at com.sun.proxy.$Proxy30.startContainers(Unknown Source)
>
>       at
> org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainers(ContainerManagementProtocolPBClientImpl.java:96)
>
>       at
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:151)
>
>       at
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)
>
>       at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
>       at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
>       at java.lang.Thread.run(Thread.java:744)
>
> Caused by: java.net.SocketTimeoutException: 60000 millis timeout while
> waiting for channel to be ready for read. ch :
> java.nio.channels.SocketChannel[connected local=/40.221.95.97:48268remote=U1204D32.blr.in.as.airbus.corp/
> 40.221.95.97:45003]
>
>       at
> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)
>
>       at
> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
>
>       at
> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
>
>       at java.io.FilterInputStream.read(FilterInputStream.java:133)
>
>       at java.io.FilterInputStream.read(FilterInputStream.java:133)
>
>       at
> org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:457)
>
>       at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
>
>       at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
>
>       at java.io.DataInputStream.readInt(DataInputStream.java:387)
>
>       at
> org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:995)
>
>       at org.apache.hadoop.ipc.Client$Connection.run(Client.java:891)
>
>
>
> 13/11/14 10:10:50 INFO mapreduce.Job:  map 72% reduce 24%
>
> 13/11/14 10:19:13 INFO mapreduce.Job:  map 76% reduce 24%
>
> 13/11/14 10:19:55 INFO mapreduce.Job:  map 78% reduce 24%
>
> 13/11/14 10:20:10 INFO mapreduce.Job:  map 80% reduce 24%
>
> 13/11/14 10:20:29 INFO mapreduce.Job:  map 81% reduce 24%
>
> 13/11/14 10:21:50 INFO mapreduce.Job:  map 82% reduce 24%
>
> 13/11/14 10:22:01 INFO mapreduce.Job:  map 83% reduce 24%
>
> 13/11/14 10:22:10 INFO mapreduce.Job:  map 84% reduce 24%