Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Problem with RPC encryption over wire


Copy link to this message
-
Re: Problem with RPC encryption over wire
Thank for the response.

I have removed rpc.protection parameter in all of my configuration and now
I am getting an error as below:-

Any Hint on whats going on here

13/11/14 10:10:47 INFO mapreduce.Job: Task Id :
attempt_1384339616944_0002_m_000026_0, Status : FAILED

Container launch failed for container_1384339616944_0002_01_000029 :
java.net.SocketTimeoutException: Call From U1204D32/40.221.95.97 to
U1204D32.blr.in.as.airbus.corp:45003 failed on socket timeout exception:
java.net.SocketTimeoutException: 60000 millis timeout while waiting for
channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected
local=/40.221.95.97:48268remote=U1204D32.blr.in.as.airbus.corp/
40.221.95.97:45003]; For more details see:
http://wiki.apache.org/hadoop/SocketTimeout

      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

      at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

      at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

      at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

      at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)

      at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:749)

      at org.apache.hadoop.ipc.Client.call(Client.java:1351)

      at org.apache.hadoop.ipc.Client.call(Client.java:1300)

      at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)

      at com.sun.proxy.$Proxy30.startContainers(Unknown Source)

      at
org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainers(ContainerManagementProtocolPBClientImpl.java:96)

      at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:151)

      at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)

      at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

Caused by: java.net.SocketTimeoutException: 60000 millis timeout while
waiting for channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected
local=/40.221.95.97:48268remote=U1204D32.blr.in.as.airbus.corp/
40.221.95.97:45003]

      at
org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)

      at
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)

      at
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)

      at java.io.FilterInputStream.read(FilterInputStream.java:133)

      at java.io.FilterInputStream.read(FilterInputStream.java:133)

      at
org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:457)

      at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)

      at java.io.BufferedInputStream.read(BufferedInputStream.java:254)

      at java.io.DataInputStream.readInt(DataInputStream.java:387)

      at
org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:995)

      at org.apache.hadoop.ipc.Client$Connection.run(Client.java:891)

13/11/14 10:10:50 INFO mapreduce.Job:  map 72% reduce 24%

13/11/14 10:19:13 INFO mapreduce.Job:  map 76% reduce 24%

13/11/14 10:19:55 INFO mapreduce.Job:  map 78% reduce 24%

13/11/14 10:20:10 INFO mapreduce.Job:  map 80% reduce 24%

13/11/14 10:20:29 INFO mapreduce.Job:  map 81% reduce 24%

13/11/14 10:21:50 INFO mapreduce.Job:  map 82% reduce 24%

13/11/14 10:22:01 INFO mapreduce.Job:  map 83% reduce 24%

13/11/14 10:22:10 INFO mapreduce.Job:  map 84% reduce 24%

13/11/14 10:22:13 INFO mapreduce.Job:  map 85% reduce 24%

13/11/14 10:22:16 INFO mapreduce.Job:  map 86% reduce 24%

13/11/14 10:22:27 INFO mapreduce.Job:  map 86% reduce 28%

13/11/14 10:22:30 INFO mapreduce.Job:  map 86% reduce 29%

13/11/14 10:28:30 INFO mapreduce.Job:  map 88% reduce 29%

13/11/14 10:28:35 INFO mapreduce.Job:  map 90% reduce 29%

13/11/14 10:28:37 INFO mapreduce.Job:  map 97% reduce 29%

13/11/14 10:28:43 INFO mapreduce.Job:  map 98% reduce 29%

13/11/14 10:28:45 INFO mapreduce.Job:  map 99% reduce 29%

13/11/14 10:28:48 INFO mapreduce.Job:  map 100% reduce 29%

13/11/14 10:28:55 INFO mapreduce.Job:  map 100% reduce 33%

13/11/14 10:29:06 INFO mapreduce.Job:  map 100% reduce 67%

13/11/14 10:29:27 INFO mapreduce.Job:  map 100% reduce 100%

13/11/14 10:29:33 INFO mapreduce.Job: Job job_1384339616944_0002 completed
successfully

13/11/14 10:29:38 INFO mapred.ClientServiceDelegate: Application state is
completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history
server

13/11/14 10:29:55 INFO mapred.ClientServiceDelegate: Application state is
completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history
server

13/11/14 10:29:56 INFO mapred.ClientServiceDelegate: Application state is
completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history
server

13/11/14 10:29:56 ERROR security.UserGroupInformation:
PriviledgedActionException as:prrekapaee9f (auth:SIMPLE)
cause:java.io.IOException:
org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException):
java.lang.NullPointerException

      at
org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getCounters(HistoryClientService.java:220)

      at
org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getCounters(MRClientProtocolPBServiceImpl.java:159)

      at
org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:281)

      at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)

      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)

      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2048)