Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Problem with RPC encryption over wire


Copy link to this message
-
Re: Problem with RPC encryption over wire
Thank for the response.

I have removed rpc.protection parameter in all of my configuration and now
I am getting an error as below:-

Any Hint on whats going on here

13/11/14 10:10:47 INFO mapreduce.Job: Task Id :
attempt_1384339616944_0002_m_000026_0, Status : FAILED

Container launch failed for container_1384339616944_0002_01_000029 :
java.net.SocketTimeoutException: Call From U1204D32/40.221.95.97 to
U1204D32.blr.in.as.airbus.corp:45003 failed on socket timeout exception:
java.net.SocketTimeoutException: 60000 millis timeout while waiting for
channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected
local=/40.221.95.97:48268remote=U1204D32.blr.in.as.airbus.corp/
40.221.95.97:45003]; For more details see:
http://wiki.apache.org/hadoop/SocketTimeout

      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

      at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

      at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

      at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

      at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)

      at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:749)

      at org.apache.hadoop.ipc.Client.call(Client.java:1351)

      at org.apache.hadoop.ipc.Client.call(Client.java:1300)

      at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)

      at com.sun.proxy.$Proxy30.startContainers(Unknown Source)

      at
org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainers(ContainerManagementProtocolPBClientImpl.java:96)

      at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:151)

      at
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)

      at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

      at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

      at java.lang.Thread.run(Thread.java:744)

Caused by: java.net.SocketTimeoutException: 60000 millis timeout while
waiting for channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected
local=/40.221.95.97:48268remote=U1204D32.blr.in.as.airbus.corp/
40.221.95.97:45003]

      at
org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)

      at
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)

      at
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)

      at java.io.FilterInputStream.read(FilterInputStream.java:133)

      at java.io.FilterInputStream.read(FilterInputStream.java:133)

      at
org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:457)

      at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)

      at java.io.BufferedInputStream.read(BufferedInputStream.java:254)

      at java.io.DataInputStream.readInt(DataInputStream.java:387)

      at
org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:995)

      at org.apache.hadoop.ipc.Client$Connection.run(Client.java:891)

13/11/14 10:10:50 INFO mapreduce.Job:  map 72% reduce 24%

13/11/14 10:19:13 INFO mapreduce.Job:  map 76% reduce 24%

13/11/14 10:19:55 INFO mapreduce.Job:  map 78% reduce 24%

13/11/14 10:20:10 INFO mapreduce.Job:  map 80% reduce 24%

13/11/14 10:20:29 INFO mapreduce.Job:  map 81% reduce 24%

13/11/14 10:21:50 INFO mapreduce.Job:  map 82% reduce 24%

13/11/14 10:22:01 INFO mapreduce.Job:  map 83% reduce 24%

13/11/14 10:22:10 INFO mapreduce.Job:  map 84% reduce 24%

13/11/14 10:22:13 INFO mapreduce.Job:  map 85% reduce 24%

13/11/14 10:22:16 INFO mapreduce.Job:  map 86% reduce 24%

13/11/14 10:22:27 INFO mapreduce.Job:  map 86% reduce 28%

13/11/14 10:22:30 INFO mapreduce.Job:  map 86% reduce 29%

13/11/14 10:28:30 INFO mapreduce.Job:  map 88% reduce 29%

13/11/14 10:28:35 INFO mapreduce.Job:  map 90% reduce 29%

13/11/14 10:28:37 INFO mapreduce.Job:  map 97% reduce 29%

13/11/14 10:28:43 INFO mapreduce.Job:  map 98% reduce 29%

13/11/14 10:28:45 INFO mapreduce.Job:  map 99% reduce 29%

13/11/14 10:28:48 INFO mapreduce.Job:  map 100% reduce 29%

13/11/14 10:28:55 INFO mapreduce.Job:  map 100% reduce 33%

13/11/14 10:29:06 INFO mapreduce.Job:  map 100% reduce 67%

13/11/14 10:29:27 INFO mapreduce.Job:  map 100% reduce 100%

13/11/14 10:29:33 INFO mapreduce.Job: Job job_1384339616944_0002 completed
successfully

13/11/14 10:29:38 INFO mapred.ClientServiceDelegate: Application state is
completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history
server

13/11/14 10:29:55 INFO mapred.ClientServiceDelegate: Application state is
completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history
server

13/11/14 10:29:56 INFO mapred.ClientServiceDelegate: Application state is
completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history
server

13/11/14 10:29:56 ERROR security.UserGroupInformation:
PriviledgedActionException as:prrekapaee9f (auth:SIMPLE)
cause:java.io.IOException:
org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException):
java.lang.NullPointerException

      at
org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getCounters(HistoryClientService.java:220)

      at
org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getCounters(MRClientProtocolPBServiceImpl.java:159)

      at
org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:281)

      at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)

      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)

      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2048)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB