|
|
-
Re: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch)Arun C Murthy 2013-02-26, 00:18
Pls don't cross-post, belongs only to CDH lists.
On Feb 25, 2013, at 2:24 AM, samir das mohapatra wrote: > I am using CDH4.1.2 with MRv1 not YARN. > > > On Mon, Feb 25, 2013 at 3:47 PM, samir das mohapatra <[EMAIL PROTECTED]> wrote: > yes > > > On Mon, Feb 25, 2013 at 3:30 PM, Nitin Pawar <[EMAIL PROTECTED]> wrote: > does this match with your issue > > https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/kIPOvrFaQE8 > > > On Mon, Feb 25, 2013 at 3:20 PM, samir das mohapatra <[EMAIL PROTECTED]> wrote: > > > ---------- Forwarded message ---------- > From: samir das mohapatra <[EMAIL PROTECTED]> > Date: Mon, Feb 25, 2013 at 3:05 PM > Subject: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch) > To: [EMAIL PROTECTED] > > > Hi All, > I am getting bellow error , can any one help me on the same issue, > > ERROR LOG: > ---------------------- > > hadoop@hadoophost2:~$ hadoop distcp hdfs://10.192.200.170:50070/tmp/samir.txt hdfs://10.192.244.237:50070/input > 13/02/25 01:34:36 INFO tools.DistCp: srcPaths=[hdfs://10.192.200.170:50070/tmp/samir.txt] > 13/02/25 01:34:36 INFO tools.DistCp: destPath=hdfs://10.192.244.237:50070/input > With failures, global counters are inaccurate; consider running with -i > Copy failed: java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "hadoophost2/10.192.244.237"; destination host is: "bl1slu040.corp.adobe.com":50070; > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:759) > at org.apache.hadoop.ipc.Client.call(Client.java:1164) > at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202) > at $Proxy9.getFileInfo(Unknown Source) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83) > at $Proxy9.getFileInfo(Unknown Source) > at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:628) > at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1507) > at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:783) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1257) > at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:636) > at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656) > at org.apache.hadoop.tools.DistCp.run(DistCp.java:881) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > at org.apache.hadoop.tools.DistCp.main(DistCp.java:908) > Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag. > at com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:73) > at com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124) > at com.google.protobuf.AbstractMessageLite$Builder.mergeFrom(AbstractMessageLite.java:213) > at com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:746) > at com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:238) > at com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:282) > at com.google.protobuf.AbstractMessage$Builder.mergeDelimitedFrom(AbstractMessage.java:760) > at com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:288) Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ |