Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Re: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch)
samir das mohapatra
2013-02-25, 10:24
Copy link to this message
-
Re: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch)
Nitin Pawar 2013-02-25, 10:00
does this match with your issue

https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/kIPOvrFaQE8
On Mon, Feb 25, 2013 at 3:20 PM, samir das mohapatra <
[EMAIL PROTECTED]> wrote:

>
>
> ---------- Forwarded message ----------
> From: samir das mohapatra <[EMAIL PROTECTED]>
> Date: Mon, Feb 25, 2013 at 3:05 PM
> Subject: ISSUE IN CDH4.1.2 : transfer data between different HDFS
> clusters.(using distch)
> To: [EMAIL PROTECTED]
>
>
> Hi All,
>   I am getting bellow error , can any one help me on the same issue,
>
> ERROR LOG:
> ----------------------
>
> hadoop@hadoophost2:~$ hadoop   distcp hdfs://
> 10.192.200.170:50070/tmp/samir.txt hdfs://10.192.244.237:50070/input
> 13/02/25 01:34:36 INFO tools.DistCp: srcPaths=[hdfs://
> 10.192.200.170:50070/tmp/samir.txt]
> 13/02/25 01:34:36 INFO tools.DistCp: destPath=hdfs://
> 10.192.244.237:50070/input
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Failed on local exception:
> com.google.protobuf.InvalidProtocolBufferException: Protocol message
> end-group tag did not match expected tag.; Host Details : local host is:
> "hadoophost2/10.192.244.237"; destination host is: "
> bl1slu040.corp.adobe.com":50070;
>     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:759)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1164)
>     at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
>     at $Proxy9.getFileInfo(Unknown Source)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
>     at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
>     at $Proxy9.getFileInfo(Unknown Source)
>     at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:628)
>     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1507)
>     at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:783)
>     at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1257)
>     at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:636)
>     at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656)
>     at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>     at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
> Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol
> message end-group tag did not match expected tag.
>     at
> com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:73)
>     at
> com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124)
>     at
> com.google.protobuf.AbstractMessageLite$Builder.mergeFrom(AbstractMessageLite.java:213)
>     at
> com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:746)
>     at
> com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:238)
>     at
> com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:282)
>     at
> com.google.protobuf.AbstractMessage$Builder.mergeDelimitedFrom(AbstractMessage.java:760)
>     at
> com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:288)
>     at
> com.google.protobuf.AbstractMessage$Builder.mergeDelimitedFrom(AbstractMessage.java:752)
>     at
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:985)
Nitin Pawar
+
samir das mohapatra 2013-02-25, 10:24