Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch)


Copy link to this message
-
Re: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch)
Pls don't cross-post, belongs only to CDH lists.

On Feb 25, 2013, at 2:24 AM, samir das mohapatra wrote:

> I am using CDH4.1.2 with MRv1 not YARN.
>
>
> On Mon, Feb 25, 2013 at 3:47 PM, samir das mohapatra <[EMAIL PROTECTED]> wrote:
> yes
>
>
> On Mon, Feb 25, 2013 at 3:30 PM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
> does this match with your issue
>
> https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/kIPOvrFaQE8
>
>
> On Mon, Feb 25, 2013 at 3:20 PM, samir das mohapatra <[EMAIL PROTECTED]> wrote:
>
>
> ---------- Forwarded message ----------
> From: samir das mohapatra <[EMAIL PROTECTED]>
> Date: Mon, Feb 25, 2013 at 3:05 PM
> Subject: ISSUE IN CDH4.1.2 : transfer data between different HDFS clusters.(using distch)
> To: [EMAIL PROTECTED]
>
>
> Hi All,
>   I am getting bellow error , can any one help me on the same issue,
>
> ERROR LOG:
> ----------------------
>
> hadoop@hadoophost2:~$ hadoop   distcp hdfs://10.192.200.170:50070/tmp/samir.txt hdfs://10.192.244.237:50070/input
> 13/02/25 01:34:36 INFO tools.DistCp: srcPaths=[hdfs://10.192.200.170:50070/tmp/samir.txt]
> 13/02/25 01:34:36 INFO tools.DistCp: destPath=hdfs://10.192.244.237:50070/input
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "hadoophost2/10.192.244.237"; destination host is: "bl1slu040.corp.adobe.com":50070;
>     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:759)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1164)
>     at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
>     at $Proxy9.getFileInfo(Unknown Source)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
>     at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
>     at $Proxy9.getFileInfo(Unknown Source)
>     at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:628)
>     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1507)
>     at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:783)
>     at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1257)
>     at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:636)
>     at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656)
>     at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>     at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
> Caused by: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.
>     at com.google.protobuf.InvalidProtocolBufferException.invalidEndTag(InvalidProtocolBufferException.java:73)
>     at com.google.protobuf.CodedInputStream.checkLastTagWas(CodedInputStream.java:124)
>     at com.google.protobuf.AbstractMessageLite$Builder.mergeFrom(AbstractMessageLite.java:213)
>     at com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:746)
>     at com.google.protobuf.AbstractMessage$Builder.mergeFrom(AbstractMessage.java:238)
>     at com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:282)
>     at com.google.protobuf.AbstractMessage$Builder.mergeDelimitedFrom(AbstractMessage.java:760)
>     at com.google.protobuf.AbstractMessageLite$Builder.mergeDelimitedFrom(AbstractMessageLite.java:288)

Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB