Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - copy data inter-cluster with different version of Hadoop


Copy link to this message
-
Re: copy data inter-cluster with different version of Hadoop
Shahab Yunus 2013-10-28, 19:44
Sorry, last email was accidentally sent before I can finish it.

Take a look at using webHDFS protocol to use distcp between clusters with
different versions:
http://books.google.com/books?id=Wu_xeGdU4G8C&pg=PA76&lpg=PA76&dq=distcp+webhdfs+different+versions&source=bl&ots=i7BOYEXaYp&sig=R8TJ6QmLG8QUhkSHxiNOhEdOlhc&hl=en&sa=X&ei=Mb5uUtnwFcL72QWQuIHwAg&ved=0CE8Q6AEwBA#v=onepage&q=distcp%20webhdfs%20different%20versions&f=false

http://hadoop.apache.org/docs/r1.0.4/webhdfs.html

Also, please note that this is not a HBase question and should be sent to
Hadoop mailing list. Thanks.

Regards,
Shahab
On Mon, Oct 28, 2013 at 3:14 PM, S. Zhou <[EMAIL PROTECTED]> wrote:

> I need to copy data from Hadoop cluster A to cluster B. I know I can use
> "distCp" tool to do that. Now the problem is: cluster A has version 1.2.1
> and cluster B has version 0.20.x.  So "distcp" tool from either version
> does not work  on both versions. Is there a possible way to do that? So far
> I copy data from cluster A to local and upload to cluster B.
>
> Thanks
> Senqiang
>