Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> distcp question


Copy link to this message
-
Re: distcp question
Rita,

I believe, per the implementation, that webhdfs:// URIs should work
fine. Please give it a try and let us know.

On Fri, Oct 12, 2012 at 7:14 PM, Rita <[EMAIL PROTECTED]> wrote:
> I have 2 different versions of Hadoop running. I need to copy significant
> amount of data  (100tb) from one cluster to another. I know distcp is the
> way to do. On the target cluster I have webhdfs running. Would that work?
>
> The DistCp manual says, I need to use "HftpFileSystem". Is that necessary
> or will webhdfs do the task?
>
>
>
> --
> --- Get your facts first, then you can distort them as you please.--

--
Harsh J