Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> DistCP : Is it gauranteed to work for any two uri schemes?


Copy link to this message
-
DistCP : Is it gauranteed to work for any two uri schemes?
Hi folks:

I've been thinking about the AWS S3DistCP class and am wondering : is
distcp built to work between any two hadoop file system classes ?

Or is it implicitly built mainly to work to copy between to HDFS file
sytems.

I've havent found many examples online with different URI schemes.

With emerging HDFS alternatives, I'd be interested in ways to otimize IO
between different filesystems using distcp.

Jay Vyas
http://jayunit100.blogspot.com

 
+
Harsh J 2014-02-04, 13:34
+
java8964 2014-02-04, 14:14
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB