Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Moving files


I want to move a file in HDFS after a job using the Java API, I'm trying
this command but I always get false (could not rename):

Path from = new
Path("hdfs://localhost/process-changes/itemtable-r-00001");
Path to = new Path("hdfs://localhost/output/itemtable-r-00001");
boolean wasCopied = from.getFileSystem(getConf()).rename(from, to);

All I want to do is copy some files from HDFS to S3 at the end of my job,
but DistCp copies a whole directory, so I think I need to move the files
around to prepare them for DistCp's directory->directory copy.
+
Mahesh Balija 2012-11-25, 12:42