Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Tell Hadoop to store pairs of files at the same location(s) on HDFS


Copy link to this message
-
Tell Hadoop to store pairs of files at the same location(s) on HDFS
Hi guys,

I have been wondering if there's a way (hack'ish would be okay too) to tell
Hadoop that two files shall be stored together at the same location(s). It
would benefit map-side join performance if it could be done somehow because
all map tasks would be able to read data from a local copy. Does anyone
know a way?

-Sigurd
+
Harsh J 2012-12-05, 17:58
+
Sigurd Spieckermann 2012-12-05, 19:26
+
M. C. Srivas 2012-12-05, 21:51