Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Tell Hadoop to store pairs of files at the same location(s) on HDFS


Copy link to this message
-
Tell Hadoop to store pairs of files at the same location(s) on HDFS
Hi guys,

I have been wondering if there's a way (hack'ish would be okay too) to tell
Hadoop that two files shall be stored together at the same location(s). It
would benefit map-side join performance if it could be done somehow because
all map tasks would be able to read data from a local copy. Does anyone
know a way?

-Sigurd