Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Tell Hadoop to store pairs of files at the same location(s) on HDFS


Copy link to this message
-
Re: Tell Hadoop to store pairs of files at the same location(s) on HDFS
Harsh J 2012-12-05, 17:58
You are probably talking of
https://issues.apache.org/jira/browse/HDFS-2576 and similar JIRAs.
This feature isn't available in HDFS yet, but may arrive soon.

On Wed, Dec 5, 2012 at 11:23 PM, Sigurd Spieckermann
<[EMAIL PROTECTED]> wrote:
> Hi guys,
>
> I have been wondering if there's a way (hack'ish would be okay too) to tell
> Hadoop that two files shall be stored together at the same location(s). It
> would benefit map-side join performance if it could be done somehow because
> all map tasks would be able to read data from a local copy. Does anyone know
> a way?
>
> -Sigurd

--
Harsh J