Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> New Distributed Cache


Copy link to this message
-
Re: New Distributed Cache
did you try JobContext.getCacheFiles() ?
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Wed, Jul 10, 2013 at 10:15 AM, Botelho, Andrew <[EMAIL PROTECTED]>wrote:

> Hi,****
>
> ** **
>
> I am trying to store a file in the Distributed Cache during my Hadoop job.
> ****
>
> In the driver class, I tell the job to store the file in the cache with
> this code:****
>
> ** **
>
> Job job = Job.getInstance();****
>
> job.addCacheFile(new URI("file name"));****
>
> ** **
>
> That all compiles fine.  In the Mapper code, I try accessing the cached
> file with this method:****
>
> ** **
>
> Path[] localPaths = context.getLocalCacheFiles();****
>
> ** **
>
> However, I am getting warnings that this method is deprecated.****
>
> Does anyone know the newest way to access cached files in the Mapper code?
> (I am using Hadoop 2.0.5)****
>
> ** **
>
> Thanks in advance,****
>
> ** **
>
> Andrew****
>