Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> MapReduce APIs


Copy link to this message
-
Re: MapReduce APIs
You could use the org.apache.hadoop.filecache.DistributedCache API as:

DistributedCache.addCacheFile(URI, job.getConfiguration());

On Sat, Nov 24, 2012 at 3:06 AM, Kartashov, Andy <[EMAIL PROTECTED]> wrote:
> Guys,
>
>
>
> I know that there is old and new API for MapReduce. The old API is found
> under org.apache.hadoop.mapred and the new is under
> org.apache.hadoop.mapreduce
>
>
>
> I successfully used  both (the old and the new API) writing my MapReduce
> drivers.
>
>
>
> The problem came up when I tried to use distributed cache. My new API Job
> object could not locate
>
> public void addCacheFile(URI uri) method and I was scratching my head why.
>
>
>
> What I did not reaslise is that despite new and oold API there is also
> Hadoop 0.20 vs Hadoop 2.0.0 APIs that use exact same packages.
>
>  The old Hadoop.0.20.00 new Mapreduce API class Job simply doesn’t have that
> method “addCacheFile(URI uri)”.
>
>
>
> I am running Hadoop 2.0.0. so could not understand why the method was not
> inside the class. I ended up rewriting MR job under old API mapred package
> and ran soccessfully.
>
>
>
> Can anyone shed some light on this?
>
>
>
> Thanks
>
> AK
>
>
>
>
>
> NOTICE: This e-mail message and any attachments are confidential, subject to
> copyright and may be privileged. Any unauthorized use, copying or disclosure
> is prohibited. If you are not the intended recipient, please delete and
> contact the sender immediately. Please consider the environment before
> printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui
> l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent
> être couverts par le secret professionnel. Toute utilisation, copie ou
> divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire
> prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur.
> Veuillez penser à l'environnement avant d'imprimer le présent courriel

--
Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB