Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Problems adding JARs to distributed classpath in Hadoop 0.20.2

Copy link to this message
Re: Problems adding JARs to distributed classpath in Hadoop 0.20.2
Alejandro Abdelnur 2011-05-31, 19:02
What is exactly that does not work?

Oozie uses DistributeCache as the only mechanism to set classpaths to jobs
and it works fine.



On Mon, May 30, 2011 at 10:22 AM, John Armstrong <[EMAIL PROTECTED]>wrote:

> On Mon, 30 May 2011 09:43:14 -0700, Alejandro Abdelnur <[EMAIL PROTECTED]>
> wrote:
> > If you still want to start your MR job from your Java action, then your
> > Java
> > action should do all the setup the MapReduceMain class does before
> starting
> > the MR job (this will ensure delegation tokens and distributed cache is
> > avail to your MR job).
> Yes, my Java action is doing the setup work.  In particular, it calls
> DistrributedCache.addfileToClassPath(), which (according to the
> documentation) should be the same as passing it in at the command line with
> -libjars, right?  And yet it doesn't seem to work.
> Is this the same as the JIRA issue MAPREDUCE-752?  And if so, does this
> mean that there is no solution (other than a workaround like passing a fat
> JAR) that doesn't involve patching the Hadoop code itself (which I'd have
> to get our client to agree to)?