Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Who creates job.jar?


Copy link to this message
-
Re: Who creates job.jar?
Steve Lewis 2010-06-25, 15:55
I have attached code for creating a Hadoop Jar - All you need to do is run
HadoopDeployer in the same environment
that your hadoop job runs as a local process (You did test your job in this
way - It jars everything in the class path except
jars you add to an excluded list because they are not needed (such as Junit)
or already in the path such as the hadoop jar.
On Fri, Jun 25, 2010 at 3:32 AM, Kiyoshi Mizumaru <
[EMAIL PROTECTED]> wrote:

> > - What do you mean by aws?
>
> It must be Amazon Web Services, I think.
>
>
> On Fri, Jun 25, 2010 at 7:22 PM, Pedro Costa <[EMAIL PROTECTED]> wrote:
> > I don't understand when you say "you" :). I've created the
> > hadoop-0.20.2-dev-core.jar and hadoop-0.20.2-dev-examples.jar and none of
> > them has the job.jar. I've also searched all hadoop directories, and none
> of
> > them have the jar.
> >
> > - When the jar is created and it's exported?
> >
> > - What do you mean by aws?
> >
> >
> > On Thu, Jun 24, 2010 at 11:52 PM, Steve Lewis <[EMAIL PROTECTED]>
> wrote:
> >>
> >> You create the jar and export it to aws before running the job. The jar
> >> should contain all of your code and in a directory called lib all
> libraries
> >> you need - I have a tool for generating jars but it is a little rough -
> >>
> >> On Thu, Jun 24, 2010 at 2:38 PM, Pedro Costa <[EMAIL PROTECTED]>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>> 1 - Hadoop MR uses a job.jar used to execute MR. But who creates and
> when
> >>> is created this job.jar?
> >>>
> >>> 2 - This job.jar is only created at run time during the execution of an
> >>> MR task?
> >>>
> >>> 3 - It's created only 1 job.jar per MR execution?
> >>>
> >>>
> >>> Thanks
> >>> --
> >>> Pedro
> >>
> >>
> >>
> >> --
> >> Steven M. Lewis PhD
> >> Institute for Systems Biology
> >> Seattle WA
> >
> >
> >
> > --
> > Pedro
> >
>

--
Steven M. Lewis PhD
Institute for Systems Biology
Seattle WA