Is there a way in the MapReduce API or Scheduler to have a job reschedule or
repeat itself?  I have job that needs to continually run but I don't see a
way to make a job run infinitely.

Thanks,

Jesse

Hi,

One way is to trigger a parent job that just reports a status every n minutes < within the timeout threshold, and to trigger the required job that does the work from inside that, on need basis. One downside is that you would be wasting a processing slot but this should not bother much.
 
Thanks
Sudharsan S

-----Original Message-----
From: Jesse Anderson [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 02, 2011 9:30 AM
To: [EMAIL PROTECTED]
Subject: Automatic (Re)Scheduling

Is there a way in the MapReduce API or Scheduler to have a job reschedule or repeat itself?  I have job that needs to continually run but I don't see a way to make a job run infinitely.

Thanks,

Jesse

Hi Jesse,

Take a look at Oozie Coordinator functionality (
https://github.com/yahoo/oozie).

Alejandro

On Wed, Jun 1, 2011 at 9:00 PM, Jesse Anderson <[EMAIL PROTECTED]> wrote:

> Is there a way in the MapReduce API or Scheduler to have a job reschedule
> or
> repeat itself?  I have job that needs to continually run but I don't see a
> way to make a job run infinitely.
>
> Thanks,
>
> Jesse
>

Alejandro,

Yes, that is exactly what I am looking for.  I forgot to mention that I will
be using Amazon EC2 for this project and it doesn't look like Oozie will
work on EC2.

Thanks,

Jesse

On Thu, Jun 2, 2011 at 10:19 AM, Alejandro Abdelnur <[EMAIL PROTECTED]>wrote:

> Hi Jesse,
>
> Take a look at Oozie Coordinator functionality (
> https://github.com/yahoo/oozie).
>
> Alejandro
>
> On Wed, Jun 1, 2011 at 9:00 PM, Jesse Anderson <[EMAIL PROTECTED]> wrote:
>
> > Is there a way in the MapReduce API or Scheduler to have a job reschedule
> > or
> > repeat itself?  I have job that needs to continually run but I don't see
> a
> > way to make a job run infinitely.
> >
> > Thanks,
> >
> > Jesse
> >
>

There are folks using Oozie in EC2, please shoot an email to the
[EMAIL PROTECTED]

Thanks.

Alejandro

On Thu, Jun 2, 2011 at 2:21 PM, Jesse Anderson <[EMAIL PROTECTED]> wrote:

> Alejandro,
>
> Yes, that is exactly what I am looking for.  I forgot to mention that I
> will
> be using Amazon EC2 for this project and it doesn't look like Oozie will
> work on EC2.
>
> Thanks,
>
> Jesse
>
> On Thu, Jun 2, 2011 at 10:19 AM, Alejandro Abdelnur <[EMAIL PROTECTED]
> >wrote:
>
> > Hi Jesse,
> >
> > Take a look at Oozie Coordinator functionality (
> > https://github.com/yahoo/oozie).
> >
> > Alejandro
> >
> > On Wed, Jun 1, 2011 at 9:00 PM, Jesse Anderson <[EMAIL PROTECTED]>
> wrote:
> >
> > > Is there a way in the MapReduce API or Scheduler to have a job
> reschedule
> > > or
> > > repeat itself?  I have job that needs to continually run but I don't
> see
> > a
> > > way to make a job run infinitely.
> > >
> > > Thanks,
> > >
> > > Jesse
> > >
> >
>