MapReduce, mail # user - Re: Is there a way to get notificaiton when the job is failed?

Is there a way to get notificaiton when the job is failed?

WangRamon 2012-09-06, 08:32

Hi Guys Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion. CheersRamon

Re: Is there a way to get notificaiton when the job is failed?

Julien Muller 2012-09-06, 08:53

Hi,

We use oozie for this kind of notification. Not really a monitoring
tool, it is a workflow system.

http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html

Julien

2012/9/6 WangRamon <[EMAIL PROTECTED]>:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>

Re: Is there a way to get notificaiton when the job is failed?

Hemanth Yamijala 2012-09-06, 09:13

Hi,

There is a provision to get job end notifications for a mapreduce job via
an HTTP call. You have to set a parameter called job.end.notification.url
to a http address in your Job's configuration. Or if the job implements the
Tool interface it can be passed directly from command line without having
to modify the job, like so:

hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...

The URL can contain two special strings $jobId and $jobStatus which will be
replaced with the actual values for the job. Then, your web application can
implement any notification as required.

Thanks
hemanth

On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <[EMAIL PROTECTED]> wrote:

> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>

RE: Is there a way to get notificaiton when the job is failed?

WangRamon 2012-09-06, 09:25

Hi Julien It's interesting, thanks, we will have a look at it. CheersRamon
> From: [EMAIL PROTECTED]
> Date: Thu, 6 Sep 2012 10:53:53 +0200
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> To: [EMAIL PROTECTED]
>
> Hi,
>
> We use oozie for this kind of notification. Not really a monitoring
> tool, it is a workflow system.
>
> http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
>
> Julien
>
> 2012/9/6 WangRamon <[EMAIL PROTECTED]>:
> > Hi Guys
> >
> > Is there some 3rd party monitor tool that i can use to monitor the hadoop
> > cluster, especially that i can get a notification/email when there is a job
> > failed? Thanks for any suggestion.
> >
> > Cheers
> > Ramon
> >
> >

RE: Is there a way to get notificaiton when the job is failed?

WangRamon 2012-09-06, 09:26

Hi hemanth Does it support Hadoop version 1.0.0? Thanks CheersRamon
Date: Thu, 6 Sep 2012 14:43:45 +0530
Subject: Re: Is there a way to get notificaiton when the job is failed?
From: [EMAIL PROTECTED]
To: [EMAIL PROTECTED]

Hi,
There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:

hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.

Thankshemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <[EMAIL PROTECTED]> wrote:

Hi Guys

Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.

Cheers
Ramon

Re: Is there a way to get notificaiton when the job is failed?

Hemanth Yamijala 2012-09-06, 09:53

Hi,

I just tried it out on 1.0.x. It works fine.

Thanks
Hemanth

On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <[EMAIL PROTECTED]> wrote:

> Hi hemanth
>
> Does it support Hadoop version 1.0.0? Thanks
>
> Cheers
> Ramon
>
> ------------------------------
> Date: Thu, 6 Sep 2012 14:43:45 +0530
>
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
>
> Hi,
>
> There is a provision to get job end notifications for a mapreduce job via
> an HTTP call. You have to set a parameter called job.end.notification.url
> to a http address in your Job's configuration. Or if the job implements the
> Tool interface it can be passed directly from command line without having
> to modify the job, like so:
>
> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
>
> The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
>
> Thanks
> hemanth
>
> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <[EMAIL PROTECTED]> wrote:
>
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
>
>

Re: Is there a way to get notificaiton when the job is failed?

Rajiv Chittajallu 2012-09-06, 11:49

Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
(hey hemanth, welcome back..)

>________________________________
> From: Hemanth Yamijala <[EMAIL PROTECTED]>
>To: [EMAIL PROTECTED]
>Sent: Thursday, September 6, 2012 2:53 AM
>Subject: Re: Is there a way to get notificaiton when the job is failed?
>
>
>Hi,
>
>
>I just tried it out on 1.0.x. It works fine.
>
>
>Thanks
>Hemanth
>
>
>On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <[EMAIL PROTECTED]> wrote:
>
>Hi hemanth
>>
>>Does it support Hadoop version 1.0.0? Thanks
>>
>>Cheers
>>Ramon
>>
>>
>>
>>________________________________
>>Date: Thu, 6 Sep 2012 14:43:45 +0530
>>
>>Subject: Re: Is there a way to get notificaiton when the job is failed?
>>From: [EMAIL PROTECTED]
>>To: [EMAIL PROTECTED]
>>
>>
>>Hi,
>>
>>
>>There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>
>>
>>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>
>>
>>The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>
>>
>>Thanks
>>hemanth
>>
>>
>>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <[EMAIL PROTECTED]> wrote:
>>
>>Hi Guys
>>>
>>>Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>
>>>Cheers
>>>Ramon
>>>
>>>
>>>
>>
>
>
>

Re: Is there a way to get notificaiton when the job is failed?

Hemanth Yamijala 2012-09-06, 12:05

Hi Rajiv,

Thanks for the heads-up ....

Looking at the JIRA, the gist is that with Hadoop 1.x, a badly configured
job (like with short retry interval and/or large number of retries) that
continuously fail (like a problematic web server or app) could potentially
block notifications of other jobs. Hence, is risky to use in general.

Hope Ramon will take this into account as well, if deciding to go down this
path.

Thanks
Hemanth

On Thu, Sep 6, 2012 at 5:19 PM, Rajiv Chittajallu <[EMAIL PROTECTED]>wrote:

> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688
> Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
> >________________________________
> > From: Hemanth Yamijala <[EMAIL PROTECTED]>
> >To: [EMAIL PROTECTED]
> >Sent: Thursday, September 6, 2012 2:53 AM
> >Subject: Re: Is there a way to get notificaiton when the job is failed?
> >
> >
> >Hi,
> >
> >
> >I just tried it out on 1.0.x. It works fine.
> >
> >
> >Thanks
> >Hemanth
> >
> >
> >On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <[EMAIL PROTECTED]> wrote:
> >
> >Hi hemanth
> >>
> >>Does it support Hadoop version 1.0.0? Thanks
> >>
> >>Cheers
> >>Ramon
> >>
> >>
> >>
> >>________________________________
> >>Date: Thu, 6 Sep 2012 14:43:45 +0530
> >>
> >>Subject: Re: Is there a way to get notificaiton when the job is failed?
> >>From: [EMAIL PROTECTED]
> >>To: [EMAIL PROTECTED]
> >>
> >>
> >>Hi,
> >>
> >>
> >>There is a provision to get job end notifications for a mapreduce job
> via an HTTP call. You have to set a parameter called
> job.end.notification.url to a http address in your Job's configuration. Or
> if the job implements the Tool interface it can be passed directly from
> command line without having to modify the job, like so:
> >>
> >>
> >>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
> >>
> >>
> >>The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
> >>
> >>
> >>Thanks
> >>hemanth
> >>
> >>
> >>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <[EMAIL PROTECTED]>
> wrote:
> >>
> >>Hi Guys
> >>>
> >>>Is there some 3rd party monitor tool that i can use to monitor the
> hadoop cluster, especially that i can get a notification/email when there
> is a job failed? Thanks for any suggestion.
> >>>
> >>>Cheers
> >>>Ramon
> >>>
> >>>
> >>>
> >>
> >
> >
> >
>

Re: Is there a way to get notificaiton when the job is failed?

Vinod Kumar Vavilapalli 2012-09-06, 19:15

We can reopen it if we wish it to be fixed in 1.0.

Thanks,
+Vinod

On Sep 6, 2012, at 4:49 AM, Rajiv Chittajallu wrote:

> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
>> ________________________________
>> From: Hemanth Yamijala <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Sent: Thursday, September 6, 2012 2:53 AM
>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>
>>
>> Hi,
>>
>>
>> I just tried it out on 1.0.x. It works fine.
>>
>>
>> Thanks
>> Hemanth
>>
>>
>> On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <[EMAIL PROTECTED]> wrote:
>>
>> Hi hemanth
>>>
>>> Does it support Hadoop version 1.0.0? Thanks
>>>
>>> Cheers
>>> Ramon
>>>
>>>
>>>
>>> ________________________________
>>> Date: Thu, 6 Sep 2012 14:43:45 +0530
>>>
>>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>> From: [EMAIL PROTECTED]
>>> To: [EMAIL PROTECTED]
>>>
>>>
>>> Hi,
>>>
>>>
>>> There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>>
>>>
>>> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>>
>>>
>>> The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>>
>>>
>>> Thanks
>>> hemanth
>>>
>>>
>>> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <[EMAIL PROTECTED]> wrote:
>>>
>>> Hi Guys
>>>>
>>>> Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>>
>>>> Cheers
>>>> Ramon
>>>>
>>>>
>>>>
>>>
>>
>>
>>