|
|
-
set the mapred.map.tasks.speculative.execution=false, but it is not useful.
林育智 2012-06-12, 11:38
hi all: I set the mapred.map.tasks.speculative.execution=false,but in the userlogs,you could found 3 attempt map task's log. have i miss something? expect your help. thanks.
-
Re: set the mapred.map.tasks.speculative.execution=false, but it is not useful.
Jagat Singh 2012-06-12, 11:43
Besides Speculative execution , Tasks can be attempted multiple times due to failures.
So you can see 3 attempt there.
On Tue, Jun 12, 2012 at 5:08 PM, 林育智 <[EMAIL PROTECTED]> wrote:
> hi all: > I set the mapred.map.tasks.speculative.execution=false,but in the > userlogs,you could found 3 attempt map task's log. have i miss something? > expect your help. thanks. >
-
Re: set the mapred.map.tasks.speculative.execution=false, but it is not useful.
Bejoy KS 2012-06-12, 13:10
Hi
If your intension is controlling the number of attempts every task make, then the property to be tweaked is
mapred.map.max.attempts
The default value is 4, for no map task re attempts make it 1.
Regards Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message----- From: Jagat Singh <[EMAIL PROTECTED]> Date: Tue, 12 Jun 2012 17:13:36 To: <[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] Subject: Re: set the mapred.map.tasks.speculative.execution=false, but it is not useful.
Besides Speculative execution , Tasks can be attempted multiple times due to failures.
So you can see 3 attempt there.
On Tue, Jun 12, 2012 at 5:08 PM, 林育智 <[EMAIL PROTECTED]> wrote:
> hi all: > I set the mapred.map.tasks.speculative.execution=false,but in the > userlogs,you could found 3 attempt map task's log. have i miss something? > expect your help. thanks. >
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext