|
|
hadoopman 2011-04-26, 00:29
Has anyone had problems with the latest version of hadoop and the fair scheduler not placing jobs into pools correctly? We're digging into it currently. An older version of hadoop (using our config file) is working fine however the latest version seems to be putting everything into the default pool.
Thoughts on where we can look?
Thanks!
-
Re: fair scheduler issue
Saurabh bhutyani 2011-04-26, 12:52
Which version of hadoop are you referring to?
Thanks & Regards, Saurabh Bhutyani
Call : 9820083104 Gtalk: [EMAIL PROTECTED]
On Tue, Apr 26, 2011 at 5:59 AM, hadoopman <[EMAIL PROTECTED]> wrote:
> Has anyone had problems with the latest version of hadoop and the fair > scheduler not placing jobs into pools correctly? We're digging into it > currently. An older version of hadoop (using our config file) is working > fine however the latest version seems to be putting everything into the > default pool. > > Thoughts on where we can look? > > Thanks! > >
-
Re: fair scheduler issue
James Seigel 2011-04-26, 13:15
I know cloudera has a bug in their version. They should have filed a Jira for it.
Are you getting NPE in the logs?
James
Sent from my mobile. Please excuse the typos.
On 2011-04-26, at 6:53 AM, Saurabh bhutyani <[EMAIL PROTECTED]> wrote:
> Which version of hadoop are you referring to? > > Thanks & Regards, > Saurabh Bhutyani > > Call : 9820083104 > Gtalk: [EMAIL PROTECTED] > > > > On Tue, Apr 26, 2011 at 5:59 AM, hadoopman <[EMAIL PROTECTED]> wrote: > >> Has anyone had problems with the latest version of hadoop and the fair >> scheduler not placing jobs into pools correctly? We're digging into it >> currently. An older version of hadoop (using our config file) is working >> fine however the latest version seems to be putting everything into the >> default pool. >> >> Thoughts on where we can look? >> >> Thanks! >> >>
-
Re: fair scheduler issue
hadoopman 2011-04-26, 17:40
Here is the version we're currently running. Pulled from the mapred admin page:
Version: 0.20.3-CDH3-SNAPSHOT, r${cloudera.hash}
Compiled: Fri Dec 10 13:33:50 PST 2010 by hadoop
Thanks! On 04/26/2011 06:52 AM, Saurabh bhutyani wrote: > Which version of hadoop are you referring to? > > Thanks& Regards, > Saurabh Bhutyani > > Call : 9820083104 > Gtalk: [EMAIL PROTECTED] > > > > On Tue, Apr 26, 2011 at 5:59 AM, hadoopman<[EMAIL PROTECTED]> wrote: > > >> Has anyone had problems with the latest version of hadoop and the fair >> scheduler not placing jobs into pools correctly? We're digging into it >> currently. An older version of hadoop (using our config file) is working >> fine however the latest version seems to be putting everything into the >> default pool. >> >> Thoughts on where we can look? >> >> Thanks! >> >> >> >
-
Re: fair scheduler issue
hadoopman 2011-04-26, 17:41
Still digging through it all and playing with multiple versions of Hadoop (both the Apache and Cloudera flavors). Looks like it's a recent bug in Cloudera from what we're seeing...
Thanks! On 04/26/2011 07:15 AM, James Seigel wrote: > I know cloudera has a bug in their version. They should have filed a > Jira for it. > > Are you getting NPE in the logs? > > James > > Sent from my mobile. Please excuse the typos. > > On 2011-04-26, at 6:53 AM, Saurabh bhutyani<[EMAIL PROTECTED]> wrote: > > >> Which version of hadoop are you referring to? >> >> Thanks& Regards, >> Saurabh Bhutyani >> >> Call : 9820083104 >> Gtalk: [EMAIL PROTECTED] >> >> >> >> On Tue, Apr 26, 2011 at 5:59 AM, hadoopman<[EMAIL PROTECTED]> wrote: >> >> >>> Has anyone had problems with the latest version of hadoop and the fair >>> scheduler not placing jobs into pools correctly? We're digging into it >>> currently. An older version of hadoop (using our config file) is working >>> fine however the latest version seems to be putting everything into the >>> default pool. >>> >>> Thoughts on where we can look? >>> >>> Thanks! >>> >>> >>> >
|
|