|
|
-
Sometimes no map tasks are run - X are complete and N-X are pending, none running
Saptarshi Guha 2009-04-17, 00:24
Hello, I'm using 0.19.2-dev-core (checked out from cvs and build). With 51 maps, i have a case where 50 tasks have completed and 1 is pending, about 1400 records left for this one to process. The completed map taska have written out 18GB to the HDFS. The last map task is forrever in the pending queue - is this is issue my setup/config or do others have the problem?
Thank you
Saptarshi Guha
-
Re: Sometimes no map tasks are run - X are complete and N-X are pending, none running
Sharad Agarwal 2009-04-17, 06:56
> The last map task is forrever in the pending queue - is this is issue my > setup/config or do others have the problem? Do you mean the left over maps are not at all scheduled ? What do you see in jobtracker logs ?
-
Re: Sometimes no map tasks are run - X are complete and N-X are pending, none running
Jothi Padmanabhan 2009-04-17, 07:06
On 4/17/09 12:26 PM, "Sharad Agarwal" <[EMAIL PROTECTED]> wrote:
> > >> The last map task is forrever in the pending queue - is this is issue my >> setup/config or do others have the problem? > Do you mean the left over maps are not at all scheduled ? What do you see in > jobtracker logs ?
Also in the JT UI, please check on how many maps are marked as running, when this map is still pending?
-
Re: Sometimes no map tasks are run - X are complete and N-X are pending, none running
Saptarshi Guha 2009-04-17, 16:39
I forgot to examine logs, I will next time it happens. Thank you BW, no maps are running. Only few are pending and the rest are complete. Saptarshi Guha On Fri, Apr 17, 2009 at 3:06 AM, Jothi Padmanabhan <[EMAIL PROTECTED]>wrote:
> > > On 4/17/09 12:26 PM, "Sharad Agarwal" <[EMAIL PROTECTED]> wrote: > > > > > > >> The last map task is forrever in the pending queue - is this is issue my > >> setup/config or do others have the problem? > > Do you mean the left over maps are not at all scheduled ? What do you see > in > > jobtracker logs ? > > Also in the JT UI, please check on how many maps are marked as running, > when > this map is still pending? > >
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext