|
|
-
jobtracker url(Critical)
hadoop hive 2012-01-27, 11:17
Hey folks,
i m facing a problem, with job Tracker URL, actually i added a node to the cluster and after sometime i restart the cluster, then i found that my job tracker is showing recent added node in *nodes * but rest of nodes are not available not even in *blacklist. * * * can any1 have any idea why its happening. Thanks and regards Vikas Srivastava
-
Re: jobtracker url(Critical)
Harsh J 2012-01-27, 11:35
Vikas,
Have you ensured your non-appearing tasktracker services are started/alive and carry no communication errors in their logs? Did you perhaps bring up a firewall accidentally, that was not present before?
On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <[EMAIL PROTECTED]> wrote: > Hey folks, > > i m facing a problem, with job Tracker URL, actually i added a node to the > cluster and after sometime i restart the cluster, then i found that my job > tracker is showing recent added node in *nodes * but rest of nodes are not > available not even in *blacklist. * > * > * > can any1 have any idea why its happening. > > > Thanks and regards > Vikas Srivastava
-- Harsh J Customer Ops. Engineer, Cloudera
-
Re: jobtracker url(Critical)
hadoop hive 2012-01-27, 12:20
Hey Harsh,
but after sumtym they are available 1 by 1 in jobtracker URL.
any idea how they add up slowly slowly.
regards Vikas
On Fri, Jan 27, 2012 at 5:05 PM, Harsh J <[EMAIL PROTECTED]> wrote:
> Vikas, > > Have you ensured your non-appearing tasktracker services are > started/alive and carry no communication errors in their logs? Did you > perhaps bring up a firewall accidentally, that was not present before? > > On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <[EMAIL PROTECTED]> wrote: > > Hey folks, > > > > i m facing a problem, with job Tracker URL, actually i added a node to > the > > cluster and after sometime i restart the cluster, then i found that my > job > > tracker is showing recent added node in *nodes * but rest of nodes are > not > > available not even in *blacklist. * > > * > > * > > can any1 have any idea why its happening. > > > > > > Thanks and regards > > Vikas Srivastava > > > > -- > Harsh J > Customer Ops. Engineer, Cloudera >
-
Re: jobtracker url(Critical)
Edward Capriolo 2012-01-27, 13:06
Task tracker sometimes so not clean up their mapred temp directories well if that is the case the tt on startup can spent many minutes deleting files. I use find to delete files older then a couple of days.
On Friday, January 27, 2012, hadoop hive <[EMAIL PROTECTED]> wrote: > Hey Harsh, > > but after sumtym they are available 1 by 1 in jobtracker URL. > > any idea how they add up slowly slowly. > > regards > Vikas > > On Fri, Jan 27, 2012 at 5:05 PM, Harsh J <[EMAIL PROTECTED]> wrote: > >> Vikas, >> >> Have you ensured your non-appearing tasktracker services are >> started/alive and carry no communication errors in their logs? Did you >> perhaps bring up a firewall accidentally, that was not present before? >> >> On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <[EMAIL PROTECTED]> wrote: >> > Hey folks, >> > >> > i m facing a problem, with job Tracker URL, actually i added a node to >> the >> > cluster and after sometime i restart the cluster, then i found that my >> job >> > tracker is showing recent added node in *nodes * but rest of nodes are >> not >> > available not even in *blacklist. * >> > * >> > * >> > can any1 have any idea why its happening. >> > >> > >> > Thanks and regards >> > Vikas Srivastava >> >> >> >> -- >> Harsh J >> Customer Ops. Engineer, Cloudera >> >
-
Re: jobtracker url(Critical)
hadoop hive 2012-01-30, 07:15
Thanks Edward I'll do that.
On Fri, Jan 27, 2012 at 6:36 PM, Edward Capriolo <[EMAIL PROTECTED]>wrote:
> Task tracker sometimes so not clean up their mapred temp directories well > if that is the case the tt on startup can spent many minutes deleting > files. I use find to delete files older then a couple of days. > > On Friday, January 27, 2012, hadoop hive <[EMAIL PROTECTED]> wrote: > > Hey Harsh, > > > > but after sumtym they are available 1 by 1 in jobtracker URL. > > > > any idea how they add up slowly slowly. > > > > regards > > Vikas > > > > On Fri, Jan 27, 2012 at 5:05 PM, Harsh J <[EMAIL PROTECTED]> wrote: > > > >> Vikas, > >> > >> Have you ensured your non-appearing tasktracker services are > >> started/alive and carry no communication errors in their logs? Did you > >> perhaps bring up a firewall accidentally, that was not present before? > >> > >> On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <[EMAIL PROTECTED]> > wrote: > >> > Hey folks, > >> > > >> > i m facing a problem, with job Tracker URL, actually i added a node > to > >> the > >> > cluster and after sometime i restart the cluster, then i found that > my > >> job > >> > tracker is showing recent added node in *nodes * but rest of nodes > are > >> not > >> > available not even in *blacklist. * > >> > * > >> > * > >> > can any1 have any idea why its happening. > >> > > >> > > >> > Thanks and regards > >> > Vikas Srivastava > >> > >> > >> > >> -- > >> Harsh J > >> Customer Ops. Engineer, Cloudera > >> > > >
|
|