Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: How to find Blacklisted Nodes via cli.


Copy link to this message
-
Re: How to find Blacklisted Nodes via cli.
Hi Harsh,

Thanks I understand, In HDFS Dead Nodes concept.
In MapReduce How to clear blacklisted nodes via command line. We are using
CM, we have frequently nodes will be blacklisted It's very hard to select
nodes and restart the mapreduce services via CM.

Please guide me command line option clear the blacklisted nodes restart
the task tracker on particular node

-Dhanasekaran.

Did I learn something today? If not, I wasted it.
On Thu, Jan 31, 2013 at 9:02 AM, Harsh J <[EMAIL PROTECTED]> wrote:

> There isn't a concept of 'blacklist' in HDFS, it exists only in
> MapReduce (MR1) and YARN.
>
> Dead Nodes (and those that have been excluded) are reported via "hdfs
> dfsadmin -report" as indicated earlier.
>
> On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
> <[EMAIL PROTECTED]> wrote:
> > Hi Hemanth,
> >
> > Thanks for spending your valuable time for me.
> >
> > This mapred job -list-blacklisted-trackers for find jobtracker level but
> I
> > want hdfs level I didn't find any command. [HDFS Blacklisted nodes]
> Please
> > guide me. And also to clear blacklisted nodes via command line
> >
> > -Dhanasekaran.
> >
> > Did I learn something today? If not, I wasted it.
> >
> >
> > On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> > <[EMAIL PROTECTED]> wrote:
> >>
> >> Hi,
> >>
> >> Part answer: you can get the blacklisted tasktrackers using the command
> >> line:
> >>
> >> mapred job -list-blacklisted-trackers.
> >>
> >> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if
> it
> >> works fine after some time. Though I am not very sure about this.
> >>
> >> Thanks
> >> hemanth
> >>
> >>
> >> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
> >> <[EMAIL PROTECTED]> wrote:
> >>>
> >>> Hi Guys,
> >>>
> >>> How to find Blacklisted Nodes via, command line. I want to see job
> >>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
> >>>
> >>> and also how to clear blacklisted nodes to clear start. The only option
> >>> to restart the service. some other way clear the Blacklisted Nodes.
> >>>
> >>> please guide me.
> >>>
> >>> -Dhanasekaran.
> >>>
> >>> Did I learn something today? If not, I wasted it.
> >>
> >>
> >
>
>
>
> --
> Harsh J
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB