Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> decommissioning node woes


+
Rita 2011-03-17, 01:36
Copy link to this message
-
Re: decommissioning node woes
Any help?
On Wed, Mar 16, 2011 at 9:36 PM, Rita <[EMAIL PROTECTED]> wrote:

> Hello,
>
> I have been struggling with decommissioning data  nodes. I have a 50+ data
> node cluster (no MR) with each server holding about 2TB of storage. I split
> the nodes into 2 racks.
>
>
> I edit the 'exclude' file and then do a -refreshNodes. I see the node
> immediate in 'Decommiosied node' and I also see it as a 'live' node!
> Eventhough I wait 24+ hours its still like this. I am suspecting its a bug
> in my version.  The data node process is still running on the node I am
> trying to decommission. So, sometimes I kill -9 the process and I see the
> 'under replicated' blocks...this can't be the normal procedure.
>
> There were even times that I had corrupt blocks because I was impatient --
> waited 24-34 hours
>
> I am using 23 August, 2010: release 0.21.0 <http://hadoop.apache.org/hdfs/releases.html#23+August%2C+2010%3A+release+0.21.0+available>
>  version.
>
> Is this a known bug? Is there anything else I need to do to decommission a
> node?
>
>
>
>
>
>
>
> --
> --- Get your facts first, then you can distort them as you please.--
>

--
--- Get your facts first, then you can distort them as you please.--
+
Ted Dunning 2011-03-18, 16:03
+
James Seigel 2011-03-18, 16:08
+
Ted Dunning 2011-03-18, 16:38
+
Michael Segel 2011-03-18, 16:59
+
Ted Dunning 2011-03-18, 17:34
+
James Seigel 2011-03-18, 17:39
+
Steve Loughran 2011-03-18, 17:57
+
Michael Segel 2011-03-19, 03:30
+
Ted Dunning 2011-03-19, 16:00
+
Michael Segel 2011-03-20, 02:11
+
M. C. Srivas 2011-03-20, 02:52
+
Steve Loughran 2011-03-21, 10:39
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB