Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Live nodes count not incremented with the addition of new nodes


+
iwannaplay games 2012-08-23, 13:48
+
Harsh J 2012-08-23, 13:54
+
iwannaplay games 2012-08-24, 08:57
+
Mohammad Tariq 2012-08-24, 09:53
+
iwannaplay games 2012-08-24, 10:32
Copy link to this message
-
Re: Live nodes count not incremented with the addition of new nodes
what do you mean by "same storage space"??every node will have its own
disk.right??also make sure you are dding the names of newly added nodes to
your slaves file.

Regards,
    Mohammad Tariq

On Fri, Aug 24, 2012 at 4:02 PM, iwannaplay games <
[EMAIL PROTECTED]> wrote:

> I ran it
> Its not working
> It seems that as soon as another node registers ,previous node occupy
> the same storage space and removes the previous one.
>
> For all the slave nodes,i have kept the same configuration.Is there
> any change in hadoop installation
>
> Regards
> Prabhjot
> On 8/24/12, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
> > Run the balancer once and see if it works.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> >
> > On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> > [EMAIL PROTECTED]> wrote:
> >
> >> yeah installation is proper but it seems they are sharing the same
> >> storage
> >> id'
> >> Do i need to make any change in slaves configuration.I have copied the
> >> slaves image on other nodes.
> >> Check this log file:
> >> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> >> blocks
> >> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> >> processing time: 1 msecs
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node registration from
> >> 192.168.0.122:50010 storage
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> >> replaced by 192.168.0.122:50010 with the same storageID
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Removing a node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.122:50010
> >>
> >>
> >> Why with another node registration previous node is removed?
> >>
> >> Regards
> >> Prabhjot
> >>
> >> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <[EMAIL PROTECTED]> wrote:
> >> >
> >> > I'd first check if your additional nodes came up fine (check the
> >> > services' logs) and connected to the master alright.
> >> >
> >> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> >> > <[EMAIL PROTECTED]> wrote:
> >> > >
> >> > >
> >> > > Hi
> >> > >
> >> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> >> cluster.
> >> > >
> >> > > Ran these commands
> >> > > hadoop dfsadmin -refreshNodes
> >> > > hadoop mradmin -refreshNodes
> >> > >
> >> > > But still when i check through fsck or http://master:50070
> >> > > i get only 2 live nodes,one master and one slave(out of 3
> >> slaves,randomly it
> >> > > picks anyone)
> >> > >
> >> > > Can anybody tell me why its not updating the count of live nodes to
> >> > > 4.
> >> > >
> >> > > Regards
> >> > > Prabhjot
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Harsh J
> >>
> >
>
+
Harsh J 2012-08-24, 11:49