|
AnExplorer
2012-06-12, 09:48
Ramkrishna.S.Vasudevan
2012-06-12, 09:55
AnExplorer
2012-06-12, 11:34
Ramkrishna.S.Vasudevan
2012-06-12, 11:48
Doug Meil
2012-06-12, 12:33
Christian Schäfer
2012-06-12, 15:01
AnExplorer
2012-06-13, 05:10
AnExplorer
2012-06-13, 05:17
|
-
one HRegionServer means one DataNode?AnExplorer 2012-06-12, 09:48
Hi..I am new to Hbase. Can anyone please suggest that one HRegionServer means one DataNode? Can there be multiple data nodes in one HRegionServer??:confused: -- View this message in context: http://old.nabble.com/one-HRegionServer-means-one-DataNode--tp33998720p33998720.html Sent from the HBase User mailing list archive at Nabble.com.
-
RE: one HRegionServer means one DataNode?Ramkrishna.S.Vasudevan 2012-06-12, 09:55
Hi
Region Server is not DataNode. DataNodes are part of HDFS. RegionServers are part of HBase. HBase uses HDFS to store data and in the process of storing data DataNodes are used by HDFS. DataNodes are the actual machines where the data resides. Regards Ram > -----Original Message----- > From: AnExplorer [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, June 12, 2012 3:18 PM > To: [EMAIL PROTECTED] > Subject: one HRegionServer means one DataNode? > > > Hi..I am new to Hbase. Can anyone please suggest that one HRegionServer > means > one DataNode? Can there be multiple data nodes in one > HRegionServer??:confused: > -- > View this message in context: http://old.nabble.com/one-HRegionServer- > means-one-DataNode--tp33998720p33998720.html > Sent from the HBase User mailing list archive at Nabble.com.
-
RE: one HRegionServer means one DataNode?AnExplorer 2012-06-12, 11:34
Thanks for the response Ram!! It is pretty much clear to me now that RegionServers are part of HBase and Datanodes are part of HDFS. Actually I have a query - I had setup a hadoop cluster with one master and 3 slaves. Are these three slaves called RegionServer? And if yes How many data nodes are there now with me..I guess its 3.plz correct me if I am wrong. thx.. Ramkrishna.S.Vasudevan wrote: > > Hi > > Region Server is not DataNode. > > DataNodes are part of HDFS. RegionServers are part of HBase. HBase uses > HDFS to store data and in the process of storing data DataNodes are used > by > HDFS. DataNodes are the actual machines where the data resides. > > Regards > Ram > > >> -----Original Message----- >> From: AnExplorer [mailto:[EMAIL PROTECTED]] >> Sent: Tuesday, June 12, 2012 3:18 PM >> To: [EMAIL PROTECTED] >> Subject: one HRegionServer means one DataNode? >> >> >> Hi..I am new to Hbase. Can anyone please suggest that one HRegionServer >> means >> one DataNode? Can there be multiple data nodes in one >> HRegionServer??:confused: >> -- >> View this message in context: http://old.nabble.com/one-HRegionServer- >> means-one-DataNode--tp33998720p33998720.html >> Sent from the HBase User mailing list archive at Nabble.com. > > > -- View this message in context: http://old.nabble.com/one-HRegionServer-means-one-DataNode--tp33998720p33999181.html Sent from the HBase User mailing list archive at Nabble.com.
-
RE: one HRegionServer means one DataNode?Ramkrishna.S.Vasudevan 2012-06-12, 11:48
See response inline.
> -----Original Message----- > From: AnExplorer [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, June 12, 2012 5:05 PM > To: [EMAIL PROTECTED] > Subject: RE: one HRegionServer means one DataNode? > > > Thanks for the response Ram!! It is pretty much clear to me now that > RegionServers are part of HBase and Datanodes are part of HDFS. > Actually I > have a query - I had setup a hadoop cluster with one master and 3 > slaves. [Ram] Hadoop Cluster -> What are the process that you are running as part of this? [Ram] In HDFS you have Namenode and datanodes. Here Namenode is like a master and Datanodes do the work of serving data. [Ram] In Hbase case, you have 2 things HMaster and HRegionServer. [Ram] So if your hadoop cluster starts 3 datanodes then you have 3 datanodes in your cluster. [Ram] There can be even one RegionServer alone but the data from them can reside in all three Datanodes. Regards Ram > > > > Ramkrishna.S.Vasudevan wrote: > > > > Hi > > > > Region Server is not DataNode. > > > > DataNodes are part of HDFS. RegionServers are part of HBase. HBase > uses > > HDFS to store data and in the process of storing data DataNodes are > used > > by > > HDFS. DataNodes are the actual machines where the data resides. > > > > Regards > > Ram > > > > > >> -----Original Message----- > >> From: AnExplorer [mailto:[EMAIL PROTECTED]] > >> Sent: Tuesday, June 12, 2012 3:18 PM > >> To: [EMAIL PROTECTED] > >> Subject: one HRegionServer means one DataNode? > >> > >> > >> Hi..I am new to Hbase. Can anyone please suggest that one > HRegionServer > >> means > >> one DataNode? Can there be multiple data nodes in one > >> HRegionServer??:confused: > >> -- > >> View this message in context: http://old.nabble.com/one- > HRegionServer- > >> means-one-DataNode--tp33998720p33998720.html > >> Sent from the HBase User mailing list archive at Nabble.com. > > > > > > > > -- > View this message in context: http://old.nabble.com/one-HRegionServer- > means-one-DataNode--tp33998720p33999181.html > Sent from the HBase User mailing list archive at Nabble.com.
-
Re: one HRegionServer means one DataNode?Doug Meil 2012-06-12, 12:33
Hi there- You probably should at least read this part of the RefGuide for an introŠ http://hbase.apache.org/book.html#architecture Š welcome to HBase! On 6/12/12 5:48 AM, "AnExplorer" <[EMAIL PROTECTED]> wrote: > >Hi..I am new to Hbase. Can anyone please suggest that one HRegionServer >means >one DataNode? Can there be multiple data nodes in one >HRegionServer??:confused: >-- >View this message in context: >http://old.nabble.com/one-HRegionServer-means-one-DataNode--tp33998720p339 >98720.html >Sent from the HBase User mailing list archive at Nabble.com.
-
Re: one HRegionServer means one DataNode?Christian Schäfer 2012-06-12, 15:01
As one picture could give more than thousand words...check out the first figure on http://www.larsgeorge.com/search?q=HBase+Architecture It's the best figure I know to understand how Hadoop(here HDFS) and HBase are related to each other. ________________________________ Von: AnExplorer <[EMAIL PROTECTED]> An: [EMAIL PROTECTED] Gesendet: 13:34 Dienstag, 12.Juni 2012 Betreff: RE: one HRegionServer means one DataNode? Thanks for the response Ram!! It is pretty much clear to me now that RegionServers are part of HBase and Datanodes are part of HDFS. Actually I have a query - I had setup a hadoop cluster with one master and 3 slaves. Are these three slaves called RegionServer? And if yes How many data nodes are there now with me..I guess its 3.plz correct me if I am wrong. thx.. Ramkrishna.S.Vasudevan wrote: > > Hi > > Region Server is not DataNode. > > DataNodes are part of HDFS. RegionServers are part of HBase. HBase uses > HDFS to store data and in the process of storing data DataNodes are used > by > HDFS. DataNodes are the actual machines where the data resides. > > Regards > Ram > > >> -----Original Message----- >> From: AnExplorer [mailto:[EMAIL PROTECTED]] >> Sent: Tuesday, June 12, 2012 3:18 PM >> To: [EMAIL PROTECTED] >> Subject: one HRegionServer means one DataNode? >> >> >> Hi..I am new to Hbase. Can anyone please suggest that one HRegionServer >> means >> one DataNode? Can there be multiple data nodes in one >> HRegionServer??:confused: >> -- >> View this message in context: http://old.nabble.com/one-HRegionServer- >> means-one-DataNode--tp33998720p33998720.html >> Sent from the HBase User mailing list archive at Nabble.com. > > > -- View this message in context: http://old.nabble.com/one-HRegionServer-means-one-DataNode--tp33998720p33999181.html Sent from the HBase User mailing list archive at Nabble.com.
-
RE: one HRegionServer means one DataNode?AnExplorer 2012-06-13, 05:10
Thanks Ram!! So, there are 3 datanodes in the cluster. Is there any way to find out that whether these datanodes are served by one RegionServer or more? where can we see that? Thanks again.. Ramkrishna.S.Vasudevan wrote: > > See response inline. > >> -----Original Message----- >> From: AnExplorer [mailto:[EMAIL PROTECTED]] >> Sent: Tuesday, June 12, 2012 5:05 PM >> To: [EMAIL PROTECTED] >> Subject: RE: one HRegionServer means one DataNode? >> >> >> Thanks for the response Ram!! It is pretty much clear to me now that >> RegionServers are part of HBase and Datanodes are part of HDFS. >> Actually I >> have a query - I had setup a hadoop cluster with one master and 3 >> slaves. > [Ram] Hadoop Cluster -> What are the process that you are running as part > of > this? > [Ram] In HDFS you have Namenode and datanodes. Here Namenode is like a > master and Datanodes do the work of serving data. > [Ram] In Hbase case, you have 2 things HMaster and HRegionServer. > > [Ram] So if your hadoop cluster starts 3 datanodes then you have 3 > datanodes > in your cluster. > [Ram] There can be even one RegionServer alone but the data from them can > reside in all three Datanodes. > Regards > Ram > >> >> >> >> Ramkrishna.S.Vasudevan wrote: >> > >> > Hi >> > >> > Region Server is not DataNode. >> > >> > DataNodes are part of HDFS. RegionServers are part of HBase. HBase >> uses >> > HDFS to store data and in the process of storing data DataNodes are >> used >> > by >> > HDFS. DataNodes are the actual machines where the data resides. >> > >> > Regards >> > Ram >> > >> > >> >> -----Original Message----- >> >> From: AnExplorer [mailto:[EMAIL PROTECTED]] >> >> Sent: Tuesday, June 12, 2012 3:18 PM >> >> To: [EMAIL PROTECTED] >> >> Subject: one HRegionServer means one DataNode? >> >> >> >> >> >> Hi..I am new to Hbase. Can anyone please suggest that one >> HRegionServer >> >> means >> >> one DataNode? Can there be multiple data nodes in one >> >> HRegionServer??:confused: >> >> -- >> >> View this message in context: http://old.nabble.com/one- >> HRegionServer- >> >> means-one-DataNode--tp33998720p33998720.html >> >> Sent from the HBase User mailing list archive at Nabble.com. >> > >> > >> > >> >> -- >> View this message in context: http://old.nabble.com/one-HRegionServer- >> means-one-DataNode--tp33998720p33999181.html >> Sent from the HBase User mailing list archive at Nabble.com. > > > -- View this message in context: http://old.nabble.com/one-HRegionServer-means-one-DataNode--tp33998720p34003653.html Sent from the HBase User mailing list archive at Nabble.com.
-
Re: one HRegionServer means one DataNode?AnExplorer 2012-06-13, 05:17
Thanks Doug. I have gone through this and theoretically kind of understood it. But after setting up the cluster, I was not able to make out that where is RegionServer and where I can find that. Would really seek help in future from you guys.Thanks a lot!! Doug Meil-2 wrote: > > > Hi there- > > You probably should at least read this part of the RefGuide for an introŠ > > http://hbase.apache.org/book.html#architecture > > Š welcome to HBase! > > > > > On 6/12/12 5:48 AM, "AnExplorer" <[EMAIL PROTECTED]> wrote: > >> >>Hi..I am new to Hbase. Can anyone please suggest that one HRegionServer >>means >>one DataNode? Can there be multiple data nodes in one >>HRegionServer??:confused: >>-- >>View this message in context: >>http://old.nabble.com/one-HRegionServer-means-one-DataNode--tp33998720p339 >>98720.html >>Sent from the HBase User mailing list archive at Nabble.com. > > > > -- View this message in context: http://old.nabble.com/one-HRegionServer-means-one-DataNode--tp33998720p34003667.html Sent from the HBase User mailing list archive at Nabble.com. |