Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - Re: Confusion with Actual Number of Regions in HBase


+
Ted Yu 2013-02-20, 23:48
+
Joarder KAMAL 2013-02-20, 23:56
+
Ted Yu 2013-02-21, 00:08
Copy link to this message
-
Re: Confusion with Actual Number of Regions in HBase
Joarder KAMAL 2013-02-21, 01:39
Hi Ted,

After login into the HBase UI I found two of my region servers were dead.
Don't have any clue why. Master is still up and running for the past 4 days.
Memory is still running pretty low without any workload and two region
servers!!

--------------------------------------------------

root@hdb1-01:/home/ubuntu# jps
1064 NameNode
1578 JobTracker
10770 Jps
2481 HRegionServer
2261 HMaster
1280 DataNode
1769 TaskTracker
2197 HQuorumPeer
1480 SecondaryNameNode
--------------------------------------------------
root@hdb1-02:/home/ubuntu# jps
1492 HRegionServer
1315 TaskTracker
1137 DataNode
3290 Jps
--------------------------------------------------
root@hdb1-03:/home/ubuntu# jps
1527 HRegionServer
1171 DataNode
7475 Jps
1349 TaskTracker

--------------------------------------------------
PID found 2197, 2261 and 2481 for 'hbase'
--------------------------------------------------
root@hdb1-01:/home/ubuntu# ps axo pid,ppid,rss,vsz | grep 2197
 2197     1 52248 1938732
--------------------------------------------------
root@hdb1-01:/home/ubuntu# ps axo pid,ppid,rss,vsz | grep 2261
 2261     1 108724 2007912
--------------------------------------------------
root@hdb1-01:/home/ubuntu# ps axo pid,ppid,rss,vsz | grep 2481
 2481     1 686252 2031376
--------------------------------------------------
root@hdb1-01:/home/ubuntu# free -m
             total       used       free     shared    buffers     cached
Mem:     1652       1616         36          0         51         305

-/+ buffers/cache:       1259        393
Swap:          895          8        887
Thanks a lot again ...
Regards,
Joarder Kamal

On 21 February 2013 11:08, Ted Yu <[EMAIL PROTECTED]> wrote:

> What do you see when you use 'ps aux | grep <pid>' command ?
> A sample is shown below:
>
> USER              PID  %CPU %MEM      VSZ    RSS   TT  STAT STARTED
>  TIME COMMAND
> tyu             16468 232.2  1.4  4974136 240528 s002  R+    4:05PM
> 2:11.15
>
> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/bin/javadoc
> -J-Xmx2048m @options @packages
>
> Please give us the VSZ and RSS readings.
>
> Thanks
>
> On Wed, Feb 20, 2013 at 3:56 PM, Joarder KAMAL <[EMAIL PROTECTED]> wrote:
>
> > Sorry may be I didn't clarify the question properly.
> >
> > Q2. As per the default setting maxHeapMB size is 991, so in saturation
> > condition HBase can't use more RAM (even if it is available, for example
> > the system memory size is 4GB) than this defined size, is it right?
> >
> >
> > Many thanks again...
> >
> > On 21 February 2013 10:48, Ted Yu <[EMAIL PROTECTED]> wrote:
> >
> > > I am not familiar with monitoring tools on EC2.
> > >
> > > You can use Ganglia to monitor hadoop / HBase.
> > >
> > > Cheers
> > >
> > > On Wed, Feb 20, 2013 at 3:42 PM, Joarder KAMAL <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > Hi Ted,
> > > >
> > > > Thanks for the reply.
> > > >
> > > > Q1. Cleared now. Sorry I didn't count the -ROOT- and .META. tables
> > > > Q2. Not clear. Could explain a bit more? I am using the default
> > setting.
> > > >
> > > > Thanks again.
> > > >
> > > >
> > > > On 21 February 2013 10:36, Ted Yu <[EMAIL PROTECTED]> wrote:
> > > >
> > > > > bq. but when I click to view the table details it shows there are 5
> > > > > regions.
> > > > >
> > > > > Did you include -ROOT- and .META. tables above ?
> > > > >
> > > > > bq. as you can see the maxHeapMB size is 991
> > > > >
> > > > > Attachment is automatically stripped from your email. FYI
> > > > >
> > > > > On Wed, Feb 20, 2013 at 3:26 PM, Joarder KAMAL <[EMAIL PROTECTED]
> >
> > > > wrote:
> > > > >
> > > > > > Dear All,
> > > > > >
> > > > > > I am currently running a 3 node HBase cluster with Amazon EC2
> small
> > > > > > instance (1CPU, 1.7GB Mem). After running a simple workload (type
> > A)
> > > > > using
> > > > > > YCSB benchmarking tool, I noticed in the Web UI that the number
> of
> > > > > regions
> > > > > > in the 3 region servers are 7 but when I click to view the table
> > > > details
+
ramkrishna vasudevan 2013-02-21, 04:18
+
Joarder KAMAL 2013-02-21, 05:46
+
Joarder KAMAL 2013-02-20, 23:26