Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> Confusion with Actual Number of Regions in HBase


Copy link to this message
-
Re: Confusion with Actual Number of Regions in HBase
The two RS could have died due to GC or some connectivity issues with ZK.
 Checking the logs would help us get a clear idea.

REgards
Ram

On Thu, Feb 21, 2013 at 7:09 AM, Joarder KAMAL <[EMAIL PROTECTED]> wrote:

> Hi Ted,
>
> After login into the HBase UI I found two of my region servers were dead.
> Don't have any clue why. Master is still up and running for the past 4
> days.
> Memory is still running pretty low without any workload and two region
> servers!!
>
> --------------------------------------------------
>
> root@hdb1-01:/home/ubuntu# jps
> 1064 NameNode
> 1578 JobTracker
> 10770 Jps
> 2481 HRegionServer
> 2261 HMaster
> 1280 DataNode
> 1769 TaskTracker
> 2197 HQuorumPeer
> 1480 SecondaryNameNode
> --------------------------------------------------
> root@hdb1-02:/home/ubuntu# jps
> 1492 HRegionServer
> 1315 TaskTracker
> 1137 DataNode
> 3290 Jps
> --------------------------------------------------
> root@hdb1-03:/home/ubuntu# jps
> 1527 HRegionServer
> 1171 DataNode
> 7475 Jps
> 1349 TaskTracker
>
> --------------------------------------------------
> PID found 2197, 2261 and 2481 for 'hbase'
> --------------------------------------------------
> root@hdb1-01:/home/ubuntu# ps axo pid,ppid,rss,vsz | grep 2197
>  2197     1 52248 1938732
> --------------------------------------------------
> root@hdb1-01:/home/ubuntu# ps axo pid,ppid,rss,vsz | grep 2261
>  2261     1 108724 2007912
> --------------------------------------------------
> root@hdb1-01:/home/ubuntu# ps axo pid,ppid,rss,vsz | grep 2481
>  2481     1 686252 2031376
> --------------------------------------------------
> root@hdb1-01:/home/ubuntu# free -m
>              total       used       free     shared    buffers     cached
> Mem:     1652       1616         36          0         51         305
>
> -/+ buffers/cache:       1259        393
> Swap:          895          8        887
>
>
> Thanks a lot again ...
>
>
> Regards,
> Joarder Kamal
>
>
>
> On 21 February 2013 11:08, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > What do you see when you use 'ps aux | grep <pid>' command ?
> > A sample is shown below:
> >
> > USER              PID  %CPU %MEM      VSZ    RSS   TT  STAT STARTED
> >  TIME COMMAND
> > tyu             16468 232.2  1.4  4974136 240528 s002  R+    4:05PM
> > 2:11.15
> >
> >
> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/bin/javadoc
> > -J-Xmx2048m @options @packages
> >
> > Please give us the VSZ and RSS readings.
> >
> > Thanks
> >
> > On Wed, Feb 20, 2013 at 3:56 PM, Joarder KAMAL <[EMAIL PROTECTED]>
> wrote:
> >
> > > Sorry may be I didn't clarify the question properly.
> > >
> > > Q2. As per the default setting maxHeapMB size is 991, so in saturation
> > > condition HBase can't use more RAM (even if it is available, for
> example
> > > the system memory size is 4GB) than this defined size, is it right?
> > >
> > >
> > > Many thanks again...
> > >
> > > On 21 February 2013 10:48, Ted Yu <[EMAIL PROTECTED]> wrote:
> > >
> > > > I am not familiar with monitoring tools on EC2.
> > > >
> > > > You can use Ganglia to monitor hadoop / HBase.
> > > >
> > > > Cheers
> > > >
> > > > On Wed, Feb 20, 2013 at 3:42 PM, Joarder KAMAL <[EMAIL PROTECTED]>
> > > wrote:
> > > >
> > > > > Hi Ted,
> > > > >
> > > > > Thanks for the reply.
> > > > >
> > > > > Q1. Cleared now. Sorry I didn't count the -ROOT- and .META. tables
> > > > > Q2. Not clear. Could explain a bit more? I am using the default
> > > setting.
> > > > >
> > > > > Thanks again.
> > > > >
> > > > >
> > > > > On 21 February 2013 10:36, Ted Yu <[EMAIL PROTECTED]> wrote:
> > > > >
> > > > > > bq. but when I click to view the table details it shows there
> are 5
> > > > > > regions.
> > > > > >
> > > > > > Did you include -ROOT- and .META. tables above ?
> > > > > >
> > > > > > bq. as you can see the maxHeapMB size is 991
> > > > > >
> > > > > > Attachment is automatically stripped from your email. FYI
> > > > > >
> > > > > > On Wed, Feb 20, 2013 at 3:26 PM, Joarder KAMAL <