Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Cluster load


Copy link to this message
-
Re: Cluster load
Hi,

by node do you mean regionserver node ?

if you referring to RegionServer node: you can go to the hbase master web
interface master:65510/master.jsp to see load for each regionserver. That's
the overall load. If you want to see load per node per table, you will need
to query on .META. table (column: info:server)

--K
On Fri, Jul 27, 2012 at 9:07 AM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

> Is there a way to see how much data does each node have per Hbase table?
>
> On Thu, Jul 26, 2012 at 5:53 PM, syed kather <[EMAIL PROTECTED]> wrote:
>
> > First check whether the data in hbase is consistent ... check this by
> > running hbck (bin/hbase hbck ) If all the region is consistent .
> > Now check no of splits in localhost:60010 for the table mention ..
> >  On Jul 27, 2012 4:02 AM, "Mohit Anchlia" <[EMAIL PROTECTED]>
> wrote:
> >
> > > I added new regions and the performance didn't improve. I think it
> still
> > is
> > > the load balancing issue. I want to ensure that my rows are getting
> > > distrbuted accross cluster. What I see is this:
> > >
> > > Could you please tell me what's the best way to see the load?
> > >
> > >
> > > [root@dsdb4 ~]# hadoop fs -lsr /hbase/SESSION_TIMELINE1/
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.oldlogs/hlog.1343334723359
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.oldlogs/hlog.1343334723093
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.oldlogs/hlog.1343334723240
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.oldlogs/hlog.1343334723171
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf
> > >
>