Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Cluster load


+
Mohit Anchlia 2012-07-26, 22:32
+
syed kather 2012-07-27, 00:53
+
Mohit Anchlia 2012-07-27, 01:07
Copy link to this message
-
Re: Cluster load
Hi,

by node do you mean regionserver node ?

if you referring to RegionServer node: you can go to the hbase master web
interface master:65510/master.jsp to see load for each regionserver. That's
the overall load. If you want to see load per node per table, you will need
to query on .META. table (column: info:server)

--K
On Fri, Jul 27, 2012 at 9:07 AM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

> Is there a way to see how much data does each node have per Hbase table?
>
> On Thu, Jul 26, 2012 at 5:53 PM, syed kather <[EMAIL PROTECTED]> wrote:
>
> > First check whether the data in hbase is consistent ... check this by
> > running hbck (bin/hbase hbck ) If all the region is consistent .
> > Now check no of splits in localhost:60010 for the table mention ..
> >  On Jul 27, 2012 4:02 AM, "Mohit Anchlia" <[EMAIL PROTECTED]>
> wrote:
> >
> > > I added new regions and the performance didn't improve. I think it
> still
> > is
> > > the load balancing issue. I want to ensure that my rows are getting
> > > distrbuted accross cluster. What I see is this:
> > >
> > > Could you please tell me what's the best way to see the load?
> > >
> > >
> > > [root@dsdb4 ~]# hadoop fs -lsr /hbase/SESSION_TIMELINE1/
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.oldlogs/hlog.1343334723359
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.oldlogs/hlog.1343334723093
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.oldlogs/hlog.1343334723240
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a
> > >
> > > drwxr-xr-x - root root 1 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.oldlogs
> > >
> > > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> > >
> > >
> >
> /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.oldlogs/hlog.1343334723171
> > >
> > > drwxr-xr-x - root root 0 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/S_T_MTX
> > >
> > > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.regioninfo
> > >
> > > drwxr-xr-x - root root 3 2012-07-26 13:32
> > > /hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf
> > >
>
+
Alex Baranau 2012-07-27, 14:21
+
syed kather 2012-07-27, 14:52
+
Alex Baranau 2012-07-27, 18:07
+
syed kather 2012-07-27, 18:21
+
Alex Baranau 2012-07-27, 18:48
+
Mohit Anchlia 2012-07-27, 23:24
+
Alex Baranau 2012-07-27, 23:51
+
Mohit Anchlia 2012-07-28, 00:43
+
Alex Baranau 2012-07-28, 01:03
+
Mohit Anchlia 2012-07-28, 18:07
+
Suraj Varma 2012-07-29, 04:38
+
Mohit Anchlia 2012-07-30, 17:56
+
Alex Baranau 2012-07-30, 18:58
+
Mohit Anchlia 2012-07-30, 19:37
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB