Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Cluster load


+
Mohit Anchlia 2012-07-26, 22:32
+
syed kather 2012-07-27, 00:53
Copy link to this message
-
Re: Cluster load
Mohit Anchlia 2012-07-27, 01:07
Is there a way to see how much data does each node have per Hbase table?

On Thu, Jul 26, 2012 at 5:53 PM, syed kather <[EMAIL PROTECTED]> wrote:

> First check whether the data in hbase is consistent ... check this by
> running hbck (bin/hbase hbck ) If all the region is consistent .
> Now check no of splits in localhost:60010 for the table mention ..
>  On Jul 27, 2012 4:02 AM, "Mohit Anchlia" <[EMAIL PROTECTED]> wrote:
>
> > I added new regions and the performance didn't improve. I think it still
> is
> > the load balancing issue. I want to ensure that my rows are getting
> > distrbuted accross cluster. What I see is this:
> >
> > Could you please tell me what's the best way to see the load?
> >
> >
> > [root@dsdb4 ~]# hadoop fs -lsr /hbase/SESSION_TIMELINE1/
> >
> > drwxr-xr-x - root root 3 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641
> >
> > drwxr-xr-x - root root 1 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.oldlogs
> >
> > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> >
> >
> /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.oldlogs/hlog.1343334723359
> >
> > drwxr-xr-x - root root 0 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/S_T_MTX
> >
> > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/8c02c8ed87e1a023ece8d8090a364641/.regioninfo
> >
> > drwxr-xr-x - root root 3 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854
> >
> > drwxr-xr-x - root root 1 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.oldlogs
> >
> > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> >
> >
> /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.oldlogs/hlog.1343334723093
> >
> > drwxr-xr-x - root root 0 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/S_T_MTX
> >
> > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/79e03d78a784601e8daa88aa85c39854/.regioninfo
> >
> > drwxr-xr-x - root root 3 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba
> >
> > drwxr-xr-x - root root 1 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.oldlogs
> >
> > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> >
> >
> /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.oldlogs/hlog.1343334723240
> >
> > drwxr-xr-x - root root 0 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/S_T_MTX
> >
> > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/1054fe861f199a23ebef8f49f99c4aba/.regioninfo
> >
> > drwxr-xr-x - root root 3 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a
> >
> > drwxr-xr-x - root root 1 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.oldlogs
> >
> > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> >
> >
> /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.oldlogs/hlog.1343334723171
> >
> > drwxr-xr-x - root root 0 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/S_T_MTX
> >
> > -rwxr-xr-x 3 root root 764 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/04295ef1d74887a107a013810f5aa26a/.regioninfo
> >
> > drwxr-xr-x - root root 3 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf
> >
> > drwxr-xr-x - root root 1 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf/.oldlogs
> >
> > -rwxr-xr-x 3 root root 124 2012-07-26 13:32
> >
> >
> /hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf/.oldlogs/hlog.1343334723397
> >
> > drwxr-xr-x - root root 0 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf/S_T_MTX
> >
> > -rwxr-xr-x 3 root root 762 2012-07-26 13:32
> > /hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf/.regioninfo
> >
> > drwxr-xr-x - root root 4 2012-07-26 13:57
> > /hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a
+
Khang Pham 2012-07-27, 07:16
+
Alex Baranau 2012-07-27, 14:21
+
syed kather 2012-07-27, 14:52
+
Alex Baranau 2012-07-27, 18:07
+
syed kather 2012-07-27, 18:21
+
Alex Baranau 2012-07-27, 18:48
+
Mohit Anchlia 2012-07-27, 23:24
+
Alex Baranau 2012-07-27, 23:51
+
Mohit Anchlia 2012-07-28, 00:43
+
Alex Baranau 2012-07-28, 01:03
+
Mohit Anchlia 2012-07-28, 18:07
+
Suraj Varma 2012-07-29, 04:38
+
Mohit Anchlia 2012-07-30, 17:56
+
Alex Baranau 2012-07-30, 18:58
+
Mohit Anchlia 2012-07-30, 19:37