Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Cluster load


+
Mohit Anchlia 2012-07-26, 22:32
+
syed kather 2012-07-27, 00:53
+
Mohit Anchlia 2012-07-27, 01:07
+
Khang Pham 2012-07-27, 07:16
+
Alex Baranau 2012-07-27, 14:21
+
syed kather 2012-07-27, 14:52
+
Alex Baranau 2012-07-27, 18:07
+
syed kather 2012-07-27, 18:21
+
Alex Baranau 2012-07-27, 18:48
Copy link to this message
-
Re: Cluster load
Mohit Anchlia 2012-07-27, 23:24
On Fri, Jul 27, 2012 at 11:48 AM, Alex Baranau <[EMAIL PROTECTED]>wrote:

> You can read metrics [0] from JMX directly [1] or use Ganglia [2] or other
> third-party tools like [3] (I'm a little biased here;)).
>
> [0] http://hbase.apache.org/book.html#hbase_metrics
> [1] http://hbase.apache.org/metrics.html
> [2] http://wiki.apache.org/hadoop/GangliaMetrics
> [3] http://sematext.com/spm/hbase-performance-monitoring/index.html
>
> Note, that metrics values may seem a bit ugly/weird: as they say, you have
> to refer to Lars' book HBase in Action to understand how some of them
> calculated. There's an ongoing work towards revising metrics, they should
> look much better in next releases.
>
>

I did flush still what I am seeing is that all my keys are still going to
the first region even though my keys have 0-9 as the first character. Is
there a easy way to see why that might be? hbase shell scan only shows
value in hex.

  SESSION_TIMELINE1,,1343334722986.0a5f6fadd0435 column=info:regioninfo,
timestamp=1343334723073, value=REGION => {NAME =>
'SESSION_TIMELINE1,,1343334722986.0a5f6fadd0435898c6f4cf11daa989
 898c6f4cf11daa9895a.                           5a.', STARTKEY => '',
ENDKEY => '0', ENCODED => 0a5f6fadd0435898c6f4cf11daa9895a, TABLE => {{NAME
=> 'SESSION_TIMELINE1', FAMILIES => [{NA
                                                ME => 'S_T_MTX',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'GZ',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
                                                '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}}
 SESSION_TIMELINE1,0,1343334722986.79e03d78a784 column=info:regioninfo,
timestamp=1343334723116, value=REGION => {NAME =>
'SESSION_TIMELINE1,0,1343334722986.79e03d78a784601e8daa88aa85c39
 601e8daa88aa85c39854.                          854.', STARTKEY => '0',
ENDKEY => '1', ENCODED => 79e03d78a784601e8daa88aa85c39854, TABLE => {{NAME
=> 'SESSION_TIMELINE1', FAMILIES => [{
                                                NAME => 'S_T_MTX',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'GZ',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE                                                 > '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}}
 SESSION_TIMELINE1,1,1343334722987.1f0735a7e085 column=info:regioninfo,
timestamp=1343334723154, value=REGION => {NAME =>
'SESSION_TIMELINE1,1,1343334722987.1f0735a7e08504357d0bca07e6772
 04357d0bca07e6772a75.                          a75.', STARTKEY => '1',
ENDKEY => '2', ENCODED => 1f0735a7e08504357d0bca07e6772a75, TABLE => {{NAME
=> 'SESSION_TIMELINE1', FAMILIES => [{
                                                NAME => 'S_T_MTX',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'GZ',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE                                                 > '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}}

drwxr-xr-x   - root root          0 2012-07-26 13:32
/hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf/S_T_MTX
-rwxr-xr-x   3 root root        762 2012-07-26 13:32
/hbase/SESSION_TIMELINE1/486b20400be4a901d92ecded96d737cf/.regioninfo
drwxr-xr-x   - root root          4 2012-07-26 13:57
/hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a
drwxr-xr-x   - root root          0 2012-07-27 16:10
/hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a/.tmp
drwxr-xr-x   - root root          1 2012-07-26 13:32
/hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a/.oldlogs
-rwxr-xr-x   3 root root        124 2012-07-26 13:32
/hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a/.oldlogs/hlog.1343334723004
drwxr-xr-x   - root root          2 2012-07-27 16:10
/hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a/S_T_MTX
-rwxr-xr-x   3 root root   20249146 2012-07-26 17:54
/hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a/S_T_MTX/5004103053282833292
-rwxr-xr-x   3 root root    1400171 2012-07-27 16:10
/hbase/SESSION_TIMELINE1/0a5f6fadd0435898c6f4cf11daa9895a/S_T_MTX/8545160324229826840

+
Alex Baranau 2012-07-27, 23:51
+
Mohit Anchlia 2012-07-28, 00:43
+
Alex Baranau 2012-07-28, 01:03
+
Mohit Anchlia 2012-07-28, 18:07
+
Suraj Varma 2012-07-29, 04:38
+
Mohit Anchlia 2012-07-30, 17:56
+
Alex Baranau 2012-07-30, 18:58
+
Mohit Anchlia 2012-07-30, 19:37