Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: compactions.   Results from 1 to 10 from 11 (0.603s).
Did you mean:
SpellChecker(?): compaction 
Loading phrases to help you
refine your search...
compaction failure - HBase - [mail # user]
...Hi, :   I found lots of error saying compaction  failed, does anybody know how  to get around this  problem ?   Jimmy.    2010-06-23 00:01:17,407 DEBUG  org.apache.hadoop.hbase.regionserver.Compact...
...SplitT hread: Compaction requested for region Spam_MsgEventTable,2010-06-22  13:17:04\x0 915e45cc95fa9201b366dc7316dd88438,1277244197913/1155282109 because:  regionserver /
[+ show more]
   Author: Jinsong Hu, 2010-06-23, 21:26
[expand - 5 more] - ideas to improve throughput of the base writting - HBase - [mail # user]
...Hi,  There:   While saving lots of data to  on hbase, I noticed that the regionserver  CPU went to more than 100%. examination shows that the hbase CompactSplit is  spending full time...
... working on compacting/splitting  hbase store files. The  machine I have is an 8 core machine. because there is only one comact/split  thread in hbase, only one core is fully used.   I continue...
[+ show more]
   Author: Jinsong Hu, 2010-06-07, 22:52
Re: what is the unit of the TTL in hbase and how often hbase remove expired regions? - HBase - [mail # user]
...I realized that there is a problem.  I read some comments and realized that  the TTL is used when the compaction is executed. that means if there is some regions that has older data...
... then TTL , and no  new data is written to that region, then the old data will never be removed  , because no compaction will ever happen for those data after they are  stored.  Unfortunately...
[+ show more]
   Author: Jinsong Hu, 2010-09-14, 03:05
[expand - 6 more] - Re: hbase doesn't delete data older than TTL in old regions - HBase - [mail # user]
..., the major_compaction didn't happen for this table for the last 24 hours.  I realized that I have other tables that have been running for a while and  all I need to do is to check the existing logs...
... , so I checked the major_compaction from their log, and I found that the major_compaction does  happen, but not really every 24 hours. I have seem 2 major compaction happenning within  3 hours...
[+ show more]
   Author: Jinsong Hu, 2010-09-17, 16:59
Re: lack of region merge cause in_memory option trouble - HBase - [mail # user]
... that if I manually run major_compact against the table, it helps a  lot. the older data gets removed. hbase is supposed to run major_compact  every day, but searching from the log, and I found...
... that is not the case. I  have found situations that the major_compact didn't happen for several days.  for the tables with TTL, I found the lack of major_compact greatly impacted the read performance.  after...
[+ show more]
   Author: Jinsong Hu, 2010-09-19, 15:53
Re: ycsb test on hbase - HBase - [mail # user]
...When I did the test, I found the CPU went to 100% for the compaction thread.  while other cores in the OS is not fully utilized. I checked the hbase code and found there is only  one single...
... thread that does compaction. That needs to be changed. I found that 0.21 version of hbase  does have this plan to use multiple thread to do so, but it appears it will take a long time for us...
   Author: Jinsong Hu, 2010-09-10, 17:49
dilemma of memory and CPU for hbase. - HBase - [mail # user]
... does minor compaction and the CPU usage is very high, It also  blocks the heavy client record insertion.    So now I am limited on one side by memory,  limited on another size by  CPU...
   Author: Jinsong Hu, 2010-07-01, 18:52
Re: regionserver crash under heavy load - HBase - [mail # user]
...=287,  storefi leIndexSize=54, memstoreSize=489, compactionQueueSize=1, usedHeap=488,  maxHeap=2 043, blockCacheSize=5800680, blockCacheFree=422830968, blockCacheCount=244,  bloc k...
...Size=489, compactionQueueSize=1, usedHeap=491,  maxHeap=204 3, blockCacheSize=5800680, blockCacheFree=422830968, blockCacheCount=244,  blockC acheHitRatio=29  I logged all gc and the longest gc...
   Author: Jinsong Hu, 2010-07-13, 22:28
survey: what is the current stable hadoop and hbase combination - HBase - [mail # user]
...:03:19,120 DEBUG  org.apache.hadoop.hbase.regionserver.CompactSplitT hread: Compaction requested for region  HEARTBEAT_MASTERPATCH,,1274304444539/1273 809222 because: regionserver/
   Author: Jinsong Hu, 2010-05-27, 16:25
[expand - 1 more] - Re: memory usage too high in regionserver - HBase - [mail # user]
...you are right. now it shows up as  request=180.5, regions=60, stores=61, storefiles=67, storefileIndexSize=143,  memstoreSize=20, compactionQueueSize=0, usedHeap=1417, maxHeap=6127,  block...
   Author: Jinsong Hu, 2010-08-09, 22:22
HBase (11)
mail # user (11)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (11)
Stack (58)
Jean-Daniel Cryans (57)
Ted Yu (42)
Jean-Marc Spaggiari (32)
lars hofhansl (22)
Ryan Rawson (15)
Michael Segel (13)
Andrew Purtell (12)
Doug Meil (12)
Vidhyashankar Venkatarama...(10)
Bryan Beaudreault (9)
yun peng (8)
Alex Baranau (7)
Asaf Mesika (7)
Buttler, David (7)
Harsh J (7)
Jack Levin (7)
Jinsong Hu (7)
Matt Corgan (7)
Otis Gospodnetic (7)
Amit Sela (6)
Dmitriy Lyubimov (6)
Esteban Gutierrez (6)
Jonathan Gray (6)
Lars George (6)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB