Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> [VOTE] The 1st hbase 0.94.7 release candidate is available for download


Copy link to this message
-
Re: [VOTE] The 1st hbase 0.94.7 release candidate is available for download
Hi Lars,

I just re-ran both of them again. Here are the results:
jmspaggi@hbasetest:~/hbase$ cat hbase-0.94.6.1/output.txt  | grep Finished
| grep RandomWriteTest
13/04/19 20:58:13 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34481ms at
offset 0 for 1048576 rows
13/04/19 21:00:06 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35055ms at
offset 0 for 1048576 rows
13/04/19 21:02:00 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35890ms at
offset 0 for 1048576 rows
13/04/19 21:03:52 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34207ms at
offset 0 for 1048576 rows
13/04/19 21:05:42 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34898ms at
offset 0 for 1048576 rows
13/04/19 21:07:36 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36355ms at
offset 0 for 1048576 rows
13/04/19 21:09:28 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34613ms at
offset 0 for 1048576 rows
13/04/19 21:11:22 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34398ms at
offset 0 for 1048576 rows
13/04/19 21:13:15 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35092ms at
offset 0 for 1048576 rows
13/04/19 21:15:08 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 33852ms at
offset 0 for 1048576 rows
jmspaggi@hbasetest:~/hbase$ cat hbase-0.94.7/output.txt  | grep Finished |
grep RandomWriteTest
13/04/19 17:10:26 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36443ms at
offset 0 for 1048576 rows
13/04/19 17:12:21 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37071ms at
offset 0 for 1048576 rows
13/04/19 17:14:17 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37143ms at
offset 0 for 1048576 rows
13/04/19 17:16:11 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37561ms at
offset 0 for 1048576 rows
13/04/19 17:18:05 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37082ms at
offset 0 for 1048576 rows
13/04/19 17:20:01 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36667ms at
offset 0 for 1048576 rows
13/04/19 17:21:55 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36580ms at
offset 0 for 1048576 rows
13/04/19 17:23:48 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36708ms at
offset 0 for 1048576 rows
13/04/19 17:25:42 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36773ms at
offset 0 for 1048576 rows
13/04/19 17:27:35 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37035ms at
offset 0 for 1048576 rows

I copied the log4j config from one to the other one to make sure they are
logging the same thing. They are both ran on a single node standalone
dedicated computer. Here is the command line I used:
echo Test starting for randomWrite
for i in {1..10}; do echo; echo -n $i ; rm -rf /tmp/*; bin/start-hbase.sh;
sleep 60; bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation
randomWrite 1; bin/stop-hbase.sh; done &>> output.txt

Computer is a 4 cores 4.2Ghz 16G with 60GB regular SATA-I hard drive.

I will re-run the tests on another computer with different specs to figure
if the hard drive is impacting the results.

But so far, 0.94.7 is still slower for me.

JM

2013/4/19 lars hofhansl <[EMAIL PROTECTED]>

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB