Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - [VOTE] The 1st hbase 0.94.7 release candidate is available for download


+
lars hofhansl 2013-04-17, 18:40
+
Jean-Marc Spaggiari 2013-04-18, 15:13
+
lars hofhansl 2013-04-19, 17:59
Copy link to this message
-
Re: [VOTE] The 1st hbase 0.94.7 release candidate is available for download
Jean-Marc Spaggiari 2013-04-20, 12:06
Hi Lars,

I just re-ran both of them again. Here are the results:
jmspaggi@hbasetest:~/hbase$ cat hbase-0.94.6.1/output.txt  | grep Finished
| grep RandomWriteTest
13/04/19 20:58:13 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34481ms at
offset 0 for 1048576 rows
13/04/19 21:00:06 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35055ms at
offset 0 for 1048576 rows
13/04/19 21:02:00 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35890ms at
offset 0 for 1048576 rows
13/04/19 21:03:52 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34207ms at
offset 0 for 1048576 rows
13/04/19 21:05:42 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34898ms at
offset 0 for 1048576 rows
13/04/19 21:07:36 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36355ms at
offset 0 for 1048576 rows
13/04/19 21:09:28 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34613ms at
offset 0 for 1048576 rows
13/04/19 21:11:22 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34398ms at
offset 0 for 1048576 rows
13/04/19 21:13:15 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35092ms at
offset 0 for 1048576 rows
13/04/19 21:15:08 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 33852ms at
offset 0 for 1048576 rows
jmspaggi@hbasetest:~/hbase$ cat hbase-0.94.7/output.txt  | grep Finished |
grep RandomWriteTest
13/04/19 17:10:26 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36443ms at
offset 0 for 1048576 rows
13/04/19 17:12:21 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37071ms at
offset 0 for 1048576 rows
13/04/19 17:14:17 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37143ms at
offset 0 for 1048576 rows
13/04/19 17:16:11 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37561ms at
offset 0 for 1048576 rows
13/04/19 17:18:05 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37082ms at
offset 0 for 1048576 rows
13/04/19 17:20:01 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36667ms at
offset 0 for 1048576 rows
13/04/19 17:21:55 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36580ms at
offset 0 for 1048576 rows
13/04/19 17:23:48 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36708ms at
offset 0 for 1048576 rows
13/04/19 17:25:42 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36773ms at
offset 0 for 1048576 rows
13/04/19 17:27:35 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37035ms at
offset 0 for 1048576 rows

I copied the log4j config from one to the other one to make sure they are
logging the same thing. They are both ran on a single node standalone
dedicated computer. Here is the command line I used:
echo Test starting for randomWrite
for i in {1..10}; do echo; echo -n $i ; rm -rf /tmp/*; bin/start-hbase.sh;
sleep 60; bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation
randomWrite 1; bin/stop-hbase.sh; done &>> output.txt

Computer is a 4 cores 4.2Ghz 16G with 60GB regular SATA-I hard drive.

I will re-run the tests on another computer with different specs to figure
if the hard drive is impacting the results.

But so far, 0.94.7 is still slower for me.

JM

2013/4/19 lars hofhansl <[EMAIL PROTECTED]>

+
Jean-Marc Spaggiari 2013-04-20, 14:35
+
lars hofhansl 2013-04-20, 21:56
+
lars hofhansl 2013-04-20, 23:37
+
Jean-Marc Spaggiari 2013-04-22, 16:43
+
lars hofhansl 2013-04-24, 05:17
+
Jean-Daniel Cryans 2013-04-24, 17:09
+
Andrew Purtell 2013-04-24, 20:53
+
lars hofhansl 2013-04-25, 00:01
+
Jonathan Hsieh 2013-04-25, 00:04
+
Jonathan Hsieh 2013-04-24, 23:54
+
lars hofhansl 2013-04-25, 00:08
+
Jonathan Hsieh 2013-04-25, 00:15
+
lars hofhansl 2013-04-25, 00:51
+
Andrew Purtell 2013-04-25, 00:52
+
lars hofhansl 2013-04-25, 00:55
+
lars hofhansl 2013-04-25, 01:09