Comments on: again, on benchmarks

By: svar

svar — Thu, 26 Nov 2009 12:12:56 +0000

By the way we miss you here …

By: svar

svar — Thu, 26 Nov 2009 11:53:21 +0000

:) yes, i really don’t clame it to be one, just curiosity. I just introduce a primary key and a binary field with sha1 at least it is fixing the design problem found in the bench. Just wanted to show that with a proper disign and good setup we could at least divide the numbers expose to the world per a factor 20. More comparing Apple to Orange instead of Apple to Steack :)

By: Domas Mituzas

Domas Mituzas — Thu, 26 Nov 2009 10:39:57 +0000

stephane, that is very poor benchmark too ;-)

By: svar

svar — Wed, 25 Nov 2009 20:31:53 +0000

CREATE TABLE comp_dump(
k binary(20) DEFAULT NULL,
v char(32) DEFAULT NULL,
Primary key(`k`) ) ENGINE=InnoDB;

set @ct:=1;
insert into comp_dump select unhex(sha1(@ct:=@ct+1)), ‘aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa’ ;

repeat the next query n time
insert into comp_dump select unhex(sha1(@ct:=@ct+1)), ‘aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa’ from comp_dump;

select count(*) from comp_dump;
| 2097152 |

time /Users/stephanevaroqui/local/mysql-5.4.1-beta-osx10.5-x86_64/bin/mysqlslap –create-schema=test -c 10 -i10000 -q benchget.sql
Benchmark
Average number of seconds to run all queries: 0.001 seconds
Minimum number of seconds to run all queries: 0.000 seconds
Maximum number of seconds to run all queries: 0.007 seconds
Number of clients running queries: 10
Average number of queries per client: 1

real 0m23.337s
user 0m3.988s
sys 0m12.059s

cat benchget.sql
select v from comp_dump where k=unhex(cast(sha1(cast((2000000 ) as unsigned))as char));

time /Users/stephanevaroqui/local/mysql-5.4.1-beta-osx10.5-x86_64/bin/mysqlslap –create-schema=test -c 10 -i10000 -q benchset.sql
Benchmark
Average number of seconds to run all queries: 0.001 seconds
Minimum number of seconds to run all queries: 0.000 seconds
Maximum number of seconds to run all queries: 0.028 seconds
Number of clients running queries: 10
Average number of queries per client: 1

real 0m26.644s
user 0m3.708s
sys 0m12.229s
macbook-pro-de-stephane-varoqui:~ stephanevaroqui$ cat benchset.sql
update comp_dump set v=’bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb’ where k=unhex(cast(sha1(cast((2000000 ) as unsigned))as char));

By: Toru Maesaka

Toru Maesaka — Wed, 25 Nov 2009 06:31:31 +0000

I feel your pain.

By: Sergej 'ZaZa' Kurakin

Sergej 'ZaZa' Kurakin — Mon, 23 Nov 2009 22:32:42 +0000

Nice notice about benchmarks in blogs – most of them are just stupid crap and it’s growing :-/

If people would spend more time describing benchmarks in more details, not just showing results in tables, probably, benchmarks would be more truthful. Just because they would look deeper and see mistakes.

By: LinuxJedi

LinuxJedi — Fri, 20 Nov 2009 00:53:05 +0000

Have you looked at the MySQL tutorials?

By: Baron Schwartz

Baron Schwartz — Fri, 20 Nov 2009 00:04:04 +0000

MY favorite part is this:

“I could see the unauthenticated users, which meant that the client had connected to MySQL and was doing a handshake using MySQL authentication (using username and password).”

So the author didn’t set skip_name_resolve, which probably really means he’s just benchmarking his DNS lookup speed.

By: VadimTk

VadimTk — Thu, 19 Nov 2009 22:30:14 +0000

Domas,

Agree with you on this one

I wanted to grumble by myself but you are faster.

By: Harrison

Harrison — Thu, 19 Nov 2009 20:07:22 +0000

Agreed. Very poor benchmark.