Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save mdcallag/cf790b62a11c0f1a7e148533e0f9a9e9 to your computer and use it in GitHub Desktop.
Save mdcallag/cf790b62a11c0f1a7e148533e0f9a9e9 to your computer and use it in GitHub Desktop.
Config is:
* Intel NUC 2 cpus, 4 vcpus, 16gb RAM
* block cache / buffer pool is 12gb
* 16 tables, 3M rows/table, 1 client connection
* compressed InnoDB uses zlib, compressed MyRocks uses lz4 for mid levels and zstd for max level
Engines:
* myrocks.p5721.{zstd,none} - MyRocks, Percona 5.7.21 using zstd or no compression for max level
* innodb.p5721.{zlib,none} - InnoDB, Percona 5.7.21 using zlib or no compression
Metrics:
* size - database size after load
* seconds - time to load database
* QPS - average queries/second
* r/q, rKB/q - iostat reads / query and read KB / query
* Mcpu/q - CPU overhead / query
* r/s, rKB/s - iostat reads/s and read KB/s
* CPU/s - vmstat us+sy
rand=uniform
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3084 5.0 37.1 352096 1099 8171 77.6 myrocks.p5721.zstd
2794 5.3 99.4 389378 1054 19838 77.7 myrocks.p5721.none
1451 7.0 56.0 735152 725 5800 76.3 innodb.p5721.zlib
3583 7.0 112.4 303666 1798 28762 77.7 innodb.p5721.none
rand=pareto 0.5
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3069 4.9 36.5 353824 1083 7995 77.5 myrocks.p5721.zstd
2851 5.1 96.9 383429 1048 19720 78.1 myrocks.p5721.none
1489 5.4 43.6 716444 579 4633 76.3 innodb.p5721.zlib
3587 7.0 111.8 303080 1791 28653 77.7 innodb.p5721.none
rand=pareto 0.1
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
4457 0.193 1.266 242092 61 403 77.1 myrocks.p5721.zstd
4044 0.270 4.971 268533 78 1436 77.5 myrocks.p5721.none
4882 0.299 2.392 222022 104 834 77.4 innodb.p5721.zlib
5338 0.348 5.561 204020 133 2120 77.8 innodb.p5721.none
Per-query results for uniform
query=1
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
1741 23.4 171.9 625359 2908 62539 77.8 myrocks.p5721.zstd
1645 24.2 454.9 662417 2849 53467 77.9 myrocks.p5721.none
1287 25.1 200.7 834830 2305 18443 76.7 innodb.p5721.zlib
2141 28.2 451.8 503994 4318 69087 77.1 innodb.p5721.none
query=2
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
1441 22.3 164.1 749526 2300 16889 77.1 myrocks.p5721.zstd
1315 23.5 441.4 823512 2211 41463 77.4 myrocks.p5721.none
1133 22.1 176.8 940948 1788 14305 76.2 innodb.p5721.zlib
1711 24.9 398.5 629346 3044 48707 76.9 innodb.p5721.none
query=3
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3569 0 0 303726 0 0 77.4 myrocks.p5721.zstd
3350 0 0.002 322088 0 1 77.1 myrocks.p5721.none
5070 0 0.001 212839 0 0 77.0 innodb.p5721.zlib
4508 0 0 240034 0 0 77.3 innodb.p5721.none
query=4
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3438 0.006 0.030 314747 1 7 77.3 myrocks.p5721.zstd
3231 0.045 0.674 333066 10 156 76.9 myrocks.p5721.none
4350 0 0 248294 0 0 77.1 innodb.p5721.zlib
4273 0 0 252726 0 0 77.1 innodb.p5721.none
query=5
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3772 0.022 0.111 285826 6 30 77.0 myrocks.p5721.zstd
3384 0.044 0.659 319407 11 159 77.2 myrocks.p5721.none
4933 0 0 219744 0 0 77.4 innodb.p5721.zlib
4833 0 0 223864 0 0 73.7 innodb.p5721.none
query=6
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
5541 0.001 0.004 194740 0 2 77.0 myrocks.p5721.zstd
4939 0.004 0.057 219292 1 20 77.4 myrocks.p5721.none
6229 0 0 174513 0 0 77.7 innodb.p5721.zlib
6325 0 0 171231 0 0 77.3 innodb.p5721.none
Per-query results for pareto 0.1
query=1
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
4540 0.510 3.419 238310 165 1109 77.3 myrocks.p5721.zstd
4363 0.677 12.523 248676 211 3903 77.5 myrocks.p5721.none
5178 0.702 5.613 209730 260 2076 77.5 innodb.p5721.zlib
5511 0.977 15.626 197437 384 6151 77.7 innodb.p5721.none
query=2
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3107 0.372 2.591 347946 83 575 77.2 myrocks.p5721.zstd
3023 0.476 8.884 356588 103 1918 77.0 myrocks.p5721.none
3578 0.326 2.610 302998 83 667 77.4 innodb.p5721.zlib
3775 0.493 7.881 287417 133 2125 77.5 innodb.p5721.none
query=3
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3797 0 0 286301 0 0 77.7 myrocks.p5721.zstd
3725 0 0 292087 0 0 77.7 myrocks.p5721.none
5268 0 0 204998 0 0 77.1 innodb.p5721.zlib
4968 0.117 1.874 217978 42 665 77.4 innodb.p5721.none
query=4
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3792 0.001 0.005 286377 0.3 1 77.5 myrocks.p5721.zstd
3682 0.001 0.025 295745 0.3 6 77.8 myrocks.p5721.none
5306 0 0 204494 0 0 77.5 innodb.p5721.zlib
5016 0.034 0.541 216490 12 194 77.6 innodb.p5721.none
query=5
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
3956 0 0 275782 0 0 77.9 myrocks.p5721.zstd
3698 0 0 294753 0 0 77.8 myrocks.p5721.none
5370 0.011 0.087 201293 4 33 77.3 innodb.p5721.zlib
5215 0 0 207686 0 0 77.3 innodb.p5721.none
query=6
QPS r/q rKB/q Mcpu/q r/s rKB/s CPU/s engine
5704 0 0 190217 0 0 77.5 myrocks.p5721.zstd
4920 0 0.001 219713 0 0 77.3 myrocks.p5721.none
7813 0.003 0.025 138750 2 14 77.4 innodb.p5721.zlib -> qps had lots of variance, this was peak
6733 0 0 161739 0 0 77.8 innodb.p5721.none
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment