지돌이의 블로그 입니다!

스펙

복잡함..ㅋ HDD여러개.. 네트워크 1Gbps
꾸진..... node들...
가벼운 참고용...

Kubernetes : v1.16.8
rook-ceph : v14.2.8

전체..

Type transactions (per sec) queries (per sec) ignored errors reconnects
MariaDB & HostPath 38.43 (100%) 768.62 (100%) X X
MariaDB & Ceph 20.40 (53%) 407.91 (53%) X X
MariaDB-Galera & CEPH 16.73 (43.5%) 339.32 (44.1%) 16 (0.25/s) X

MariaDB & HostPath

DBMS : mariadb (without clustering)
storage : hostpath (direct)

$ sysbench /usr/share/sysbench/oltp_read_write.lua --db-driver=mysql --threads=10 --time=60 ... --tables=10 --table_size=10000 --histogram run
sysbench 1.0.11 (using system LuaJIT 2.1.0-beta3)

Running the test with following options:
Number of threads: 10
Initializing random number generator from current time


Initializing worker threads...

Threads started!

Latency histogram (values are in milliseconds)
       value  ------------- distribution ------------- count
      97.555 |                                         1
     139.846 |**                                       10
     142.387 |**                                       10
     144.974 |*                                        6
     147.608 |**                                       12
     150.290 |*****                                    31
     153.021 |**                                       14
     155.801 |*                                        7
     158.632 |******                                   35
     161.514 |******************                       110
     164.449 |                                         1
     167.437 |****************                         93
     170.479 |**********************************       204
     173.577 |************                             73
     176.731 |****                                     26
     179.942 |**************************************** 239
     183.211 |**********                               61
     186.540 |*                                        8
     189.929 |*******************************          184
     193.380 |**********                               60
     196.894 |***                                      20
     200.472 |***************                          92
     204.114 |***                                      17
     207.823 |*                                        8
     211.599 |****                                     24
     215.443 |                                         1
     219.358 |****                                     21
     223.344 |                                         2
     227.402 |*                                        6
     231.534 |*****                                    28
     235.740 |                                         1
     240.024 |*****                                    30
     244.385 |*                                        7
     248.825 |*******                                  44
     253.346 |**                                       14
     257.950 |**                                       10
     262.636 |********                                 49
     267.408 |***                                      15
     272.267 |******                                   36
     277.214 |**                                       13
     282.251 |**********                               58
     292.601 |***                                      17
     297.917 |*                                        5
     303.330 |***                                      18
     308.842 |****                                     21
     314.453 |**                                       9
     320.167 |***                                      19
     325.984 |*                                        4
     331.907 |*******                                  40
     337.938 |*****                                    27
     344.078 |*                                        6
     350.330 |*******                                  39
     356.695 |**                                       10
     363.176 |****                                     22
     369.775 |****                                     25
     376.494 |*                                        3
     383.334 |*******                                  42
     390.299 |***                                      20
     397.391 |                                         1
     404.611 |***                                      15
     411.963 |***                                      16
     419.448 |***                                      16
     427.069 |**                                       10
     434.829 |**                                       9
     442.730 |***                                      16
     450.774 |***                                      18
     458.964 |*                                        8
     467.304 |*                                        6
     475.794 |                                         1
     484.439 |*                                        7
     493.242 |***                                      20
     502.204 |**                                       11
     511.328 |***                                      16
     520.619 |*                                        4
     530.078 |***                                      17
     539.710 |**                                       11
     549.516 |**                                       12
     559.501 |*                                        5
     569.667 |*                                        5
     580.017 |                                         2
     590.556 |*                                        4
     601.286 |*                                        3
     612.211 |*                                        6
     623.335 |*                                        6
     634.661 |*                                        4
     646.192 |*                                        7
     657.933 |**                                       10
     669.888 |                                         2
     682.059 |*                                        4
     694.452 |*                                        3
     707.070 |*                                        3
     719.917 |*                                        4
     732.998 |                                         1
     759.876 |*                                        4
     773.683 |                                         1
     802.053 |*                                        3
     816.626 |                                         2
     846.572 |*                                        3
     893.561 |                                         1
     926.327 |                                         2
     977.743 |*                                        3
    1013.597 |                                         1
    1032.013 |                                         1

SQL statistics:
    queries performed:
        read:                            32368
        write:                           9248
        other:                           4624
        total:                           46240
    transactions:                        2312   (38.43 per sec.)
    queries:                             46240  (768.62 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          60.1592s
    total number of events:              2312

Latency (ms):
         min:                                 97.62
         avg:                                259.75
         max:                               1034.92
         95th percentile:                    530.08
         sum:                             600546.68

Threads fairness:
    events (avg/stddev):           231.2000/5.93
    execution time (avg/stddev):   60.0547/0.04

MariaDB & Ceph

DBMS : mariadb (without clustering)
storage class : hdd & ceph

$ sysbench /usr/share/sysbench/oltp_read_write.lua --db-driver=mysql --threads=10 --time=60 ... --tables=10 --table_size=10000 --histogram run
sysbench 1.0.11 (using system LuaJIT 2.1.0-beta3)

Running the test with following options:
Number of threads: 10
Initializing random number generator from current time


Initializing worker threads...

Threads started!

Latency histogram (values are in milliseconds)
       value  ------------- distribution ------------- count
      64.474 |*************                            8
      66.838 |******                                   4
      68.053 |*****                                    3
      69.289 |**                                       1
      70.548 |******                                   4
      71.830 |**                                       1
      73.135 |**********                               6
      74.464 |**                                       1
      75.817 |*************                            8
      77.194 |*****************************            18
      80.025 |**********                               6
      81.479 |***********                              7
      84.467 |********                                 5
      86.002 |********                                 5
      87.564 |***********                              7
      89.155 |*********************                    13
      90.775 |***                                      2
      92.424 |***********                              7
      94.104 |*****                                    3
      95.814 |**************                           9
      97.555 |***                                      2
      99.327 |**                                       1
     101.132 |****************                         10
     102.969 |*************                            8
     104.840 |**********                               6
     106.745 |**************                           9
     110.659 |**                                       1
     116.802 |*****************************            18
     118.924 |***                                      2
     121.085 |***********                              7
     123.285 |******************                       11
     125.525 |**                                       1
     127.805 |****************                         10
     130.128 |*********************                    13
     132.492 |***                                      2
     134.899 |************************                 15
     137.350 |**********                               6
     139.846 |**                                       1
     142.387 |**************************************** 25
     144.974 |***********                              7
     147.608 |***                                      2
     150.290 |**************************               16
     153.021 |********                                 5
     158.632 |********                                 5
     161.514 |**                                       1
     164.449 |********                                 5
     167.437 |**********                               6
     170.479 |*****                                    3
     173.577 |*************                            8
     176.731 |*************                            8
     179.942 |**********                               6
     186.540 |**********                               6
     189.929 |**                                       1
     196.894 |**                                       1
     200.472 |***********                              7
     219.358 |*********************                    13
     223.344 |***                                      2
     227.402 |**************                           9
     235.740 |**********************                   14
     240.024 |*************                            8
     244.385 |**************                           9
     248.825 |**********                               6
     253.346 |*************                            8
     257.950 |**********************                   14
     262.636 |**                                       1
     267.408 |******************                       11
     272.267 |*************                            8
     277.214 |***                                      2
     282.251 |*************                            8
     287.379 |*********************                    13
     297.917 |**********                               6
     303.330 |******                                   4
     308.842 |**************                           9
     314.453 |******                                   4
     320.167 |************************                 15
     325.984 |**************                           9
     331.907 |*************                            8
     337.938 |*************                            8
     344.078 |**********************                   14
     350.330 |******                                   4
     356.695 |*****                                    3
     363.176 |*********************                    13
     369.775 |*************************************    23
     376.494 |**************                           9
     383.334 |**********************                   14
     390.299 |**************                           9
     404.611 |******************************           19
     411.963 |****************                         10
     419.448 |**************                           9
     427.069 |**********                               6
     434.829 |***                                      2
     442.730 |******************************           19
     450.774 |******************                       11
     458.964 |*****************************            18
     467.304 |***************************              17
     475.794 |***********                              7
     484.439 |************************                 15
     493.242 |******************                       11
     502.204 |*********************                    13
     511.328 |******************                       11
     520.619 |**************                           9
     530.078 |******************                       11
     539.710 |****************                         10
     549.516 |*****                                    3
     559.501 |*********************                    13
     580.017 |******************************           19
     601.286 |********                                 5
     612.211 |****************                         10
     623.335 |*******************                      12
     634.661 |****************                         10
     646.192 |**************                           9
     657.933 |**************************************** 25
     669.888 |******************                       11
     682.059 |****************                         10
     694.452 |********                                 5
     707.070 |*******************                      12
     719.917 |******                                   4
     732.998 |******                                   4
     746.316 |*******************                      12
     759.876 |******************                       11
     773.683 |******                                   4
     787.741 |***********                              7
     802.053 |**                                       1
     816.626 |**************                           9
     831.464 |*************                            8
     846.572 |******                                   4
     861.954 |***********                              7
     877.615 |******************                       11
     893.561 |**********************************       21
     926.327 |*******************                      12
     960.295 |*********************                    13
     977.743 |****************                         10
    1032.013 |****************                         10
    1050.764 |*************                            8
    1069.856 |*************                            8
    1089.295 |**********                               6
    1109.087 |*****                                    3
    1149.757 |*********************                    13
    1170.648 |****************                         10
    1191.918 |******                                   4
    1213.575 |**                                       1
    1235.625 |*****                                    3
    1258.076 |***********                              7
    1304.208 |*****                                    3
    1401.611 |***                                      2
    1427.078 |***                                      2
    1453.007 |***********                              7
    1479.408 |**                                       1
    1533.657 |**                                       1
    1561.523 |**                                       1
    1589.895 |***                                      2
    1648.196 |*****                                    3
    1708.634 |*****                                    3
    1739.679 |***                                      2
    1771.289 |**                                       1
    1938.162 |********                                 5
    1973.377 |***                                      2
    2238.469 |********                                 5
    2728.806 |***                                      2
    3095.377 |*****                                    3
    3574.989 |**                                       1
    4855.311 |**                                       1

SQL statistics:
    queries performed:
        read:                            17234
        write:                           4924
        other:                           2462
        total:                           24620
    transactions:                        1231   (20.40 per sec.)
    queries:                             24620  (407.91 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          60.3554s
    total number of events:              1231

Latency (ms):
         min:                                 64.54
         avg:                                489.08
         max:                               4820.09
         95th percentile:                   1170.65
         sum:                             602056.82

Threads fairness:
    events (avg/stddev):           123.1000/2.59
    execution time (avg/stddev):   60.2057/0.07

MariaDB-Galera & Ceph

DBMS : mariadb-galera (3 replica)
storage class : hdd & ceph

$ sysbench /usr/share/sysbench/oltp_read_write.lua --db-driver=mysql --threads=10 --time=60 ... --tables=10 --table_size=10000 --histogram run
sysbench 1.0.11 (using system LuaJIT 2.1.0-beta3)

Running the test with following options:
Number of threads: 10
Initializing random number generator from current time


Initializing worker threads...

Threads started!

Latency histogram (values are in milliseconds)
       value  ------------- distribution ------------- count
       8.895 |**                                       1
       9.560 |**                                       1
       9.734 |**                                       1
       9.910 |*****                                    3
      10.090 |***                                      2
      10.274 |******                                   4
      10.460 |*****                                    3
      10.651 |********                                 5
      10.844 |*************                            8
      11.041 |************************                 15
      11.242 |******************                       11
      11.446 |**************************************   24
      11.654 |**********************************       21
      11.866 |*************************************    23
      12.081 |***********************************      22
      12.301 |*************************************    23
      12.524 |*****************************            18
      12.752 |****************                         10
      12.984 |********************************         20
      13.219 |**************************               16
      13.460 |************************                 15
      13.704 |****************                         10
      13.953 |*******************                      12
      14.207 |*************************************    23
      14.465 |*****************************            18
      14.728 |**************************************   24
      14.995 |************************                 15
      15.268 |*****************************            18
      15.545 |****************                         10
      15.828 |*********************                    13
      16.115 |**************************************** 25
      16.408 |*********************                    13
      16.706 |**************************               16
      17.010 |************************                 15
      17.319 |****************                         10
      17.633 |****************                         10
      17.954 |***********                              7
      18.280 |**********                               6
      18.612 |******                                   4
      18.950 |********                                 5
      19.295 |***                                      2
      19.645 |*****                                    3
      20.002 |*****                                    3
      20.366 |********                                 5
      20.736 |********                                 5
      21.112 |******                                   4
      21.886 |**                                       1
      22.284 |**                                       1
      22.689 |*****                                    3
      23.948 |*****                                    3
      24.384 |*****                                    3
      24.827 |******                                   4
      25.278 |**                                       1
      25.737 |*****                                    3
      27.659 |***                                      2
      29.725 |**                                       1
      31.375 |*****                                    3
      33.116 |******                                   4
      33.718 |**                                       1
      34.330 |**                                       1
      36.236 |**                                       1
      38.247 |**                                       1
      38.942 |**                                       1
      49.213 |**                                       1
      50.107 |**                                       1
      51.018 |**********                               6
      52.889 |**                                       1
      53.850 |**                                       1
      54.828 |**                                       1
      55.824 |********                                 5
      56.839 |**                                       1
      64.474 |******                                   4
      65.645 |**********                               6
      66.838 |***                                      2
      69.289 |**                                       1
      71.830 |*****                                    3
      73.135 |*****                                    3
      80.025 |**                                       1
      81.479 |**                                       1
      92.424 |**                                       1
      94.104 |**                                       1
     104.840 |***                                      2
     106.745 |********                                 5
     108.685 |***                                      2
     116.802 |*****                                    3
     118.924 |**                                       1
     123.285 |*****                                    3
     125.525 |********                                 5
     130.128 |**                                       1
     144.974 |**********                               6
     158.632 |********                                 5
     183.211 |*****                                    3
     204.114 |******                                   4
     207.823 |**                                       1
     211.599 |**********                               6
     248.825 |**                                       1
     272.267 |******                                   4
     277.214 |**                                       1
     331.907 |********                                 5
     337.938 |******                                   4
     350.330 |******                                   4
     356.695 |*************                            8
     363.176 |***                                      2
     369.775 |**********                               6
     376.494 |******                                   4
     383.334 |**********                               6
     390.299 |***********                              7
     397.391 |**************                           9
     404.611 |********                                 5
     411.963 |***                                      2
     434.829 |***                                      2
     442.730 |*****                                    3
     450.774 |***                                      2
     458.964 |**********                               6
     467.304 |**********                               6
     475.794 |*****                                    3
     484.439 |***                                      2
     493.242 |********                                 5
     502.204 |**********                               6
     530.078 |***                                      2
     539.710 |**                                       1
     549.516 |********                                 5
     559.501 |*************                            8
     569.667 |*****                                    3
     580.017 |*****                                    3
     590.556 |***                                      2
     612.211 |**                                       1
     623.335 |**                                       1
     634.661 |********                                 5
     646.192 |*************                            8
     657.933 |*****                                    3
     669.888 |**                                       1
     694.452 |******                                   4
     719.917 |******                                   4
     732.998 |******                                   4
     746.316 |***                                      2
     759.876 |***                                      2
     773.683 |**********                               6
     787.741 |******                                   4
     802.053 |******                                   4
     816.626 |**************                           9
     831.464 |**                                       1
     846.572 |****************                         10
     861.954 |***                                      2
     877.615 |*****                                    3
     893.561 |**                                       1
     926.327 |********                                 5
     943.158 |**                                       1
     960.295 |*****                                    3
     977.743 |********                                 5
     995.508 |******************                       11
    1013.597 |********                                 5
    1032.013 |*****                                    3
    1050.764 |***                                      2
    1069.856 |***                                      2
    1089.295 |****************                         10
    1109.087 |**                                       1
    1129.239 |*************                            8
    1170.648 |***                                      2
    1258.076 |***                                      2
    1327.905 |**                                       1
    1352.033 |********                                 5
    1376.599 |*******************                      12
    1401.611 |***                                      2
    1427.078 |*************                            8
    1479.408 |*****                                    3
    1506.288 |********                                 5
    1533.657 |*******************                      12
    1561.523 |*****                                    3
    1648.196 |***                                      2
    1678.143 |***                                      2
    1708.634 |***********                              7
    1739.679 |********                                 5
    1771.289 |******                                   4
    1803.472 |********                                 5
    1903.575 |*****                                    3
    1973.377 |**                                       1
    2009.233 |**                                       1
    2045.740 |***                                      2
    2082.910 |***********                              7
    2120.756 |**                                       1
    2159.289 |*************                            8
    2198.523 |******                                   4
    2238.469 |**                                       1
    2405.646 |********                                 5
    2493.859 |***                                      2
    2585.308 |**                                       1
    2632.282 |**                                       1
    2778.387 |*****                                    3
    2932.602 |**                                       1
    3040.139 |**                                       1
    3386.993 |**                                       1
    3448.533 |**                                       1
    3574.989 |**                                       1
    3639.945 |***********                              7
    3706.081 |**                                       1
    3773.420 |**                                       1
    4055.231 |*****                                    3
    4128.913 |*****                                    3
    4437.275 |********                                 5
    4599.987 |*****                                    3
    4855.311 |***                                      2
    4943.530 |**********                               6
    5033.352 |**                                       1
    5124.806 |**                                       1
    5507.544 |***                                      2
    6713.971 |***                                      2
    7215.393 |**                                       1
    9284.145 |*****                                    3

SQL statistics:
    queries performed:
        read:                            15162
        write:                           3509
        other:                           2969
        total:                           21640
    transactions:                        1067   (16.73 per sec.)
    queries:                             21640  (339.32 per sec.)
    ignored errors:                      16     (0.25 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          63.7729s
    total number of events:              1067

Latency (ms):
         min:                                  8.93
         avg:                                579.15
         max:                               9363.55
         95th percentile:                   2405.65
         sum:                             617956.25

Threads fairness:
    events (avg/stddev):           106.7000/10.81
    execution time (avg/stddev):   61.7956/1.50

Comment +0