synology-csi fio 테스트

테스트 환경

• NAS: DS1618+
• NETWORK: 10Gbps
• Storage Pool: SHR
• DISK: HC550 (7200rpm 512MB) * 4

Seq Read

seq-read: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process

seq-read: (groupid=0, jobs=1): err= 0: pid=51: Mon May  5 11:41:57 2025
   read: IOPS=60.3k, BW=236MiB/s (247MB/s)(2356MiB/10001msec)
    slat (usec): min=4, max=836, avg= 8.19, stdev= 6.49
    clat (usec): min=218, max=35524, avg=1051.99, stdev=699.26
     lat (usec): min=232, max=35531, avg=1060.50, stdev=699.38
    clat percentiles (usec):
     |  1.00th=[  515],  5.00th=[  545], 10.00th=[  578], 20.00th=[  635],
     | 30.00th=[  701], 40.00th=[  775], 50.00th=[  873], 60.00th=[ 1037],
     | 70.00th=[ 1254], 80.00th=[ 1450], 90.00th=[ 1663], 95.00th=[ 1860],
     | 99.00th=[ 2409], 99.50th=[ 3195], 99.90th=[ 6980], 99.95th=[13435],
     | 99.99th=[35390]
   bw (  KiB/s): min=191688, max=290416, per=99.98%, avg=241189.95, stdev=33437.21, samples=20
   iops        : min=47922, max=72604, avg=60297.45, stdev=8359.27, samples=20
  lat (usec)   : 250=0.01%, 500=0.32%, 750=36.61%, 1000=20.98%
  lat (msec)   : 2=38.86%, 4=2.86%, 10=0.31%, 20=0.06%, 50=0.01%
  cpu          : usr=15.35%, sys=49.25%, ctx=17404, majf=0, minf=4
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=123.1%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=603113,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=236MiB/s (247MB/s), 236MiB/s-236MiB/s (247MB/s-247MB/s), io=2356MiB (2471MB), run=10001-10001msec

Seq Write

seq-write: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process
seq-write: Laying out IO file (1 file / 1024MiB)

seq-write: (groupid=0, jobs=1): err= 0: pid=54: Mon May  5 11:42:14 2025
  write: IOPS=39.3k, BW=154MiB/s (161MB/s)(1537MiB/10001msec)
    slat (usec): min=7, max=4091, avg=17.99, stdev=11.28
    clat (usec): min=349, max=50306, avg=1607.69, stdev=1182.28
     lat (usec): min=379, max=50318, avg=1626.12, stdev=1182.71
    clat percentiles (usec):
     |  1.00th=[  840],  5.00th=[  947], 10.00th=[ 1012], 20.00th=[ 1123],
     | 30.00th=[ 1237], 40.00th=[ 1319], 50.00th=[ 1418], 60.00th=[ 1516],
     | 70.00th=[ 1631], 80.00th=[ 1827], 90.00th=[ 2180], 95.00th=[ 2671],
     | 99.00th=[ 5473], 99.50th=[ 6652], 99.90th=[14615], 99.95th=[23987],
     | 99.99th=[49021]
   bw (  KiB/s): min=118403, max=208944, per=100.00%, avg=158491.79, stdev=22435.17, samples=19
   iops        : min=29600, max=52236, avg=39622.89, stdev=5608.85, samples=19
  lat (usec)   : 500=0.01%, 750=0.38%, 1000=8.95%
  lat (msec)   : 2=76.77%, 4=11.79%, 10=1.90%, 20=0.15%, 50=0.07%
  lat (msec)   : 100=0.01%
  cpu          : usr=13.60%, sys=68.29%, ctx=26071, majf=0, minf=4
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=122.5%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,393294,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=154MiB/s (161MB/s), 154MiB/s-154MiB/s (161MB/s-161MB/s), io=1537MiB (1611MB), run=10001-10001msec

Rand Read

rand-read: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process
rand-read: Laying out IO file (1 file / 1024MiB)

rand-read: (groupid=0, jobs=1): err= 0: pid=57: Mon May  5 11:42:38 2025
   read: IOPS=50.1k, BW=196MiB/s (205MB/s)(1956MiB/10002msec)
    slat (usec): min=4, max=815, avg=10.14, stdev= 8.04
    clat (usec): min=295, max=18735, avg=1266.65, stdev=581.44
     lat (usec): min=325, max=18747, avg=1277.20, stdev=582.12
    clat percentiles (usec):
     |  1.00th=[  586],  5.00th=[  693], 10.00th=[  775], 20.00th=[  889],
     | 30.00th=[  996], 40.00th=[ 1090], 50.00th=[ 1188], 60.00th=[ 1287],
     | 70.00th=[ 1401], 80.00th=[ 1532], 90.00th=[ 1762], 95.00th=[ 2057],
     | 99.00th=[ 2966], 99.50th=[ 3523], 99.90th=[ 7046], 99.95th=[10683],
     | 99.99th=[16581]
   bw (  KiB/s): min=160520, max=214800, per=100.00%, avg=200266.55, stdev=13813.72, samples=20
   iops        : min=40130, max=53700, avg=50066.70, stdev=3453.50, samples=20
  lat (usec)   : 500=0.12%, 750=8.35%, 1000=22.39%
  lat (msec)   : 2=63.65%, 4=5.16%, 10=0.28%, 20=0.07%
  cpu          : usr=15.60%, sys=52.62%, ctx=52285, majf=0, minf=3
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=119.9%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=500715,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=196MiB/s (205MB/s), 196MiB/s-196MiB/s (205MB/s-205MB/s), io=1956MiB (2051MB), run=10002-10002msec

Rand Write

rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process
rand-write: Laying out IO file (1 file / 1024MiB)

rand-write: (groupid=0, jobs=1): err= 0: pid=60: Mon May  5 11:42:52 2025
  write: IOPS=34.1k, BW=133MiB/s (140MB/s)(1333MiB/10001msec)
    slat (usec): min=8, max=1978, avg=20.61, stdev=10.54
    clat (usec): min=462, max=40637, avg=1853.54, stdev=1137.70
     lat (usec): min=482, max=40654, avg=1874.65, stdev=1138.69
    clat percentiles (usec):
     |  1.00th=[  898],  5.00th=[ 1037], 10.00th=[ 1123], 20.00th=[ 1254],
     | 30.00th=[ 1401], 40.00th=[ 1565], 50.00th=[ 1663], 60.00th=[ 1762],
     | 70.00th=[ 1942], 80.00th=[ 2212], 90.00th=[ 2573], 95.00th=[ 3228],
     | 99.00th=[ 5800], 99.50th=[ 7308], 99.90th=[12649], 99.95th=[18220],
     | 99.99th=[39060]
   bw (  KiB/s): min=96463, max=203704, per=99.96%, avg=136421.30, stdev=30274.86, samples=20
   iops        : min=24115, max=50926, avg=34105.25, stdev=7568.76, samples=20
  lat (usec)   : 500=0.01%, 750=0.25%, 1000=2.62%
  lat (msec)   : 2=69.90%, 4=24.48%, 10=2.59%, 20=0.14%, 50=0.04%
  cpu          : usr=12.60%, sys=66.98%, ctx=24956, majf=0, minf=4
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=117.7%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,341151,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=133MiB/s (140MB/s), 133MiB/s-133MiB/s (140MB/s-140MB/s), io=1333MiB (1398MB), run=10001-10001msec

Cache도 없고 direct 으로 했는데 왜이리 rand io 가 빠른지 모르겠다.. 중간에 어디선가 캐싱되는듯...