테스트 환경
- NAS: DS1618+
- NETWORK: 10Gbps
- Storage Pool: SHR
- DISK: HC550 (7200rpm 512MB) * 4
Seq Read
seq-read: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process
seq-read: (groupid=0, jobs=1): err= 0: pid=51: Mon May 5 11:41:57 2025
read: IOPS=60.3k, BW=236MiB/s (247MB/s)(2356MiB/10001msec)
slat (usec): min=4, max=836, avg= 8.19, stdev= 6.49
clat (usec): min=218, max=35524, avg=1051.99, stdev=699.26
lat (usec): min=232, max=35531, avg=1060.50, stdev=699.38
clat percentiles (usec):
| 1.00th=[ 515], 5.00th=[ 545], 10.00th=[ 578], 20.00th=[ 635],
| 30.00th=[ 701], 40.00th=[ 775], 50.00th=[ 873], 60.00th=[ 1037],
| 70.00th=[ 1254], 80.00th=[ 1450], 90.00th=[ 1663], 95.00th=[ 1860],
| 99.00th=[ 2409], 99.50th=[ 3195], 99.90th=[ 6980], 99.95th=[13435],
| 99.99th=[35390]
bw ( KiB/s): min=191688, max=290416, per=99.98%, avg=241189.95, stdev=33437.21, samples=20
iops : min=47922, max=72604, avg=60297.45, stdev=8359.27, samples=20
lat (usec) : 250=0.01%, 500=0.32%, 750=36.61%, 1000=20.98%
lat (msec) : 2=38.86%, 4=2.86%, 10=0.31%, 20=0.06%, 50=0.01%
cpu : usr=15.35%, sys=49.25%, ctx=17404, majf=0, minf=4
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=123.1%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwts: total=603113,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=236MiB/s (247MB/s), 236MiB/s-236MiB/s (247MB/s-247MB/s), io=2356MiB (2471MB), run=10001-10001msec
Seq Write
seq-write: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process
seq-write: Laying out IO file (1 file / 1024MiB)
seq-write: (groupid=0, jobs=1): err= 0: pid=54: Mon May 5 11:42:14 2025
write: IOPS=39.3k, BW=154MiB/s (161MB/s)(1537MiB/10001msec)
slat (usec): min=7, max=4091, avg=17.99, stdev=11.28
clat (usec): min=349, max=50306, avg=1607.69, stdev=1182.28
lat (usec): min=379, max=50318, avg=1626.12, stdev=1182.71
clat percentiles (usec):
| 1.00th=[ 840], 5.00th=[ 947], 10.00th=[ 1012], 20.00th=[ 1123],
| 30.00th=[ 1237], 40.00th=[ 1319], 50.00th=[ 1418], 60.00th=[ 1516],
| 70.00th=[ 1631], 80.00th=[ 1827], 90.00th=[ 2180], 95.00th=[ 2671],
| 99.00th=[ 5473], 99.50th=[ 6652], 99.90th=[14615], 99.95th=[23987],
| 99.99th=[49021]
bw ( KiB/s): min=118403, max=208944, per=100.00%, avg=158491.79, stdev=22435.17, samples=19
iops : min=29600, max=52236, avg=39622.89, stdev=5608.85, samples=19
lat (usec) : 500=0.01%, 750=0.38%, 1000=8.95%
lat (msec) : 2=76.77%, 4=11.79%, 10=1.90%, 20=0.15%, 50=0.07%
lat (msec) : 100=0.01%
cpu : usr=13.60%, sys=68.29%, ctx=26071, majf=0, minf=4
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=122.5%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwts: total=0,393294,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=154MiB/s (161MB/s), 154MiB/s-154MiB/s (161MB/s-161MB/s), io=1537MiB (1611MB), run=10001-10001msec
Rand Read
rand-read: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process
rand-read: Laying out IO file (1 file / 1024MiB)
rand-read: (groupid=0, jobs=1): err= 0: pid=57: Mon May 5 11:42:38 2025
read: IOPS=50.1k, BW=196MiB/s (205MB/s)(1956MiB/10002msec)
slat (usec): min=4, max=815, avg=10.14, stdev= 8.04
clat (usec): min=295, max=18735, avg=1266.65, stdev=581.44
lat (usec): min=325, max=18747, avg=1277.20, stdev=582.12
clat percentiles (usec):
| 1.00th=[ 586], 5.00th=[ 693], 10.00th=[ 775], 20.00th=[ 889],
| 30.00th=[ 996], 40.00th=[ 1090], 50.00th=[ 1188], 60.00th=[ 1287],
| 70.00th=[ 1401], 80.00th=[ 1532], 90.00th=[ 1762], 95.00th=[ 2057],
| 99.00th=[ 2966], 99.50th=[ 3523], 99.90th=[ 7046], 99.95th=[10683],
| 99.99th=[16581]
bw ( KiB/s): min=160520, max=214800, per=100.00%, avg=200266.55, stdev=13813.72, samples=20
iops : min=40130, max=53700, avg=50066.70, stdev=3453.50, samples=20
lat (usec) : 500=0.12%, 750=8.35%, 1000=22.39%
lat (msec) : 2=63.65%, 4=5.16%, 10=0.28%, 20=0.07%
cpu : usr=15.60%, sys=52.62%, ctx=52285, majf=0, minf=3
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=119.9%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwts: total=500715,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: bw=196MiB/s (205MB/s), 196MiB/s-196MiB/s (205MB/s-205MB/s), io=1956MiB (2051MB), run=10002-10002msec
Rand Write
rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.6
Starting 1 process
rand-write: Laying out IO file (1 file / 1024MiB)
rand-write: (groupid=0, jobs=1): err= 0: pid=60: Mon May 5 11:42:52 2025
write: IOPS=34.1k, BW=133MiB/s (140MB/s)(1333MiB/10001msec)
slat (usec): min=8, max=1978, avg=20.61, stdev=10.54
clat (usec): min=462, max=40637, avg=1853.54, stdev=1137.70
lat (usec): min=482, max=40654, avg=1874.65, stdev=1138.69
clat percentiles (usec):
| 1.00th=[ 898], 5.00th=[ 1037], 10.00th=[ 1123], 20.00th=[ 1254],
| 30.00th=[ 1401], 40.00th=[ 1565], 50.00th=[ 1663], 60.00th=[ 1762],
| 70.00th=[ 1942], 80.00th=[ 2212], 90.00th=[ 2573], 95.00th=[ 3228],
| 99.00th=[ 5800], 99.50th=[ 7308], 99.90th=[12649], 99.95th=[18220],
| 99.99th=[39060]
bw ( KiB/s): min=96463, max=203704, per=99.96%, avg=136421.30, stdev=30274.86, samples=20
iops : min=24115, max=50926, avg=34105.25, stdev=7568.76, samples=20
lat (usec) : 500=0.01%, 750=0.25%, 1000=2.62%
lat (msec) : 2=69.90%, 4=24.48%, 10=2.59%, 20=0.14%, 50=0.04%
cpu : usr=12.60%, sys=66.98%, ctx=24956, majf=0, minf=4
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=117.7%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued rwts: total=0,341151,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=133MiB/s (140MB/s), 133MiB/s-133MiB/s (140MB/s-140MB/s), io=1333MiB (1398MB), run=10001-10001msec
Cache도 없고 direct 으로 했는데 왜이리 rand io 가 빠른지 모르겠다.. 중간에 어디선가 캐싱되는듯...
반응형
'개발 및 운영 > Kubernetes' 카테고리의 다른 글
rook-ceph external cluster 사용 시 rook-ceph-mgr-external 생성 실패시 (0) | 2023.11.22 |
---|---|
kubernetes sysctl (0) | 2023.05.24 |
Kubernetes 에서 Node 죽었을 때 PV가 있는 파드가 스케쥴링 되지 않는 현상 (0) | 2022.12.27 |
RKE2 의 API 서버 접속 방법 (왜 127.0.0.1:6443 인가?) (0) | 2022.10.26 |
EJBCA-CE Docker with HSM on Kubernetes (1) | 2022.10.03 |
댓글