본문 바로가기
개발 및 운영

dHCI Storage Benchmark

by Joseph.Lee 2024. 4. 24.

구성

서버 : DL380 Gen10Plus * 4ea

- Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz * 2

스토리지 : Nimble Storage

- Alletra 5030

- SSD cache (Flash Array 1.44TB (3x480GB) SATA 6G FIO Cache Bundle * 1ea /  Flash Array 2.88TB (3x960GB) SATA 6G FIO Cache Bundle * 1ea), total 4.3TB cache

- HDD : SAS 12G 2TB * 21ea (total 42TB)

 

 

READ RANDOM IOPS : 4k
# fio --randrepeat=0 --verify=0 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=read_iops --filename=./data.bin --bs=4K --iodepth=64 --size=10G --readwrite=randread --time_based --ramp_
time=2s --runtime=15s
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.13
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=289MiB/s][r=73.0k IOPS][eta 00m:00s]
read_iops: (groupid=0, jobs=1): err= 0: pid=194: Wed Apr 24 09:33:33 2024
  read: IOPS=72.9k, BW=285MiB/s (299MB/s)(4273MiB/15003msec)
   bw (  KiB/s): min=279368, max=299448, per=100.00%, avg=291693.07, stdev=4719.63, samples=30
   iops        : min=69842, max=74862, avg=72923.33, stdev=1179.87, samples=30
  cpu          : usr=4.54%, sys=16.40%, ctx=77614, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1093850,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=285MiB/s (299MB/s), 285MiB/s-285MiB/s (299MB/s-299MB/s), io=4273MiB (4481MB), run=15003-15003msec

Disk stats (read/write):
  sdg: ios=1226772/3, merge=0/1, ticks=1042598/3, in_queue=1042601, util=99.47%
READ RANDOM IOPS : 16k
# fio --randrepeat=0 --verify=0 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=read_iops --filename=./data.bin --bs=128K --iodepth=64 --size=10G --readwrite=randread --time_based --ram
p_time=2s --runtime=15s
read_iops: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=64
fio-3.13
Starting 1 process
Jobs: 1 (f=1): [r(1)][100.0%][r=478MiB/s][r=3822 IOPS][eta 00m:00s]
read_iops: (groupid=0, jobs=1): err= 0: pid=60: Wed Apr 24 09:28:13 2024
  read: IOPS=3784, BW=474MiB/s (497MB/s)(7125MiB/15046msec)
   bw (  KiB/s): min=472576, max=499712, per=100.00%, avg=485358.93, stdev=7373.74, samples=30
   iops        : min= 3692, max= 3904, avg=3791.87, stdev=57.61, samples=30
  cpu          : usr=0.25%, sys=1.73%, ctx=7442, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=56935,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=474MiB/s (497MB/s), 474MiB/s-474MiB/s (497MB/s-497MB/s), io=7125MiB (7471MB), run=15046-15046msec

Disk stats (read/write):
  sdg: ios=64518/0, merge=0/0, ticks=1085571/0, in_queue=1085571, util=99.46%
READ SEQ : 4k
# fio --randrepeat=0 --verify=0 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=seq_read --filename=./data.bin --bs=4K --iodepth=64 --size=10G --readwrite=read --time_based --ramp_time=
2s --runtime=15s
seq_read: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.13
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=134MiB/s][r=34.3k IOPS][eta 00m:00s]
seq_read: (groupid=0, jobs=1): err= 0: pid=79: Wed Apr 24 09:30:07 2024
  read: IOPS=31.1k, BW=121MiB/s (127MB/s)(1821MiB/15005msec)
   bw (  KiB/s): min=83600, max=169560, per=100.00%, avg=124271.23, stdev=24550.74, samples=30
   iops        : min=20900, max=42390, avg=31067.80, stdev=6137.66, samples=30
  cpu          : usr=1.95%, sys=7.10%, ctx=35404, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=466077,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=121MiB/s (127MB/s), 121MiB/s-121MiB/s (127MB/s-127MB/s), io=1821MiB (1909MB), run=15005-15005msec

Disk stats (read/write):
  sdg: ios=515677/0, merge=0/0, ticks=1072393/0, in_queue=1072392, util=99.47%
READ SEQ : 16k
# fio --randrepeat=0 --verify=0 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=seq_read --filename=./data.bin --bs=16K --iodepth=64 --size=10G --readwrite=read --time_based --ramp_time
=2s --runtime=15s
seq_read: (g=0): rw=read, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=libaio, iodepth=64
fio-3.13
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=850MiB/s][r=54.4k IOPS][eta 00m:00s]
seq_read: (groupid=0, jobs=1): err= 0: pid=98: Wed Apr 24 09:30:32 2024
  read: IOPS=48.5k, BW=758MiB/s (795MB/s)(11.1GiB/15002msec)
   bw (  KiB/s): min=576352, max=974592, per=100.00%, avg=776120.53, stdev=110345.74, samples=30
   iops        : min=36022, max=60912, avg=48507.53, stdev=6896.61, samples=30
  cpu          : usr=2.60%, sys=12.85%, ctx=80911, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=727613,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=758MiB/s (795MB/s), 758MiB/s-758MiB/s (795MB/s-795MB/s), io=11.1GiB (11.9GB), run=15002-15002msec

Disk stats (read/write):
  sdg: ios=812829/0, merge=0/0, ticks=1073975/0, in_queue=1073975, util=99.46%
READ SEQ : 128k
# fio --randrepeat=0 --verify=0 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=seq_read --filename=./data.bin --bs=128K --iodepth=64 --size=10G --readwrite=read --time_based --ramp_tim
e=2s --runtime=15s
seq_read: (g=0): rw=read, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=libaio, iodepth=64
fio-3.13
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=1004MiB/s][r=8032 IOPS][eta 00m:00s]
seq_read: (groupid=0, jobs=1): err= 0: pid=117: Wed Apr 24 09:31:04 2024
  read: IOPS=8406, BW=1051MiB/s (1102MB/s)(15.4GiB/15043msec)
   bw (  MiB/s): min=  790, max= 1543, per=100.00%, avg=1053.83, stdev=154.19, samples=30
   iops        : min= 6324, max=12352, avg=8430.73, stdev=1233.73, samples=30
  cpu          : usr=0.48%, sys=3.44%, ctx=18250, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=126463,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1051MiB/s (1102MB/s), 1051MiB/s-1051MiB/s (1102MB/s-1102MB/s), io=15.4GiB (16.6GB), run=15043-15043msec

Disk stats (read/write):
  sdg: ios=139261/0, merge=0/0, ticks=1084613/0, in_queue=1084614, util=99.46%
RAND RW : 4k
# fio --randrepeat=0 --verify=0 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=randrw --filename=./data.bin --bs=4K --iodepth=64 --size=10G --readwrite=randrw --time_based --ramp_time=
2s --runtime=15s
randrw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.13
Starting 1 process
Jobs: 1 (f=1): [m(1)][100.0%][r=118MiB/s,w=118MiB/s][r=30.2k,w=30.1k IOPS][eta 00m:00s]
randrw: (groupid=0, jobs=1): err= 0: pid=155: Wed Apr 24 09:32:16 2024
  read: IOPS=29.9k, BW=117MiB/s (123MB/s)(1755MiB/15020msec)
   bw (  KiB/s): min=116464, max=122672, per=100.00%, avg=119791.27, stdev=1706.27, samples=30
   iops        : min=29116, max=30668, avg=29947.80, stdev=426.58, samples=30
  write: IOPS=29.9k, BW=117MiB/s (122MB/s)(1753MiB/15020msec); 0 zone resets
   bw (  KiB/s): min=117688, max=122504, per=100.00%, avg=119625.93, stdev=1370.30, samples=30
   iops        : min=29422, max=30626, avg=29906.47, stdev=342.58, samples=30
  cpu          : usr=3.76%, sys=13.59%, ctx=68491, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=449245,448631,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=117MiB/s (123MB/s), 117MiB/s-117MiB/s (123MB/s-123MB/s), io=1755MiB (1840MB), run=15020-15020msec
  WRITE: bw=117MiB/s (122MB/s), 117MiB/s-117MiB/s (122MB/s-122MB/s), io=1753MiB (1838MB), run=15020-15020msec

Disk stats (read/write):
  sdg: ios=507685/506974, merge=0/3, ticks=730375/331132, in_queue=1061507, util=99.47%
RAND RW : 16k
# fio --randrepeat=0 --verify=0 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=randrw --filename=./data.bin --bs=16K --iodepth=64 --size=10G --readwrite=randrw --time_based --ramp_time
=2s --runtime=15s
randrw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=libaio, iodepth=64
fio-3.13
Starting 1 process
Jobs: 1 (f=1): [m(1)][100.0%][r=260MiB/s,w=260MiB/s][r=16.6k,w=16.6k IOPS][eta 00m:00s]
randrw: (groupid=0, jobs=1): err= 0: pid=174: Wed Apr 24 09:32:56 2024
  read: IOPS=17.3k, BW=270MiB/s (283MB/s)(4052MiB/15017msec)
   bw (  KiB/s): min=236032, max=343040, per=100.00%, avg=276579.20, stdev=27870.12, samples=30
   iops        : min=14752, max=21440, avg=17286.27, stdev=1741.90, samples=30
  write: IOPS=17.2k, BW=269MiB/s (282MB/s)(4039MiB/15017msec); 0 zone resets
   bw (  KiB/s): min=236960, max=342880, per=100.00%, avg=275652.27, stdev=27764.80, samples=30
   iops        : min=14810, max=21430, avg=17228.27, stdev=1735.30, samples=30
  cpu          : usr=2.15%, sys=10.01%, ctx=43089, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=259291,258452,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=270MiB/s (283MB/s), 270MiB/s-270MiB/s (283MB/s-283MB/s), io=4052MiB (4249MB), run=15017-15017msec
  WRITE: bw=269MiB/s (282MB/s), 269MiB/s-269MiB/s (282MB/s-282MB/s), io=4039MiB (4235MB), run=15017-15017msec

Disk stats (read/write):
  sdg: ios=300752/300252, merge=0/3, ticks=719541/350759, in_queue=1070301, util=99.47%

 

 

 

반응형

'개발 및 운영' 카테고리의 다른 글

Intel AMT 개발 Summary  (0) 2024.02.03
pre-decompress linux kernel 디버깅  (0) 2023.11.30
UEFI development with Go-lang  (0) 2023.11.14
메일서버 (SMAP/IMAP) 종류  (0) 2023.02.04
[임시] OpenWRT + Active Directory (AD) 구축  (0) 2022.07.12

관련글

댓글

티스토리툴바