Sysadmin Best way to measure the disk read/write speed and the Network in/out speed?

pamamolf · Sep 5, 2017

Hello

What's the best way to measure the hard disk read/write speed and the Network in/out speed of a server?

What do you use?

Thank you

eva2000 · Sep 5, 2017

For disk, a combination of dd, ffio and ioping and for network wget/axel benchmarks which centminmodbench.sh benchmark script does bench.centminmod.com

pamamolf · Sep 5, 2017

Is that options ok to benchmark only the hard disk read/write and network in/out speed (Europe only)?

DEBUG='n'
AUTOREPORT='y'
TESTFILE='/home/gziptest/imdb.sql'

OPENSSL_VERSION='1.0.2j'
MYSQLSLAP_SAVECSV='n'

SEVERBEAR='n'
OPENSSLBENCH='n'
OPENSSL_NONSYSTEM='n'
RUN_DISKDD='y'
RUN_DISKIOPING='y'
RUN_DISKFIO='y'
RUN_RAMDISKDD='n'
RUN_RAMDISKIOPING='n'
RUN_RAMDISKFIO='n' # disabled as tmpfs not support direct=1/buffered=0
RUN_AXELBENCH='y'
RUN_BANDWIDTHBENCH='y'
RUN_VULTRTESTS='n'
EUROPE_BANDWIDTHTESTS='y'
ASIA_BANDWIDTHTESTS='n'
AUSTRALIA_BANDWIDTHTESTS='n'
USA_BANDWIDTHTESTS='n'
RUN_PINGTESTS='y'
RUN_MYSQLSLAP='n'
RUN_PHPTESTS='n'
RUN_UNIXBENCH='n'
RUN_MTRTESTS='n'
MTR_PACKETS='10'
RUN_ENTROPYTEST='n'
ENTROPY_RUNS='4'
ENTROPYSLEEP=10
RUN_RNGTEST='n'
UNIXBENCH_VER='5.1.3'
Click to expand...

eva2000 · Sep 5, 2017

try and see

pamamolf · Sep 5, 2017

To be honest i don't have an idea where to look on the output for:

1)Disk read/write speed
2)Network card upload/download speed
-------------------------------------------
System Information
-------------------------------------------

3.10.0-514.26.2.el7.x86_64

CentOS Linux release 7.3.1611 (Core)

Centmin Mod
----------------------------------------------
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 8
On-line CPU(s) list: 0-7
Thread(s) per core: 2
Core(s) per socket: 4
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 62
Model name: Intel(R) Xeon(R) CPU E5-1410 v2 @ 2.80GHz
Stepping: 4
CPU MHz: 3100.125
BogoMIPS: 5599.55
Virtualization: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 10240K
NUMA node0 CPU(s): 0-7

CPU Flags
fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm ida arat pln pts dtherm tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt

----------------------------------------------
CPU NODE SOCKET CORE L1d:L1i:L2:L3 ONLINE
0 0 0 0 0:0:0:0 yes
1 0 0 1 1:1:1:0 yes
2 0 0 2 2:2:2:0 yes
3 0 0 3 3:3:3:0 yes
4 0 0 0 0:0:0:0 yes
5 0 0 1 1:1:1:0 yes
6 0 0 2 2:2:2:0 yes
7 0 0 3 3:3:3:0 yes

----------------------------------------------
total used free shared buff/cache available
Mem: 96471 19112 32453 113 44905 76538
Low: 96471 64018 32453
High: 0 0 0
Swap: 4095 0 4095

----------------------------------------------
Filesystem Size Used Avail Use% Mounted on
/dev/sda2 454G 219G 212G 51% /
devtmpfs 48G 0 48G 0% /dev
tmpfs 48G 0 48G 0% /dev/shm
tmpfs 48G 81M 48G 1% /run
tmpfs 48G 0 48G 0% /sys/fs/cgroup
/dev/sda1 380M 232M 124M 66% /boot
tmpfs 9.5G 0 9.5G 0% /run/user/0

[/CODE]
Code:
-------------------------------------------
disk ioping tests
-------------------------------------------


Running IOPing I/O benchmark...

IOPing I/O: ./ioping -c 10 .
4.0 KiB from . (ext4 /dev/sda2): request=1 time=51 us
4.0 KiB from . (ext4 /dev/sda2): request=2 time=81 us
4.0 KiB from . (ext4 /dev/sda2): request=3 time=101 us
4.0 KiB from . (ext4 /dev/sda2): request=4 time=70 us
4.0 KiB from . (ext4 /dev/sda2): request=5 time=84 us
4.0 KiB from . (ext4 /dev/sda2): request=6 time=81 us
4.0 KiB from . (ext4 /dev/sda2): request=7 time=64 us
4.0 KiB from . (ext4 /dev/sda2): request=8 time=82 us
4.0 KiB from . (ext4 /dev/sda2): request=9 time=71 us
4.0 KiB from . (ext4 /dev/sda2): request=10 time=82 us

--- . (ext4 /dev/sda2) ioping statistics ---
10 requests completed in 9.0 s, 13.0 k iops, 50.9 MiB/s
min/avg/max/mdev = 51 us / 76 us / 101 us / 12 us

IOPing seek rate: ./ioping -RD .

--- . (ext4 /dev/sda2) ioping statistics ---
71.6 k requests completed in 3.0 s, 24.9 k iops, 97.3 MiB/s
min/avg/max/mdev = 34 us / 40 us / 5.0 ms / 25 us

IOPing sequential: ./ioping -RL .

--- . (ext4 /dev/sda2) ioping statistics ---
10.9 k requests completed in 3.0 s, 4.0 k iops, 996.6 MiB/s
min/avg/max/mdev = 227 us / 250 us / 18.1 ms / 240 us

IOPing cached: ./ioping -RC .

--- . (ext4 /dev/sda2) ioping statistics ---
4.3 M requests completed in 3.0 s, 1.6 M iops, 6.1 GiB/s
min/avg/max/mdev = 0 us / 0 us / 46 us / 0 us
Code:
-------------------------------------------
disk DD tests
-------------------------------------------

dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 3.81478 s, 281 MB/s

dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 2.66301 s, 403 MB/s

dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.15762 s, 498 MB/s

dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 4.34996 s, 247 MB/s
Code:
-------------------------------------------
disk FIO tests
-------------------------------------------


Running FIO benchmark...


FIO random reads:
randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
randomreads: Laying out IO file(s) (1 file(s) / 1024MB)

randomreads: (groupid=0, jobs=1): err= 0: pid=38421: Tue Sep  5 00:18:41 2017
  read : io=1024.3MB, bw=398340KB/s, iops=99584 , runt=  2633msec
  cpu          : usr=11.36%, sys=43.05%, ctx=50396, majf=0, minf=84
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1024.3MB, aggrb=398339KB/s, minb=398339KB/s, maxb=398339KB/s, mint=2633msec, maxt=2633msec

Disk stats (read/write):
  sda: ios=254985/10, merge=0/70, ticks=160695/4, in_queue=160738, util=96.28%

FIO random writes:
randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process

randomwrites: (groupid=0, jobs=1): err= 0: pid=38452: Tue Sep  5 00:18:55 2017
  write: io=1024.3MB, bw=79205KB/s, iops=19801 , runt= 13242msec
  cpu          : usr=2.87%, sys=12.98%, ctx=49247, majf=0, minf=19
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=1024.3MB, aggrb=79204KB/s, minb=79204KB/s, maxb=79204KB/s, mint=13242msec, maxt=13242msec

Disk stats (read/write):
  sda: ios=15/261547, merge=0/250, ticks=58/826390, in_queue=826684, util=99.30%
umount: /ramdisk0: mountpoint not found
Code:
-------------------------------------------
Running bandwidth benchmark...
-------------------------------------------

----------------------------------------------
Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
Download Cachefly: 111MB/s

-------------------------------------------
Europe bandwidth tests...
-------------------------------------------

----------------------------------------------
Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
Download Linode, London, UK: 53.9MB/s
----------------------------------------------
Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
Download OVH, Paris, France: 86.1MB/s
----------------------------------------------
Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
Download SmartDC, Rotterdam, Netherlands: 75.0MB/s
Code:
-------------------------------------------
Running Axel multi-threaded bandwidth benchmark...
-------------------------------------------

----------------------------------------------
Axel Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
Axel Download Cachefly: 101.25MB/s

-------------------------------------------
Europe bandwidth tests...
-------------------------------------------

----------------------------------------------
Axel Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
Axel Download Linode, London, UK: 40.63MB/s
----------------------------------------------
Axel Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
Axel Download OVH, Paris, France: 97.39MB/s
----------------------------------------------
Axel Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
Axel Download SmartDC, Rotterdam, Netherlands: 73.29MB/s
-------------------------------------------
centminmodbench.sh completed
-------------------------------------------
Click to expand...

eva2000 · Sep 5, 2017

it's all there, read the ffio, ioping, dd and wget, axel manuals though wget, axel and dd are straight forward

for ffio, bw= and iops= lines etc

pamamolf · Sep 5, 2017

Damn it seems confusing

read : io=1024.3MB, bw=398340KB/s, iops=99584 , runt= 2633msec
Click to expand...

Read: 398.34 MB
Read iops: 99584

write: io=1024.3MB, bw=79205KB/s, iops=19801 , runt= 13242msec
Click to expand...

Write speed: 79.205 MB
Write iops: 19801

Is that correct?

For dd what's the read and write?

dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 3.81478 s, 281 MB/s

dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 2.66301 s, 403 MB/s

dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.15762 s, 498 MB/s

dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 4.34996 s, 247 MB/s
Click to expand...

For the network card the higher speed is the maximum download speed?

Axel Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
Axel Download Cachefly: 101.25MB/s
Click to expand...

Download: 100MB/s so around 800Mbit?

Upload speed?

Log in / Register

Forums

Join the community today

Sysadmin Best way to measure the disk read/write speed and the Network in/out speed?

pamamolf Well-Known Member

eva2000 Administrator Staff Member

pamamolf Well-Known Member

eva2000 Administrator Staff Member

pamamolf Well-Known Member

eva2000 Administrator Staff Member

pamamolf Well-Known Member

.

Log in / Register

Useful Searches

Join the community today

Sysadmin Best way to measure the disk read/write speed and the Network in/out speed?

pamamolf Well-Known Member

eva2000 Administrator Staff Member

pamamolf Well-Known Member

eva2000 Administrator Staff Member

pamamolf Well-Known Member

eva2000 Administrator Staff Member

pamamolf Well-Known Member

.