Benchmarks SSDNodes ssdnodes.com upto 91% discount on KVM VPS until May 31, 2018

Just came across ssdnodes.com 7yr anniversary discount deal at The 7-Year Anniversary Sale, from SSD Nodes. Update: they extended the sale until end of May 31st - sale ends in ~22hrs. Discounts are for prepayment 1yr or 3yr in advance though. My referral link



Servers use latest Intel Xeon Gold Skylake based cpus apparently

---

Code (Text):

cat /proc/cpuinfo
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 6
model           : 94
model name      : Intel Core Processor (Skylake, IBRS)
stepping        : 3
microcode       : 0x1
cpu MHz         : 2099.998
cache size      : 4096 KB
physical id     : 0
siblings        : 4
core id         : 0
cpu cores       : 4
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
bogomips        : 4199.99
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 48 bits virtual
power management:

processor       : 1
vendor_id       : GenuineIntel
cpu family      : 6
model           : 94
model name      : Intel Core Processor (Skylake, IBRS)
stepping        : 3
microcode       : 0x1
cpu MHz         : 2099.998
cache size      : 4096 KB
physical id     : 0
siblings        : 4
core id         : 1
cpu cores       : 4
apicid          : 1
initial apicid  : 1
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
bogomips        : 4199.99
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 48 bits virtual
power management:

processor       : 2
vendor_id       : GenuineIntel
cpu family      : 6
model           : 94
model name      : Intel Core Processor (Skylake, IBRS)
stepping        : 3
microcode       : 0x1
cpu MHz         : 2099.998
cache size      : 4096 KB
physical id     : 0
siblings        : 4
core id         : 2
cpu cores       : 4
apicid          : 2
initial apicid  : 2
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
bogomips        : 4199.99
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 48 bits virtual
power management:

processor       : 3
vendor_id       : GenuineIntel
cpu family      : 6
model           : 94
model name      : Intel Core Processor (Skylake, IBRS)
stepping        : 3
microcode       : 0x1
cpu MHz         : 2099.998
cache size      : 4096 KB
physical id     : 0
siblings        : 4
core id         : 3
cpu cores       : 4
apicid          : 3
initial apicid  : 3
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
bogomips        : 4199.99
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 48 bits virtual
power management:

 

Centmin Mod 123.09beta01 Installation Times

Code (Text):

yum -y update; curl -O https://centminmod.com/betainstaller.sh && chmod 0700 betainstaller.sh && bash betainstaller.sh

Code (Text):

---------------------------------------------------------------------------
Total Curl Installer YUM or DNF Time: 175.6731 seconds
Total YUM Time: 12.901646257 seconds
Total YUM or DNF + Source Download Time: 42.8064
Total Nginx First Time Install Time: 209.7187
Total PHP First Time Install Time: 206.4821
Download Zip From Github Time: 1.4480
Total Time Other eg. source compiles: 305.9028
Total Centmin Mod Install Time: 764.9099
---------------------------------------------------------------------------
Total Install Time (curl yum + cm install + zip download): 942.0310 seconds
---------------------------------------------------------------------------
4 Intel Core Processor (Skylake, IBRS)
4 2099.998
---------------------------------------------------------------------------

Code (Text):

*************************************************
* Post-Install Check List....
*************************************************

--------------------------------------------------------
Check ccache Version:
--------------------------------------------------------
ccache version 3.4.1

Copyright (C) 2002-2007 Andrew Tridgell
Copyright (C) 2009-2018 Joel Rosdahl

This program is free software; you can redistribute it and/or modify it under
the terms of the GNU General Public License as published by the Free Software
Foundation; either version 3 of the License, or (at your option) any later
version.

--------------------------------------------------------
Check Nginx Version:
--------------------------------------------------------
nginx version: nginx/1.13.12 (290518-214917)
built by gcc 7.3.1 20180303 (Red Hat 7.3.1-5) (GCC)
built with OpenSSL 1.1.0h  27 Mar 2018
TLS SNI support enabled
configure arguments: --with-ld-opt='-ljemalloc -Wl,-z,relro -Wl,-rpath,/usr/local/lib' --with-cc-opt='-m64 -march=native -DTCP_FASTOPEN=23 -g -O3 -fstack-protector-strong -flto -fuse-ld=gold --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wimplicit-fallthrough=0 -fcode-hoisting -Wp,-D_FORTIFY_SOURCE=2 -gsplit-dwarf' --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --build=290518-214917 --with-compat --with-http_stub_status_module --with-http_secure_link_module --with-libatomic --with-http_gzip_static_module --with-http_sub_module --with-http_addition_module --with-http_image_filter_module=dynamic --with-http_geoip_module --with-stream_geoip_module --with-stream_realip_module --with-stream_ssl_preread_module --with-threads --with-stream=dynamic --with-stream_ssl_module --with-http_realip_module --add-dynamic-module=../ngx-fancyindex-0.4.2 --add-module=../ngx_cache_purge-2.4.2 --add-module=../ngx_devel_kit-0.3.0 --add-dynamic-module=../set-misc-nginx-module-0.32 --add-dynamic-module=../echo-nginx-module-0.61 --add-module=../redis2-nginx-module-0.15 --add-module=../ngx_http_redis-0.3.7 --add-module=../memc-nginx-module-0.18 --add-module=../srcache-nginx-module-0.31 --add-dynamic-module=../headers-more-nginx-module-0.33 --with-pcre=../pcre-8.42 --with-pcre-jit --with-zlib=../zlib-cloudflare-1.3.0 --with-http_ssl_module --with-http_v2_module --with-openssl=../openssl-1.1.0h --with-openssl-opt='enable-ec_nistp_64_gcc_128'

--------------------------------------------------------
Check PHP-FPM Version:
--------------------------------------------------------
PHP 5.6.36 (cli) (built: May 29 2018 21:55:41)
Copyright (c) 1997-2016 The PHP Group
Zend Engine v2.6.0, Copyright (c) 1998-2016 Zend Technologies
    with Zend OPcache v7.0.6-dev, Copyright (c) 1999-2016, by Zend Technologies

--------------------------------------------------------
Check MariaDB installed RPM Versions:
--------------------------------------------------------
MariaDB-common-10.1.33-1.el7.centos.x86_64
MariaDB-client-10.1.33-1.el7.centos.x86_64
MariaDB-devel-10.1.33-1.el7.centos.x86_64
MariaDB-compat-10.1.33-1.el7.centos.x86_64
MariaDB-server-10.1.33-1.el7.centos.x86_64
MariaDB-shared-10.1.33-1.el7.centos.x86_64

--------------------------------------------------------
Check Memcached Server Version:
--------------------------------------------------------
memcached 1.5.8

--------------------------------------------------------
Check CSF Firewall Version:
--------------------------------------------------------
csf: v12.04 (generic)

--------------------------------------------------------
Check Siege Benchmark Version:
--------------------------------------------------------
SIEGE 4.0.4

Copyright (C) 2017 by Jeffrey Fulmer, et al.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS
FOR A PARTICULAR PURPOSE.


--------------------------------------------------------
Check mysqlreport version:
--------------------------------------------------------
mysqlreport v3.5-maria11 Jul 4 2013

--------------------------------------------------------
Check pure-ftpd Version:
--------------------------------------------------------
pure-ftpd v1.0.42

--------------------------------------------------------
Check YUM Repo List
--------------------------------------------------------
Loaded plugins: fastestmirror, priorities, versionlock
Loading mirror speeds from cached hostfile
 * base: mirror.hostduplex.com
 * epel: fedora-epel.mirror.lstn.net
 * extras: repos.dfw.quadranet.com
 * rpmforge: mirror.lstn.net
 * updates: pubmirrors.dal.corespace.com
279 packages excluded due to repository priority protections
repo id                 repo name                                    status
base/7/x86_64           CentOS-7 - Base                              7,658+2,253
centos-sclo-rh/x86_64   CentOS-7 - SCLo rh                              7,371+96
centos-sclo-sclo/x86_64 CentOS-7 - SCLo sclo                                 521
*epel/x86_64            Extra Packages for Enterprise Linux 7 - x86_  11,603+974
extras/7/x86_64         CentOS-7 - Extras                                    305
mariadb                 MariaDB                                             44+2
rpmforge                RHEL 7 - RPMforge.net - dag                      136+109
updates/7/x86_64        CentOS-7 - Updates                               495+137
repolist: 28,133

--------------------------------------------------------
mytimes check:
/usr/bin/mytimes
--------------------------------------------------------
Tue May 29 21:59:17 UTC 2018    [UTC]
Wed May 30 07:59:17 AEST 2018   [Australia/Brisbane]
Tue May 29 14:59:17 PDT 2018    [America/Los_Angeles]
Tue May 29 16:59:17 CDT 2018    [America/Chicago]
Tue May 29 17:59:17 EDT 2018    [America/New_York]
Tue May 29 17:59:17 EDT 2018    [America/Montreal]
Tue May 29 22:59:17 BST 2018    [Europe/London]
Tue May 29 23:59:17 CEST 2018   [Europe/Berlin]
Wed May 30 04:59:17 +07 2018    [Asia/Bangkok]
Wed May 30 04:59:17 +07 2018    [Asia/Ho_Chi_Minh]
Wed May 30 04:59:17 WIB 2018    [Asia/Jakarta]
Wed May 30 05:59:17 +08 2018    [Asia/Kuala_Lumpur]
Wed May 30 05:59:17 +08 2018    [Asia/Singapore]
--------------------------------------------------------

Nginx HTTP/2 HTTPS benchmarks

https_bench.sh Nginx HTTP/2 HTTPS benchmarks.

There's 8x h2load test configurations in total. h2load HTTP/2 HTTPS load test tool will be run single threaded so tests only 1 cpu core of the system:

• h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
• h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
• h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
• h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
• h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
• h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
• h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
• h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com

Code (Text):

-------------------------------------------------------------------------------------------
System Information
-------------------------------------------------------------------------------------------

3.10.0-693.17.1.el7.x86_64

CentOS Linux release 7.5.1804 (Core)

Centmin Mod
-------------------------------------------------------------------------------------------
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                4
On-line CPU(s) list:   0-3
Thread(s) per core:    1
Core(s) per socket:    4
Socket(s):             1
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 94
Model name:            Intel Core Processor (Skylake, IBRS)
Stepping:              3
CPU MHz:               2099.998
BogoMIPS:              4199.99
Hypervisor vendor:     KVM
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              4096K
NUMA node0 CPU(s):     0-3
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1

CPU Flags
 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1

-------------------------------------------------------------------------------------------
CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
0   0    0      0    0:0:0      yes
1   0    0      1    1:1:1      yes
2   0    0      2    2:2:2      yes
3   0    0      3    3:3:3      yes

-------------------------------------------------------------------------------------------
              total        used        free      shared  buff/cache   available
Mem:          15886         831       14830          30         224       14748
Low:          15886        1055       14830
High:             0           0           0
Swap:          1023           0        1023

-------------------------------------------------------------------------------------------
Filesystem                       Size  Used Avail Use% Mounted on
/dev/mapper/centos_centos7-root   78G  6.4G   68G   9% /
devtmpfs                         7.8G     0  7.8G   0% /dev
tmpfs                            7.8G     0  7.8G   0% /dev/shm
tmpfs                            7.8G   17M  7.8G   1% /run
tmpfs                            7.8G     0  7.8G   0% /sys/fs/cgroup
/dev/sda1                       1014M  264M  751M  26% /boot
tmpfs                            1.6G     0  1.6G   0% /run/user/0
tmpfs                            7.8G  324K  7.8G   1% /tmp

Code (Text):

-------------------------------------------------------------------------------------------
nginx version: nginx/1.13.12 (290518-214917)
built by gcc 7.3.1 20180303 (Red Hat 7.3.1-5) (GCC)
built with OpenSSL 1.1.0h  27 Mar 2018
TLS SNI support enabled
configure arguments: --with-ld-opt='-ljemalloc -Wl,-z,relro -Wl,-rpath,/usr/local/lib' --with-cc-opt='-m64 -march=native -DTCP_FASTOPEN=23 -g -O3 -fstack-protector-strong -flto -fuse-ld=gold --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wimplicit-fallthrough=0 -fcode-hoisting -Wp,-D_FORTIFY_SOURCE=2 -gsplit-dwarf' --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --build=290518-214917 --with-compat --with-http_stub_status_module --with-http_secure_link_module --with-libatomic --with-http_gzip_static_module --with-http_sub_module --with-http_addition_module --with-http_image_filter_module=dynamic --with-http_geoip_module --with-stream_geoip_module --with-stream_realip_module --with-stream_ssl_preread_module --with-threads --with-stream=dynamic --with-stream_ssl_module --with-http_realip_module --add-dynamic-module=../ngx-fancyindex-0.4.2 --add-module=../ngx_cache_purge-2.4.2 --add-module=../ngx_devel_kit-0.3.0 --add-dynamic-module=../set-misc-nginx-module-0.32 --add-dynamic-module=../echo-nginx-module-0.61 --add-module=../redis2-nginx-module-0.15 --add-module=../ngx_http_redis-0.3.7 --add-module=../memc-nginx-module-0.18 --add-module=../srcache-nginx-module-0.31 --add-dynamic-module=../headers-more-nginx-module-0.33 --with-pcre=../pcre-8.42 --with-pcre-jit --with-zlib=../zlib-cloudflare-1.3.0 --with-http_ssl_module --with-http_v2_module --with-openssl=../openssl-1.1.0h --with-openssl-opt='enable-ec_nistp_64_gcc_128'

Code (Text):

-------------------------------------------------------------------------------------------
h2load --version
h2load nghttp2/1.31.1
-------------------------------------------------------------------------------------------

h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-RSA-AES128-GCM-SHA256
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 219.29ms, 4560.17 req/s, 9.89MB/s
requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                     min         max         mean         sd        +/- sd
time for request:     3.04ms     37.92ms     11.03ms      3.71ms    62.20%
time for connect:    30.98ms     83.37ms     63.77ms     18.31ms    63.00%
time to 1st byte:    38.47ms     98.69ms     76.83ms     22.19ms    69.00%
req/s           :      46.28      111.96       65.50       26.73    69.00%
-------------------------------------------------------------------------------------------

h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-RSA-AES256-GCM-SHA384
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 305.36ms, 3274.78 req/s, 7.10MB/s
requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                     min         max         mean         sd        +/- sd
time for request:      678us     46.22ms     17.10ms      7.07ms    71.90%
time for connect:    14.89ms    112.99ms     86.67ms     28.69ms    83.00%
time to 1st byte:    24.06ms    139.42ms    111.26ms     36.50ms    85.00%
req/s           :      33.31      175.96       54.34       48.31    85.00%
-------------------------------------------------------------------------------------------

Code (Text):

h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-ECDSA-AES128-GCM-SHA256
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 225.36ms, 4437.34 req/s, 9.62MB/s
requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                     min         max         mean         sd        +/- sd
time for request:     1.23ms     24.44ms     13.11ms      5.34ms    71.80%
time for connect:    42.95ms     70.45ms     62.76ms     10.23ms    76.00%
time to 1st byte:    67.43ms     81.44ms     74.18ms      3.84ms    60.00%
req/s           :      45.43      108.33       56.37       21.59    84.00%
-------------------------------------------------------------------------------------------

h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-ECDSA-AES256-GCM-SHA384
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 261.21ms, 3828.26 req/s, 8.30MB/s
requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                     min         max         mean         sd        +/- sd
time for request:      307us     22.50ms     17.67ms      5.18ms    87.70%
time for connect:    40.15ms     65.14ms     59.52ms      8.42ms    83.00%
time to 1st byte:    62.68ms     81.45ms     71.14ms      5.64ms    58.00%
req/s           :      38.92      135.86       46.18       22.31    94.00%
-------------------------------------------------------------------------------------------

Code (Text):

h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-RSA-AES128-GCM-SHA256
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 1.30s, 4600.38 req/s, 9.97MB/s
requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                     min         max         mean         sd        +/- sd
time for request:      462us    123.40ms     46.25ms     12.59ms    89.88%
time for connect:    39.25ms    311.85ms    261.97ms     64.69ms    89.67%
time to 1st byte:    49.63ms    366.89ms    317.90ms     75.70ms    92.67%
req/s           :      15.44      160.96       25.95       36.38    92.67%
-------------------------------------------------------------------------------------------

h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-RSA-AES256-GCM-SHA384
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 1.16s, 5154.79 req/s, 11.17MB/s
requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                     min         max         mean         sd        +/- sd
time for request:      452us    110.39ms     38.50ms     12.47ms    85.58%
time for connect:    44.00ms    303.16ms    250.01ms     71.96ms    88.33%
time to 1st byte:    59.25ms    350.25ms    298.97ms     84.14ms    88.33%
req/s           :      17.43      112.83       28.30       29.26    88.33%
-------------------------------------------------------------------------------------------

Code (Text):

h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-ECDSA-AES128-GCM-SHA256
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 1.22s, 4920.71 req/s, 10.66MB/s
requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                     min         max         mean         sd        +/- sd
time for request:      808us     56.45ms     46.33ms     12.76ms    90.30%
time for connect:   125.46ms    247.05ms    178.62ms     31.27ms    66.67%
time to 1st byte:   181.94ms    301.46ms    215.84ms     34.09ms    87.67%
req/s           :      16.55       72.33       20.79       13.52    93.33%
-------------------------------------------------------------------------------------------

h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
TLS Protocol: TLSv1.2
Cipher: ECDHE-ECDSA-AES256-GCM-SHA384
Server Temp Key: ECDH P-256 256 bits
Application protocol: h2

finished in 1.09s, 5529.35 req/s, 11.98MB/s
requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                     min         max         mean         sd        +/- sd
time for request:      388us     63.53ms     37.82ms     13.23ms    83.22%
time for connect:   115.11ms    238.77ms    178.21ms     27.32ms    78.67%
time to 1st byte:   178.67ms    286.84ms    208.59ms     28.50ms    88.33%
req/s           :      18.61       56.01       24.75       12.89    84.67%

Code (Text):

-------------------------------------------------------------------------------------------
h2load load statistics
-------------------------------------------------------------------------------------------
sar -q -s 22:06:18
Linux 3.10.0-693.17.1.el7.x86_64 (hostname)     05/29/2018      _x86_64_        (4 CPU)

10:06:18 PM   runq-sz  plist-sz   ldavg-1   ldavg-5  ldavg-15   blocked
10:06:19 PM         0       160      0.43      0.60      0.93         0
10:06:20 PM         1       160      0.43      0.60      0.93         0
10:06:21 PM         0       160      0.43      0.60      0.93         0
10:06:22 PM         0       160      0.43      0.60      0.93         0
10:06:23 PM         0       160      0.43      0.60      0.93         0
10:06:24 PM         1       160      0.39      0.59      0.92         0
10:06:25 PM         1       160      0.39      0.59      0.92         0
10:06:26 PM         0       160      0.39      0.59      0.92         0
10:06:27 PM         1       160      0.39      0.59      0.92         0
10:06:28 PM         1       160      0.39      0.59      0.92         0
10:06:29 PM         1       160      0.36      0.58      0.92         0
10:06:30 PM         1       160      0.36      0.58      0.92         0
10:06:31 PM         0       160      0.36      0.58      0.92         0
10:06:32 PM         0       160      0.36      0.58      0.92         0
10:06:33 PM         0       160      0.36      0.58      0.92         0
10:06:34 PM         1       161      0.33      0.57      0.91         0
10:06:35 PM         1       160      0.33      0.57      0.91         0
10:06:36 PM         0       160      0.33      0.57      0.91         0
10:06:37 PM         0       160      0.33      0.57      0.91         0
10:06:38 PM         0       160      0.33      0.57      0.91         0
10:06:39 PM         0       160      0.39      0.58      0.91         0
10:06:40 PM         1       160      0.39      0.58      0.91         0
10:06:41 PM         0       160      0.39      0.58      0.91         0
10:06:42 PM         1       160      0.39      0.58      0.91         0
10:06:43 PM         1       160      0.39      0.58      0.91         0
10:06:44 PM         1       160      0.36      0.57      0.91         0
10:06:45 PM         0       160      0.36      0.57      0.91         0
10:06:46 PM         0       160      0.36      0.57      0.91         0
10:06:47 PM         0       160      0.36      0.57      0.91         0
10:06:48 PM         1       160      0.36      0.57      0.91         0
10:06:49 PM         1       160      0.33      0.56      0.90         0
10:06:50 PM         1       160      0.33      0.56      0.90         0
10:06:51 PM         1       160      0.33      0.56      0.90         0
10:06:52 PM         1       160      0.33      0.56      0.90         0
10:06:53 PM         1       160      0.33      0.56      0.90         0
10:06:54 PM        11       171      0.30      0.55      0.90         1
10:06:55 PM         1       160      0.30      0.55      0.90         0
10:06:56 PM         1       160      0.30      0.55      0.90         0
10:06:57 PM         1       160      0.30      0.55      0.90         0
10:06:58 PM         1       160      0.30      0.55      0.90         0
10:06:59 PM         1       162      0.28      0.54      0.89         0
10:07:00 PM         1       160      0.28      0.54      0.89         0
10:07:01 PM         0       160      0.28      0.54      0.89         0
10:07:02 PM         0       160      0.28      0.54      0.89         0
10:07:03 PM         1       160      0.28      0.54      0.89         0
10:07:04 PM         1       160      0.26      0.53      0.89         0
10:07:05 PM         1       160      0.26      0.53      0.89         0
10:07:06 PM         1       160      0.26      0.53      0.89         0
10:07:07 PM         1       160      0.26      0.53      0.89         0
10:07:08 PM         1       160      0.26      0.53      0.89         0
10:07:09 PM         1       160      0.23      0.52      0.89         0
10:07:10 PM         1       160      0.23      0.52      0.89         0
10:07:11 PM         0       160      0.23      0.52      0.89         0
10:07:12 PM         0       160      0.23      0.52      0.89         0
10:07:13 PM         0       160      0.23      0.52      0.89         0
10:07:14 PM         5       163      0.22      0.51      0.88         0
10:07:15 PM         0       160      0.22      0.51      0.88         0
10:07:16 PM         0       160      0.22      0.51      0.88         0
10:07:17 PM         0       160      0.22      0.51      0.88         0
10:07:18 PM         1       160      0.22      0.51      0.88         0
10:07:19 PM         0       160      0.20      0.50      0.88         0
10:07:20 PM         1       160      0.20      0.50      0.88         0
10:07:21 PM         1       160      0.20      0.50      0.88         0
10:07:22 PM         1       160      0.20      0.50      0.88         0
10:07:23 PM         1       160      0.20      0.50      0.88         0
10:07:24 PM         1       160      0.18      0.49      0.87         0
10:07:25 PM         1       160      0.18      0.49      0.87         0
10:07:26 PM         1       160      0.18      0.49      0.87         0
10:07:27 PM         1       160      0.18      0.49      0.87         0
10:07:28 PM         1       160      0.18      0.49      0.87         0
10:07:29 PM         0       160      0.17      0.49      0.87         0
10:07:30 PM         0       160      0.17      0.49      0.87         0
10:07:31 PM         1       160      0.17      0.49      0.87         0
10:07:32 PM         0       160      0.17      0.49      0.87         0
10:07:33 PM         0       160      0.17      0.49      0.87         0
10:07:34 PM         1       160      0.15      0.48      0.86         0
10:07:35 PM         0       160      0.15      0.48      0.86         0
10:07:36 PM         1       160      0.15      0.48      0.86         0
10:07:37 PM         1       160      0.15      0.48      0.86         0
10:07:38 PM         1       160      0.15      0.48      0.86         0
10:07:39 PM         1       160      0.14      0.47      0.86         0
10:07:40 PM         2       162      0.14      0.47      0.86         0
10:07:41 PM         1       170      0.14      0.47      0.86         0
10:07:42 PM         0       160      0.14      0.47      0.86         0
10:07:43 PM         0       160      0.14      0.47      0.86         0
10:07:44 PM         0       160      0.13      0.46      0.85         0
10:07:45 PM         0       160      0.13      0.46      0.85         0
10:07:46 PM         0       160      0.13      0.46      0.85         0
10:07:47 PM         1       160      0.13      0.46      0.85         0
10:07:48 PM         1       160      0.13      0.46      0.85         0
10:07:49 PM         0       160      0.12      0.45      0.85         0
10:07:50 PM         1       160      0.12      0.45      0.85         0
10:07:51 PM         1       160      0.12      0.45      0.85         0
10:07:52 PM         0       160      0.12      0.45      0.85         0
10:07:53 PM         0       160      0.12      0.45      0.85         0
10:07:54 PM         0       160      0.11      0.45      0.84         0
10:07:55 PM         0       160      0.11      0.45      0.84         0
10:07:56 PM         1       160      0.11      0.45      0.84         0
10:07:57 PM         0       160      0.11      0.45      0.84         0
10:07:58 PM         1       160      0.11      0.45      0.84         0
10:07:59 PM         1       160      0.10      0.44      0.84         0
10:08:00 PM         1       160      0.10      0.44      0.84         0
10:08:01 PM         1       160      0.10      0.44      0.84         0
10:08:02 PM         2       162      0.10      0.44      0.84         0
10:08:03 PM         0       160      0.10      0.44      0.84         0
10:08:04 PM         0       160      0.09      0.43      0.83         0
10:08:05 PM         0       160      0.09      0.43      0.83         0
10:08:06 PM         1       160      0.09      0.43      0.83         0
10:08:07 PM         1       160      0.09      0.43      0.83         0
10:08:08 PM         1       160      0.09      0.43      0.83         0
10:08:09 PM         1       160      0.09      0.43      0.83         0
10:08:10 PM         0       162      0.09      0.43      0.83         0
10:08:11 PM         1       162      0.09      0.43      0.83         0
10:08:12 PM         0       162      0.09      0.43      0.83         0
10:08:13 PM         0       162      0.09      0.43      0.83         0
10:08:14 PM         0       162      0.08      0.42      0.83         0
10:08:15 PM         0       162      0.08      0.42      0.83         0
10:08:16 PM         0       162      0.08      0.42      0.83         0
10:08:17 PM         0       162      0.08      0.42      0.83         0
10:08:18 PM         1       162      0.08      0.42      0.83         0
10:08:19 PM         1       162      0.07      0.41      0.82         0
10:08:20 PM         1       162      0.07      0.41      0.82         0
10:08:21 PM         1       162      0.07      0.41      0.82         0
10:08:22 PM         1       162      0.07      0.41      0.82         0
10:08:23 PM         1       164      0.07      0.41      0.82         0
10:08:24 PM         0       160      0.23      0.44      0.83         0
10:08:25 PM         0       160      0.23      0.44      0.83         0
10:08:26 PM         0       160      0.23      0.44      0.83         0
10:08:27 PM         1       160      0.23      0.44      0.83         0
10:08:28 PM         1       160      0.23      0.44      0.83         0
10:08:29 PM         1       160      0.21      0.43      0.82         0
10:08:30 PM         1       160      0.21      0.43      0.82         0
10:08:31 PM         1       160      0.21      0.43      0.82         0
10:08:32 PM         1       160      0.21      0.43      0.82         0
10:08:33 PM         1       160      0.21      0.43      0.82         0
10:08:34 PM         1       160      0.19      0.42      0.82         0
10:08:35 PM         0       160      0.19      0.42      0.82         0
10:08:36 PM         0       160      0.19      0.42      0.82         0
10:08:37 PM         0       160      0.19      0.42      0.82         0
10:08:38 PM         0       160      0.19      0.42      0.82         0
10:08:39 PM         0       160      0.18      0.42      0.81         0
10:08:40 PM         1       160      0.18      0.42      0.81         0
10:08:41 PM         1       160      0.18      0.42      0.81         0
10:08:42 PM         1       160      0.18      0.42      0.81         0
10:08:43 PM         1       160      0.18      0.42      0.81         0
10:08:44 PM         1       162      0.16      0.41      0.81         0
10:08:45 PM         1       167      0.16      0.41      0.81         0
10:08:46 PM         0       160      0.16      0.41      0.81         0
10:08:47 PM         0       160      0.16      0.41      0.81         0
10:08:48 PM         0       160      0.16      0.41      0.81         0
10:08:49 PM         1       160      0.15      0.40      0.81         0
10:08:50 PM         1       160      0.15      0.40      0.81         0
10:08:51 PM         1       160      0.15      0.40      0.81         0
10:08:52 PM         1       160      0.15      0.40      0.81         0
10:08:53 PM         1       160      0.15      0.40      0.81         0
10:08:54 PM         0       160      0.14      0.40      0.80         0
10:08:55 PM         0       160      0.14      0.40      0.80         0
10:08:56 PM         0       160      0.14      0.40      0.80         0
10:08:57 PM         0       160      0.14      0.40      0.80         0
10:08:58 PM         0       160      0.14      0.40      0.80         0
10:08:59 PM         0       160      0.13      0.39      0.80         0
10:09:00 PM         0       160      0.13      0.39      0.80         0
10:09:01 PM         1       160      0.13      0.39      0.80         0
10:09:02 PM         1       160      0.13      0.39      0.80         0
10:09:03 PM         1       160      0.13      0.39      0.80         0
10:09:04 PM         1       160      0.12      0.38      0.79         0
10:09:05 PM         1       160      0.12      0.38      0.79         0
Average:            1       160      0.21      0.48      0.86         0
-------------------------------------------------------------------------------------------

Code (Text):

sar -r -s 22:06:18
Linux 3.10.0-693.17.1.el7.x86_64 (hostname)     05/29/2018      _x86_64_        (4 CPU)

10:06:18 PM kbmemfree kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
10:06:19 PM  15183956   1083684      6.66     11496    149864   7918596     45.73    800848     92364       192
10:06:20 PM  15183988   1083652      6.66     11496    149788   7918596     45.73    800972     92400       220
10:06:21 PM  15183988   1083652      6.66     11496    149788   7918596     45.73    800972     92400       220
10:06:22 PM  15183988   1083652      6.66     11496    149788   7918596     45.73    800972     92400       220
10:06:23 PM  15183988   1083652      6.66     11504    149800   7918596     45.73    801008     92404       392
10:06:24 PM  15183988   1083652      6.66     11508    149804   7918596     45.73    801016     92404         4
10:06:25 PM  15183988   1083652      6.66     11508    149804   7918596     45.73    801016     92404         4
10:06:26 PM  15183988   1083652      6.66     11508    149804   7918596     45.73    801016     92404         4
10:06:27 PM  15183988   1083652      6.66     11508    149812   7918596     45.73    801020     92408        16
10:06:28 PM  15183988   1083652      6.66     11508    149816   7918596     45.73    801024     92408        20
10:06:29 PM  15183988   1083652      6.66     11516    149816   7918596     45.73    801028     92412       108
10:06:30 PM  15183988   1083652      6.66     11516    149820   7918596     45.73    801028     92412       112
10:06:31 PM  15183988   1083652      6.66     11516    149820   7918596     45.73    801028     92412       112
10:06:32 PM  15183988   1083652      6.66     11516    149824   7918596     45.73    801036     92412       116
10:06:33 PM  15183988   1083652      6.66     11516    149828   7918596     45.73    801036     92412       120
10:06:34 PM  15178836   1088804      6.69     11524    149832   7940612     45.86    805540     92424       132
10:06:35 PM  15182448   1085192      6.67     11524    149832   7918596     45.73    801052     92424       132
10:06:36 PM  15182504   1085136      6.67     11524    149836   7918596     45.73    801052     92424       136
10:06:37 PM  15182592   1085048      6.67     11524    149840   7918596     45.73    801056     92424       140
10:06:38 PM  15182592   1085048      6.67     11524    149840   7918596     45.73    801060     92424       140
10:06:39 PM  15183308   1084332      6.67     11524    149844   7918596     45.73    801424     92204       152
10:06:40 PM  15183612   1084028      6.66     11532    149948   7918596     45.73    801284     92300       312
10:06:41 PM  15183612   1084028      6.66     11532    149948   7918596     45.73    801284     92300       312
10:06:42 PM  15183612   1084028      6.66     11532    149952   7918596     45.73    801284     92300       316
10:06:43 PM  15183612   1084028      6.66     11532    149956   7918596     45.73    801288     92300       320
10:06:44 PM  15183612   1084028      6.66     11532    149956   7918596     45.73    801288     92300       320
10:06:45 PM  15183612   1084028      6.66     11540    149960   7918596     45.73    801296     92300       324
10:06:46 PM  15183612   1084028      6.66     11540    149960   7918596     45.73    801296     92300       324
10:06:47 PM  15183612   1084028      6.66     11540    149972   7918596     45.73    801300     92316       336
10:06:48 PM  15183612   1084028      6.66     11540    149972   7918596     45.73    801308     92316       336
10:06:49 PM  15183612   1084028      6.66     11540    149976   7918596     45.73    801308     92316       340
10:06:50 PM  15183612   1084028      6.66     11540    149980   7918596     45.73    801324     92308       344
10:06:51 PM  15183612   1084028      6.66     11548    149980   7918596     45.73    801324     92308       344
10:06:52 PM  15183612   1084028      6.66     11548    149984   7918596     45.73    801324     92308       348
10:06:53 PM  15183612   1084028      6.66     11548    149984   7918596     45.73    801324     92308       348
10:06:54 PM  15165616   1102024      6.77     11548    149988   8160772     47.13    819728     92308       352
10:06:55 PM  15182248   1085392      6.67     11548    149996   7918596     45.73    801360     92316       356
10:06:56 PM  15182248   1085392      6.67     11556    150000   7918596     45.73    801360     92320       376
10:06:57 PM  15182248   1085392      6.67     11556    150000   7918596     45.73    801364     92320       376
10:06:58 PM  15182248   1085392      6.67     11556    150004   7918596     45.73    801364     92324       380
10:06:59 PM  15172560   1095080      6.73     11556    150008   7932200     45.81    812396     92324       140
10:07:00 PM  15182948   1084692      6.67     11556    150008   7918596     45.73    801328     92324       140
10:07:01 PM  15183136   1084504      6.67     11564    150080   7918596     45.73    801340     92400       220
10:07:02 PM  15183212   1084428      6.67     11564    150120   7918596     45.73    801360     92420       336
10:07:03 PM  15183212   1084428      6.67     11564    150120   7918596     45.73    801364     92420       336
10:07:04 PM  15183212   1084428      6.67     11564    150120   7918596     45.73    801364     92420        44
10:07:05 PM  15183212   1084428      6.67     11564    150128   7918596     45.73    801368     92420         8
10:07:06 PM  15183212   1084428      6.67     11564    150132   7918596     45.73    801372     92420        12
10:07:07 PM  15183212   1084428      6.67     11572    150132   7918596     45.73    801396     92432       104
10:07:08 PM  15183212   1084428      6.67     11572    150136   7918596     45.73    801396     92432       108
10:07:09 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801400     92432       112
10:07:10 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801404     92432       112
10:07:11 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801404     92432       112
10:07:12 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801404     92432       112
10:07:13 PM  15183088   1084552      6.67     11580    150152   7918596     45.73    801412     92432       124
10:07:14 PM  15180908   1086732      6.68     11580    150156   7984644     46.11    803764     92432       128
10:07:15 PM  15181688   1085952      6.68     11580    150164   7918596     45.73    801436     92440       140
10:07:16 PM  15181728   1085912      6.68     11580    150164   7918596     45.73    801436     92440       140
10:07:17 PM  15181848   1085792      6.67     11580    150168   7918596     45.73    801436     92440       144
10:07:18 PM  15181848   1085792      6.67     11580    150172   7918596     45.73    801440     92440       148
10:07:19 PM  15181848   1085792      6.67     11588    150172   7918596     45.73    801444     92440       148
10:07:20 PM  15182248   1085392      6.67     11588    150172   7918596     45.73    801536     92440       148
10:07:21 PM  15182408   1085232      6.67     11588    150284   7918596     45.73    801440     92544       284
10:07:22 PM  15182408   1085232      6.67     11588    150284   7918596     45.73    801444     92544       284
10:07:23 PM  15182408   1085232      6.67     11588    150284   7918596     45.73    801444     92544       284
10:07:24 PM  15182408   1085232      6.67     11588    150292   7918596     45.73    801448     92544       292
10:07:25 PM  15182408   1085232      6.67     11596    150288   7918596     45.73    801456     92544         0
10:07:26 PM  15182408   1085232      6.67     11596    150296   7918596     45.73    801456     92544         8
10:07:27 PM  15182408   1085232      6.67     11596    150300   7918596     45.73    801456     92544        12
10:07:28 PM  15182408   1085232      6.67     11596    150304   7918596     45.73    801460     92552        16
10:07:29 PM  15182408   1085232      6.67     11596    150304   7918596     45.73    801464     92552        16
10:07:30 PM  15182408   1085232      6.67     11604    150308   7918596     45.73    801464     92556        80
10:07:31 PM  15182408   1085232      6.67     11604    150312   7918596     45.73    801468     92556        88
10:07:32 PM  15182408   1085232      6.67     11604    150312   7918596     45.73    801472     92556        88
10:07:33 PM  15182408   1085232      6.67     11604    150316   7918596     45.73    801472     92556        92
10:07:34 PM  15182408   1085232      6.67     11604    150316   7918596     45.73    801472     92556        92
10:07:35 PM  15181364   1086276      6.68     11612    150320   7918596     45.73    801500     92568       128
10:07:36 PM  15181416   1086224      6.68     11612    150328   7918596     45.73    801500     92572       136
10:07:37 PM  15181416   1086224      6.68     11612    150328   7918596     45.73    801500     92572       136
10:07:38 PM  15181416   1086224      6.68     11612    150332   7918596     45.73    801512     92568       140
10:07:39 PM  15181416   1086224      6.68     11612    150336   7918596     45.73    801512     92568       144
10:07:40 PM  15158968   1108672      6.82     11620    150340   7940580     45.86    824264     92572       156
10:07:41 PM  15174924   1092716      6.72     11620    150852   7959624     45.97    808020     93076       672
10:07:42 PM  15181260   1086380      6.68     11620    151144   7918596     45.73    801636     93076       672
10:07:43 PM  15181432   1086208      6.68     11620    150952   7918596     45.73    801500     93164       784
10:07:44 PM  15181432   1086208      6.68     11620    150952   7918596     45.73    801500     93164       784
10:07:45 PM  15181432   1086208      6.68     11628    150956   7918596     45.73    801504     93164       812
10:07:46 PM  15181432   1086208      6.68     11628    150960   7918596     45.73    801508     93164       816
10:07:47 PM  15181432   1086208      6.68     11628    150964   7918596     45.73    801532     93172       820
10:07:48 PM  15181432   1086208      6.68     11628    150964   7918596     45.73    801532     93172       820
10:07:49 PM  15181432   1086208      6.68     11628    150964   7918596     45.73    801532     93172       820
10:07:50 PM  15181432   1086208      6.68     11628    150972   7918596     45.73    801540     93172       828
10:07:51 PM  15181432   1086208      6.68     11636    150964   7918596     45.73    801544     93172         0
10:07:52 PM  15181432   1086208      6.68     11636    150964   7918596     45.73    801544     93172         0
10:07:53 PM  15181432   1086208      6.68     11636    150980   7918596     45.73    801560     93172        16
10:07:54 PM  15181432   1086208      6.68     11636    150980   7918596     45.73    801564     93172        16
10:07:55 PM  15180700   1086940      6.68     11636    150980   7918596     45.73    801860     93172        16
10:07:56 PM  15181060   1086580      6.68     11644    150996   7918596     45.73    801588     93168        52
10:07:57 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
10:07:58 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
10:07:59 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
10:08:00 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
10:08:01 PM  15181060   1086580      6.68     11652    150992   7918596     45.73    801596     93176       136
10:08:02 PM  15154764   1112876      6.84     11652    151308   7940580     45.86    826496     93380       476
10:08:03 PM  15179872   1087768      6.69     11652    151488   7918596     45.73    801712     93464       848
10:08:04 PM  15180092   1087548      6.69     11652    151624   7918596     45.73    801600     93776       804
10:08:05 PM  15180092   1087548      6.69     11652    151628   7918596     45.73    801604     93776       808
10:08:06 PM  15180092   1087548      6.69     11652    151632   7918596     45.73    801608     93776       812
10:08:07 PM  15180092   1087548      6.69     11660    151624   7918596     45.73    801608     93780       812
10:08:08 PM  15180092   1087548      6.69     11660    151624   7918596     45.73    801608     93780       812
10:08:09 PM  15180092   1087548      6.69     11660    151624   7918596     45.73    801608     93780       812
10:08:10 PM  15178672   1088968      6.69     11668    151632   7921644     45.75    803072     93340       840
10:08:11 PM  15178672   1088968      6.69     11668    151640   7921644     45.75    803124     93344       844
10:08:12 PM  15178672   1088968      6.69     11668    151640   7921644     45.75    803124     93344       844
10:08:13 PM  15178672   1088968      6.69     11668    151640   7921644     45.75    803124     93344       844
10:08:14 PM  15178432   1089208      6.70     11668    151656   7921644     45.75    803420     93208       860
10:08:15 PM  15177036   1090604      6.70     11676    151668   7921644     45.75    803444     93220       868
10:08:16 PM  15177036   1090604      6.70     11676    151668   7921644     45.75    803444     93220       868
10:08:17 PM  15177036   1090604      6.70     11676    151676   7921644     45.75    803444     93228       876
10:08:18 PM  15177036   1090604      6.70     11676    151680   7921644     45.75    803448     93228       880
10:08:19 PM  15177036   1090604      6.70     11676    151680   7921644     45.75    803448     93228       880
10:08:20 PM  15177036   1090604      6.70     11676    151684   7921644     45.75    803468     93228       884
10:08:21 PM  15177160   1090480      6.70     11684    151680   7921644     45.75    803472     93228       888
10:08:22 PM  15177160   1090480      6.70     11684    151688   7921644     45.75    803476     93228       884
10:08:23 PM  15153932   1113708      6.85     11684    151692   7939532     45.85    827248     93236       888
10:08:24 PM  15179296   1088344      6.69     11684    152212   7918596     45.73    802404     93744      1408
10:08:25 PM  15179552   1088088      6.69     11684    152304   7918596     45.73    802356     93752      1500
10:08:26 PM  15179552   1088088      6.69     11692    152308   7918596     45.73    802372     93756      1328
10:08:27 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
10:08:28 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
10:08:29 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
10:08:30 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
10:08:31 PM  15179536   1088104      6.69     11700    152324   7918596     45.73    802388     93760      1368
10:08:32 PM  15179412   1088228      6.69     11700    152324   7918596     45.73    802392     93760      1368
10:08:33 PM  15179412   1088228      6.69     11700    152324   7918596     45.73    802392     93760      1368
10:08:34 PM  15179412   1088228      6.69     11700    152324   7918596     45.73    802392     93760      1368
10:08:35 PM  15178608   1089032      6.69     11700    152336   7918596     45.73    802404     93768      1384
10:08:36 PM  15178884   1088756      6.69     11700    152340   7918596     45.73    802404     93768       164
10:08:37 PM  15178884   1088756      6.69     11708    152332   7918596     45.73    802404     93768       164
10:08:38 PM  15178884   1088756      6.69     11708    152332   7918596     45.73    802404     93768       164
10:08:39 PM  15178884   1088756      6.69     11708    152348   7918596     45.73    802412     93776       172
10:08:40 PM  15178884   1088756      6.69     11708    152352   7918596     45.73    802416     93776       176
10:08:41 PM  15178884   1088756      6.69     11708    152352   7918596     45.73    802416     93776       176
10:08:42 PM  15179008   1088632      6.69     11716    152356   7918596     45.73    802420     93776       180
10:08:43 PM  15179008   1088632      6.69     11716    152360   7918596     45.73    802424     93776       184
10:08:44 PM  15154092   1113548      6.85     11716    152360   7936484     45.83    826688     93784       192
10:08:45 PM  15255936   1011704      6.22     11716    152840   7760884     44.82    725044     94180       676
10:08:46 PM  15178536   1089104      6.69     11716    152840   7918596     45.73    802564     94180       676
10:08:47 PM  15178788   1088852      6.69     11724    152984   7918596     45.73    802400     94388       828
10:08:48 PM  15178788   1088852      6.69     11724    152988   7918596     45.73    802400     94388       832
10:08:49 PM  15178788   1088852      6.69     11724    152988   7918596     45.73    802400     94388       832
10:08:50 PM  15178788   1088852      6.69     11724    152996   7918596     45.73    802408     94388       840
10:08:51 PM  15178788   1088852      6.69     11724    152996   7918596     45.73    802412     94388       840
10:08:52 PM  15178788   1088852      6.69     11732    153000   7918596     45.73    802440     94388       844
10:08:53 PM  15178788   1088852      6.69     11732    153004   7918596     45.73    802444     94388       848
10:08:54 PM  15178788   1088852      6.69     11732    153004   7918596     45.73    802444     94388       848
10:08:55 PM  15177404   1090236      6.70     11732    153008   7918596     45.73    802472     94396       856
10:08:56 PM  15177492   1090148      6.70     11732    153012   7918596     45.73    802472     94396       736
10:08:57 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
10:08:58 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
10:08:59 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
10:09:00 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
10:09:01 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
10:09:02 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
10:09:03 PM  15177548   1090092      6.70     11748    152996   7918596     45.73    802472     94396       736
10:09:04 PM  15177548   1090092      6.70     11748    152996   7918596     45.73    802472     94396       736
10:09:05 PM  15177548   1090092      6.70     11748    153036   7918596     45.73    802496     94400       700
Average:     15180726   1086914      6.68     11621    151034   7920689     45.74    802173     93060       454
-------------------------------------------------------------------------------------------

h2load tests completed using temp /etc/hosts entry:
server-ip-mask http2.domain.com #h2load

centmin mod local code last commit:

b31b485 George Liu Tue, 29 May 2018 04:14:41 +1000
update inc/mariadb_install103.inc

 

Yeah Dallas only

 

sysbench benchmarks

Giving my updated sysbench benchmark scripts a whirl

Sysbench CPU benchmarks - 1 thread. Single thread sysbench cpu benchmark was within 79% the performance of a single thread Intel Core i7 4790K clocked at 4.0Ghz with Turbo boost to 4.40Ghz !

Code (Text):

./sysbench.sh cpu
-------------------------------------------
System Information
-------------------------------------------

3.10.0-693.17.1.el7.x86_64

CentOS Linux release 7.5.1804 (Core)

Centmin Mod
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                4
On-line CPU(s) list:   0-3
Thread(s) per core:    1
Core(s) per socket:    4
Socket(s):             1
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 94
Model name:            Intel Core Processor (Skylake, IBRS)
Stepping:              3
CPU MHz:               2099.998
BogoMIPS:              4199.99
Hypervisor vendor:     KVM
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              4096K
NUMA node0 CPU(s):     0-3
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1

CPU Flags
 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1

CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
0   0    0      0    0:0:0      yes
1   0    0      1    1:1:1      yes
2   0    0      2    2:2:2      yes
3   0    0      3    3:3:3      yes

              total        used        free      shared  buff/cache   available
Mem:          15886         831       14609          30         445       14722
Low:          15886        1276       14609
High:             0           0           0
Swap:          1023           0        1023

Filesystem                       Size  Used Avail Use% Mounted on
/dev/mapper/centos_centos7-root   78G  6.4G   68G   9% /
devtmpfs                         7.8G     0  7.8G   0% /dev
tmpfs                            7.8G     0  7.8G   0% /dev/shm
tmpfs                            7.8G   17M  7.8G   1% /run
tmpfs                            7.8G     0  7.8G   0% /sys/fs/cgroup
/dev/sda1                       1014M  264M  751M  26% /boot
tmpfs                            1.6G     0  1.6G   0% /run/user/0
tmpfs                            7.8G  324K  7.8G   1% /tmp

Code (Text):

sysbench cpu --cpu-max-prime=20000 --threads=1 run
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 1
prime: 20000
events/s: 417.49
time: 10.0010s
min: 2.15
avg: 2.39
max: 3.06
95th: 2.61

| cpu sysbench | threads: | events/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 1.0.14 | 1 | 417.49 | 10.0010s | 2.15 | 2.39 | 3.06 | 2.61 |

sysbench,threads,events/s,time,min,avg,max,95th
1.0.14,1,417.49,10.0010s,2.15,2.39,3.06,2.61

Sysbench CPU benchmarks - 4 thread

Code (Text):

sysbench cpu --cpu-max-prime=20000 --threads=4 run
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 4
prime: 20000
events/s: 1556.59
time: 10.0025s
min: 2.15
avg: 2.57
max: 22.97
95th: 2.76

| cpu sysbench | threads: | events/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 1.0.14 | 4 | 1556.59 | 10.0025s | 2.15 | 2.57 | 22.97 | 2.76 |

sysbench,threads,events/s,time,min,avg,max,95th
1.0.14,4,1556.59,10.0025s,2.15,2.57,22.97,2.76

Sysbench Memory benchmarks - 1 thread

Code (Text):

./sysbench.sh mem

sysbench memory --threads=1 --memory-block-size=1K --memory-scope=global --memory-total-size=1G --memory-oper=read run
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 1
block-size: 1KiB
total-size: 1024MiB
operation: read
scope: global
total-ops: 1048576 (3101502.60 per second)
transferred (3028.81 MiB/sec)
time: 0.3365s
min: 0.00
avg: 0.00
max: 0.05
95th: 0.00

| memory sysbench | sysbench | threads: | block-size: | total-size: | operation: | total-ops: | transferred | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| memory | 1.0.14 | 1 | 1KiB | 1024MiB | read | 1048576 | 3028.81 | 0.3365s | 0.00 | 0.00 | 0.05 | 0.00 |

sysbench,sysbench,threads,block-size,total-size,operation,total-ops,transferred,time,min,avg,max,95th
memory,1.0.14,1,1KiB,1024MiB,read,1048576,3028.81,0.3365s,0.00,0.00,0.05,0.00

Sysbench Memory benchmarks - 4 thread

Code (Text):

sysbench memory --threads=4 --memory-block-size=1K --memory-scope=global --memory-total-size=1G --memory-oper=read run
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 4
block-size: 1KiB
total-size: 1024MiB
operation: read
scope: global
total-ops: 1048576 (9620871.55 per second)
transferred (9395.38 MiB/sec)
time: 0.1074s
min: 0.00
avg: 0.00
max: 0.07
95th: 0.00

| memory sysbench | sysbench | threads: | block-size: | total-size: | operation: | total-ops: | transferred | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| memory | 1.0.14 | 4 | 1KiB | 1024MiB | read | 1048576 | 9395.38 | 0.1074s | 0.00 | 0.00 | 0.07 | 0.00 |

sysbench,sysbench,threads,block-size,total-size,operation,total-ops,transferred,time,min,avg,max,95th
memory,1.0.14,4,1KiB,1024MiB,read,1048576,9395.38,0.1074s,0.00,0.00,0.07,0.00

Sysbench FileIO benchmarks - 1 thread

Code (Text):

./sysbench.sh file

sysbench fileio prepare
sysbench fileio --file-total-size=2048M --file-test-mode=seqrd prepare

sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqrd --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-seqrd-threads-1-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 1
Block-size 4KiB
Using synchronous I/O mode
Doing sequential read test
reads/s: 9463.79
writes/s: 0.00
fsyncs/s: 0.00
read-MiB/s: 36.97
written-MiB/s: 0.00
time: 10.0002s
min: 0.07
avg: 0.11
max: 8.65
95th: 0.13

| fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 1 | 4KiB | I/O | read | 9463.79 | 0.00 | 0.00 | 36.97 | 0.00 | 10.0002s | 0.07 | 0.11 | 8.65 | 0.13 |

sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,1,4KiB,I/O,read,9463.79,0.00,0.00,36.97,0.00,10.0002s,0.07,0.11,8.65,0.13

Code (Text):

sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqwr --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-seqwr-threads-1-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 1
Block-size 4KiB
Using synchronous I/O mode
Doing sequential write (creation) test
reads/s: 0.00
writes/s: 6368.91
fsyncs/s: 8145.01
read-MiB/s: 0.00
written-MiB/s: 24.88
time: 10.0001s
min: 0.02
avg: 0.07
max: 9.33
95th: 0.11

| fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 1 | 4KiB | I/O | write | 0.00 | 6368.91 | 8145.01 | 0.00 | 24.88 | 10.0001s | 0.02 | 0.07 | 9.33 | 0.11 |

sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,1,4KiB,I/O,write,0.00,6368.91,8145.01,0.00,24.88,10.0001s,0.02,0.07,9.33,0.11

Code (Text):

sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndrd --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-rndrd-threads-1-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 1
Block-size 4KiB
Read/Write ratio for combined random IO test: 1.50
Using synchronous I/O mode
Doing random read test
reads/s: 5574.94
writes/s: 0.00
fsyncs/s: 0.00
read-MiB/s: 21.78
written-MiB/s: 0.00
time: 10.0002s
min: 0.07
avg: 0.18
max: 8.66
95th: 0.23

| fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 1 | 4KiB | I/O | read | 5574.94 | 0.00 | 0.00 | 21.78 | 0.00 | 10.0002s | 0.07 | 0.18 | 8.66 | 0.23 |

sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,1,4KiB,I/O,read,5574.94,0.00,0.00,21.78,0.00,10.0002s,0.07,0.18,8.66,0.23

Code (Text):

sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndwr --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-rndwr-threads-1-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 1
Block-size 4KiB
Read/Write ratio for combined random IO test: 1.50
Using synchronous I/O mode
Doing random write test
reads/s: 0.00
writes/s: 6370.71
fsyncs/s: 8152.08
read-MiB/s: 0.00
written-MiB/s: 24.89
time: 10.0002s
min: 0.02
avg: 0.07
max: 7.47
95th: 0.11

| fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 1 | 4KiB | I/O | write | 0.00 | 6370.71 | 8152.08 | 0.00 | 24.89 | 10.0002s | 0.02 | 0.07 | 7.47 | 0.11 |

sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,1,4KiB,I/O,write,0.00,6370.71,8152.08,0.00,24.89,10.0002s,0.02,0.07,7.47,0.11

Sysbench FileIO benchmarks - 4 thread

Code (Text):

sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqrd --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-seqrd-threads-4-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 4
Block-size 4KiB
Using synchronous I/O mode
Doing sequential read test
reads/s: 32751.29
writes/s: 0.00
fsyncs/s: 0.00
read-MiB/s: 127.93
written-MiB/s: 0.00
time: 10.0001s
min: 0.05
avg: 0.12
max: 8.70
95th: 0.17

| fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 4 | 4KiB | I/O | read | 32751.29 | 0.00 | 0.00 | 127.93 | 0.00 | 10.0001s | 0.05 | 0.12 | 8.70 | 0.17 |

sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,4,4KiB,I/O,read,32751.29,0.00,0.00,127.93,0.00,10.0001s,0.05,0.12,8.70,0.17

Code (Text):

sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqwr --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-seqwr-threads-4-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 4
Block-size 4KiB
Using synchronous I/O mode
Doing sequential write (creation) test
reads/s: 0.00
writes/s: 7669.29
fsyncs/s: 9815.53
read-MiB/s: 0.00
written-MiB/s: 29.96
time: 10.0005s
min: 0.04
avg: 0.23
max: 30.78
95th: 0.24

| fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 4 | 4KiB | I/O | write | 0.00 | 7669.29 | 9815.53 | 0.00 | 29.96 | 10.0005s | 0.04 | 0.23 | 30.78 | 0.24 |

sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,4,4KiB,I/O,write,0.00,7669.29,9815.53,0.00,29.96,10.0005s,0.04,0.23,30.78,0.24

Code (Text):

sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndrd --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-rndrd-threads-4-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 4
Block-size 4KiB
Read/Write ratio for combined random IO test: 1.50
Using synchronous I/O mode
Doing random read test
reads/s: 21518.73
writes/s: 0.00
fsyncs/s: 0.00
read-MiB/s: 84.06
written-MiB/s: 0.00
time: 10.0002s
min: 0.06
avg: 0.19
max: 8.48
95th: 0.24

| fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 4 | 4KiB | I/O | read | 21518.73 | 0.00 | 0.00 | 84.06 | 0.00 | 10.0002s | 0.06 | 0.19 | 8.48 | 0.24 |

sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,4,4KiB,I/O,read,21518.73,0.00,0.00,84.06,0.00,10.0002s,0.06,0.19,8.48,0.24

Code (Text):

sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndwr --time=10 --events=0 run
raw log saved: /home/sysbench/sysbench-fileio-rndwr-threads-4-raw.log

sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 4
Block-size 4KiB
Read/Write ratio for combined random IO test: 1.50
Using synchronous I/O mode
Doing random write test
reads/s: 0.00
writes/s: 14743.81
fsyncs/s: 18863.76
read-MiB/s: 0.00
written-MiB/s: 57.59
time: 10.0002s
min: 0.03
avg: 0.12
max: 22.00
95th: 0.21

| fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| fileio | 1.0.14 | 4 | 4KiB | I/O | write | 0.00 | 14743.81 | 18863.76 | 0.00 | 57.59 | 10.0002s | 0.03 | 0.12 | 22.00 | 0.21 |

sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
fileio,1.0.14,4,4KiB,I/O,write,0.00,14743.81,18863.76,0.00,57.59,10.0002s,0.03,0.12,22.00,0.21

Sysbench MySQL OLTP read/write benchmarks - 4 thread

Code (Text):

./sysbench.sh mysqloltpnew

setup sbt database & user
mysqladmin create database: sbt

MySQL Buffers
aria_pagecache_buffer_size           1073741824
aria_sort_buffer_size                268435456
bulk_insert_buffer_size              8388608
innodb_buffer_pool_dump_at_shutdown  OFF
innodb_buffer_pool_dump_now          OFF
innodb_buffer_pool_dump_pct          100
innodb_buffer_pool_filename          ib_buffer_pool
innodb_buffer_pool_instances         4
innodb_buffer_pool_load_abort        OFF
innodb_buffer_pool_load_at_startup   OFF
innodb_buffer_pool_load_now          OFF
innodb_buffer_pool_populate          OFF
innodb_buffer_pool_size              4294967296
innodb_change_buffer_max_size        25
innodb_change_buffering              all
innodb_log_buffer_size               16777216
innodb_sort_buffer_size              2097152
join_buffer_size                     1048576
join_buffer_space_limit              2097152
key_buffer_size                      536870912
mrr_buffer_size                      262144
myisam_sort_buffer_size              536870912
net_buffer_length                    16384
optimizer_switch                     index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=off
preload_buffer_size                  32768
read_buffer_size                     1048576
read_rnd_buffer_size                 524288
sort_buffer_size                     2097152
sql_buffer_result                    OFF

MySQL Limits
aria_pagecache_division_limit         100
delayed_insert_limit                  100
expensive_subquery_limit              100
ft_query_expansion_limit              20
innodb_ft_result_cache_limit          2000000000
join_buffer_space_limit               2097152
key_cache_division_limit              100
log_slow_rate_limit                   1
min_examined_row_limit                0
open_files_limit                      524288
optimizer_selectivity_sampling_limit  100
query_cache_limit                     1048576
relay_log_space_limit                 0
sql_select_limit                      18446744073709551615
thread_pool_stall_limit               500
updatable_views_with_limit            YES

MySQL Maxes
aria_max_sort_file_size           9223372036853727232
extra_max_connections             1
ft_max_word_len                   84
group_concat_max_len              1024
innodb_adaptive_max_sleep_delay   150000
innodb_compression_pad_pct_max    50
innodb_file_format_max            Antelope
innodb_ft_max_token_size          84
innodb_io_capacity_max            5200
innodb_max_bitmap_file_size       104857600
innodb_max_changed_pages          1000000
innodb_max_dirty_pages_pct        75.000000
innodb_max_dirty_pages_pct_lwm    0.001000
innodb_max_purge_lag              0
innodb_max_purge_lag_delay        0
innodb_online_alter_log_max_size  134217728
max_allowed_packet                134217728
max_binlog_cache_size             18446744073709547520
max_binlog_size                   1073741824
max_binlog_stmt_cache_size        18446744073709547520
max_connect_errors                100000
max_connections                   900
max_delayed_threads               20
max_digest_length                 1024
max_error_count                   64
max_heap_table_size               805306368
max_insert_delayed_threads        20
max_join_size                     18446744073709551615
max_length_for_sort_data          1024
max_long_data_size                134217728
max_prepared_stmt_count           16382
max_relay_log_size                1073741824
max_seeks_for_key                 4294967295
max_session_mem_used              9223372036854775807
max_sort_length                   1024
max_sp_recursion_depth            0
max_statement_time                0.000000
max_tmp_tables                    32
max_user_connections              0
max_write_lock_count              4294967295
myisam_max_sort_file_size         4294967296
slave_max_allowed_packet          1073741824
slave_parallel_max_queued         131072
thread_pool_max_threads           1000
wsrep_max_ws_rows                 0
wsrep_max_ws_size                 2147483647

MySQL Concurrency
concurrent_insert           ALWAYS
innodb_commit_concurrency   0
innodb_concurrency_tickets  5000
innodb_thread_concurrency   0
thread_concurrency          10

Code (Text):

sysbench prepare database: sbt
sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql prepare
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)

Initializing worker threads...

Creating table 'sbtest3'...
Creating table 'sbtest4'...
Creating table 'sbtest1'...
Creating table 'sbtest2'...
Inserting 150000 records into 'sbtest3'
Inserting 150000 records into 'sbtest1'
Inserting 150000 records into 'sbtest2'
Inserting 150000 records into 'sbtest4'
Creating a secondary index on 'sbtest2'...
Creating a secondary index on 'sbtest4'...
Creating a secondary index on 'sbtest1'...
Creating a secondary index on 'sbtest3'...
Creating table 'sbtest8'...
Creating table 'sbtest5'...
Inserting 150000 records into 'sbtest8'
Creating table 'sbtest6'...
Inserting 150000 records into 'sbtest5'
Inserting 150000 records into 'sbtest6'
Creating table 'sbtest7'...
Inserting 150000 records into 'sbtest7'
Creating a secondary index on 'sbtest8'...
Creating a secondary index on 'sbtest6'...
Creating a secondary index on 'sbtest5'...
Creating a secondary index on 'sbtest7'...

+-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
| Table Name  | Number of Rows | Storage Engine | Data Size | Index Size | Total   | ROW_FORMAT | TABLE_COLLATION |
+-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
| sbt.sbtest1 | 150000 Rows    | InnoDB         | 0.06MB    | 0.00MB     | 0.06MB  | Dynamic    | utf8_general_ci |
| sbt.sbtest2 | 148032 Rows    | InnoDB         | 32.56MB   | 2.52MB     | 35.08MB | Dynamic    | utf8_general_ci |
| sbt.sbtest3 | 148032 Rows    | InnoDB         | 32.56MB   | 0.00MB     | 32.56MB | Dynamic    | utf8_general_ci |
| sbt.sbtest4 | 148032 Rows    | InnoDB         | 32.56MB   | 2.52MB     | 35.08MB | Dynamic    | utf8_general_ci |
| sbt.sbtest5 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
| sbt.sbtest6 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
| sbt.sbtest7 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
| sbt.sbtest8 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
+-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+

Code (Text):

sysbench mysql OLTP new benchmark:
sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql run
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)

Running the test with following options:
Number of threads: 4
Report intermediate results every 1 second(s)
Initializing random number generator from seed (1).


Initializing worker threads...

Threads started!

[ 1s ] thds: 4 tps: 915.35 qps: 18348.88 (r/w/o: 12852.80/3662.39/1833.69) lat (ms,95%): 8.43 err/s: 0.00 reconn/s: 0.00
[ 2s ] thds: 4 tps: 1070.11 qps: 21396.16 (r/w/o: 14971.51/4283.43/2141.22) lat (ms,95%): 5.99 err/s: 0.00 reconn/s: 0.00
[ 3s ] thds: 4 tps: 1172.03 qps: 23446.51 (r/w/o: 16418.35/4684.10/2344.05) lat (ms,95%): 5.18 err/s: 0.00 reconn/s: 0.00
[ 4s ] thds: 4 tps: 1251.95 qps: 25047.95 (r/w/o: 17531.26/5012.79/2503.89) lat (ms,95%): 4.49 err/s: 0.00 reconn/s: 0.00
[ 5s ] thds: 4 tps: 1234.03 qps: 24673.61 (r/w/o: 17272.43/4933.12/2468.06) lat (ms,95%): 4.82 err/s: 0.00 reconn/s: 0.00
[ 6s ] thds: 4 tps: 1304.01 qps: 26076.25 (r/w/o: 18250.17/5218.05/2608.02) lat (ms,95%): 4.74 err/s: 0.00 reconn/s: 0.00
[ 7s ] thds: 4 tps: 1281.01 qps: 25632.12 (r/w/o: 17944.08/5126.02/2562.01) lat (ms,95%): 4.57 err/s: 0.00 reconn/s: 0.00
[ 8s ] thds: 4 tps: 1276.90 qps: 25529.99 (r/w/o: 17874.59/5101.60/2553.80) lat (ms,95%): 5.00 err/s: 0.00 reconn/s: 0.00
[ 9s ] thds: 4 tps: 1375.99 qps: 27494.86 (r/w/o: 19239.90/5503.97/2750.99) lat (ms,95%): 4.10 err/s: 0.00 reconn/s: 0.00
[ 10s ] thds: 4 tps: 1323.84 qps: 26510.86 (r/w/o: 18566.80/5295.37/2648.69) lat (ms,95%): 4.49 err/s: 0.00 reconn/s: 0.00
[ 11s ] thds: 4 tps: 1352.35 qps: 27025.98 (r/w/o: 18911.88/5409.40/2704.70) lat (ms,95%): 3.89 err/s: 0.00 reconn/s: 0.00
[ 12s ] thds: 4 tps: 1303.85 qps: 26083.01 (r/w/o: 18259.90/5215.40/2607.70) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
[ 13s ] thds: 4 tps: 1287.92 qps: 25763.39 (r/w/o: 18035.88/5151.68/2575.84) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
[ 14s ] thds: 4 tps: 1336.15 qps: 26703.06 (r/w/o: 18686.14/5344.61/2672.31) lat (ms,95%): 3.82 err/s: 0.00 reconn/s: 0.00
[ 15s ] thds: 4 tps: 1339.97 qps: 26811.40 (r/w/o: 18771.58/5359.88/2679.94) lat (ms,95%): 3.89 err/s: 0.00 reconn/s: 0.00
[ 16s ] thds: 4 tps: 1377.99 qps: 27555.88 (r/w/o: 19287.92/5511.98/2755.99) lat (ms,95%): 3.68 err/s: 0.00 reconn/s: 0.00
[ 17s ] thds: 4 tps: 1266.03 qps: 25334.60 (r/w/o: 17735.42/5067.12/2532.06) lat (ms,95%): 4.41 err/s: 0.00 reconn/s: 0.00
[ 18s ] thds: 4 tps: 1212.65 qps: 24274.97 (r/w/o: 16994.08/4855.59/2425.30) lat (ms,95%): 5.09 err/s: 0.00 reconn/s: 0.00
[ 19s ] thds: 4 tps: 1281.39 qps: 25599.88 (r/w/o: 17916.51/5120.58/2562.79) lat (ms,95%): 4.33 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 4 tps: 1244.29 qps: 24888.79 (r/w/o: 17426.05/4974.16/2488.58) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
[ 21s ] thds: 4 tps: 1159.62 qps: 23191.45 (r/w/o: 16230.71/4641.49/2319.25) lat (ms,95%): 5.57 err/s: 0.00 reconn/s: 0.00
[ 22s ] thds: 4 tps: 1215.91 qps: 24332.25 (r/w/o: 17035.78/4864.65/2431.83) lat (ms,95%): 5.09 err/s: 0.00 reconn/s: 0.00
[ 23s ] thds: 4 tps: 1321.79 qps: 26416.73 (r/w/o: 18488.01/5285.15/2643.57) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
[ 24s ] thds: 4 tps: 1299.99 qps: 26003.75 (r/w/o: 18206.82/5197.95/2598.97) lat (ms,95%): 4.25 err/s: 0.00 reconn/s: 0.00
[ 25s ] thds: 4 tps: 1243.29 qps: 24884.90 (r/w/o: 17417.13/4980.18/2487.59) lat (ms,95%): 5.00 err/s: 0.00 reconn/s: 0.00
[ 26s ] thds: 4 tps: 1323.48 qps: 26460.64 (r/w/o: 18526.74/5286.93/2646.96) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
[ 27s ] thds: 4 tps: 1213.52 qps: 24273.49 (r/w/o: 16983.34/4862.10/2428.05) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
[ 28s ] thds: 4 tps: 1322.95 qps: 26446.97 (r/w/o: 18518.28/5283.79/2644.90) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
[ 29s ] thds: 4 tps: 1364.96 qps: 27319.22 (r/w/o: 19124.45/5464.84/2729.92) lat (ms,95%): 3.89 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 4 tps: 1369.15 qps: 27370.96 (r/w/o: 19157.08/5476.59/2737.30) lat (ms,95%): 4.25 err/s: 0.00 reconn/s: 0.00
SQL statistics:
    queries performed:
        read:                            532686
        write:                           152196
        other:                           76098
        total:                           760980
    transactions:                        38049  (1267.88 per sec.)
    queries:                             760980 (25357.60 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          30.0084s
    total number of events:              38049

Latency (ms):
         min:                                    1.93
         avg:                                    3.15
         max:                                   48.66
         95th percentile:                        4.74
         sum:                               119915.33

Threads fairness:
    events (avg/stddev):           9512.2500/192.05
    execution time (avg/stddev):   29.9788/0.00

Code (Text):

sysbench mysql OLTP new summary:
sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql run
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
threads: 4
read: 532686
write: 152196
other: 76098
total: 760980
transactions/s: 1267.88
queries/s: 25357.60
time: 30.0084s
min: 1.93
avg: 3.15
max: 48.66
95th: 4.74

| mysql sysbench | sysbench | threads: | read: | write: | other: | total: | transactions/s: | queries/s: | time: | min: | avg: | max: | 95th: |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| oltp_read_write.lua | 1.0.14 | 4 | 532686 | 152196 | 76098 | 760980 | 1267.88 | 25357.60 | 30.0084s | 1.93 | 3.15 | 48.66 | 4.74 |

sysbench,sysbench,threads,read,write,other,total,transactions/s,queries/s,time,min,avg,max,95th
oltp_read_write.lua,1.0.14,4,532686,152196,76098,760980,1267.88,25357.60,30.0084s,1.93,3.15,48.66,4.74

Code (Text):

sysbench mysql cleanup database: sbt
sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql cleanup
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)

Dropping table 'sbtest1'...
Dropping table 'sbtest2'...
Dropping table 'sbtest3'...
Dropping table 'sbtest4'...
Dropping table 'sbtest5'...
Dropping table 'sbtest6'...
Dropping table 'sbtest7'...
Dropping table 'sbtest8'...

 

Centminmodbench.sh Benchmarks

All new VPS/Dedicated servers I get, I will run my centminmodbench.sh benchmark script at bench.centminmod.com to fully evaluate the performance of the server. The results are below:

• Bandwidth wise ssdnodes's Dallas KVM VPS uses 10Gbps network, so it shows in below single threaded wget and multi-threaded Axel download bandwidth tests with Vultr Dallas test reporting 227MB/s and 300MB/s respectively.
• Crytographic performance core for core is very good on Intel Xeon Gold Scalable processor with AES-NI hardware assisted AES128/AES256 even beating out 4 cpu OpenSSL benchmark test against my Intel Core i7 4790K Haswell cpu clocked at 4.0Ghz.
• FFIO disk benchmarks report 94625 random reads and 40608 random write IOPs and 369MB/s random reads and 164MB/s random writes.

Code (Text):

-------------------------------------------
centminmodbench.sh 0.9.7
http://bench.centminmod.com
written by: George Liu (eva2000)
http://centminmod.com
-------------------------------------------

-------------------------------------------
System Information
-------------------------------------------

3.10.0-693.17.1.el7.x86_64

CentOS Linux release 7.5.1804 (Core)

Centmin Mod
----------------------------------------------
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                4
On-line CPU(s) list:   0-3
Thread(s) per core:    1
Core(s) per socket:    4
Socket(s):             1
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 94
Model name:            Intel Core Processor (Skylake, IBRS)
Stepping:              3
CPU MHz:               2099.998
BogoMIPS:              4199.99
Hypervisor vendor:     KVM
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              4096K
NUMA node0 CPU(s):     0-3
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1

CPU Flags
 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1

----------------------------------------------
CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
0   0    0      0    0:0:0      yes
1   0    0      1    1:1:1      yes
2   0    0      2    2:2:2      yes
3   0    0      3    3:3:3      yes

----------------------------------------------
              total        used        free      shared  buff/cache   available
Mem:          15886        1494       13176          30        1215       14033
Low:          15886        2710       13176
High:             0           0           0
Swap:          1023           0        1023

----------------------------------------------
Filesystem                       Size  Used Avail Use% Mounted on
/dev/mapper/centos_centos7-root   78G  6.4G   68G   9% /
devtmpfs                         7.8G     0  7.8G   0% /dev
tmpfs                            7.8G     0  7.8G   0% /dev/shm
tmpfs                            7.8G   17M  7.8G   1% /run
tmpfs                            7.8G     0  7.8G   0% /sys/fs/cgroup
/dev/sda1                       1014M  264M  751M  26% /boot
tmpfs                            1.6G     0  1.6G   0% /run/user/0
tmpfs                            7.8G  324K  7.8G   1% /tmp

Code (Text):

-------------------------------------------
disk ioping tests
-------------------------------------------


Running IOPing I/O benchmark...

IOPing I/O: ./ioping -c 10 .
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=1 time=115 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=2 time=386 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=3 time=394 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=4 time=385 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=5 time=473 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=6 time=321 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=7 time=379 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=8 time=392 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=9 time=495 us
4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=10 time=320 us

--- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
10 requests completed in 9.0 s, 2.7 k iops, 10.7 MiB/s
min/avg/max/mdev = 115 us / 366 us / 495 us / 98 us

IOPing seek rate: ./ioping -RD .

--- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
31.1 k requests completed in 3.0 s, 10.5 k iops, 41.1 MiB/s
min/avg/max/mdev = 68 us / 95 us / 4.8 ms / 35 us

IOPing sequential: ./ioping -RL .

--- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
9.3 k requests completed in 3.0 s, 3.4 k iops, 839.0 MiB/s
min/avg/max/mdev = 206 us / 297 us / 9.5 ms / 177 us

IOPing cached: ./ioping -RC .

--- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
1.7 M requests completed in 3.0 s, 589.9 k iops, 2.3 GiB/s
min/avg/max/mdev = 0 us / 1 us / 138 us / 0 us

Code (Text):

-------------------------------------------
disk DD tests
-------------------------------------------

dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 1.28657 s, 835 MB/s

dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 1.32992 s, 807 MB/s

dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 1.86451 s, 576 MB/s

dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 8.47124 s, 127 MB/s

Code (Text):

-------------------------------------------
disk FIO tests
-------------------------------------------


Running FIO benchmark...

FIO_VERSION = fio-2.0.9

FIO random reads:
randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process
randomreads: Laying out IO file(s) (1 file(s) / 1024MB)

randomreads: (groupid=0, jobs=1): err= 0: pid=19116: Tue May 29 22:38:03 2018
  read : io=1024.3MB, bw=378502KB/s, iops=94625 , runt=  2771msec
  cpu          : usr=7.65%, sys=72.46%, ctx=5507, majf=0, minf=85
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1024.3MB, aggrb=378501KB/s, minb=378501KB/s, maxb=378501KB/s, mint=2771msec, maxt=2771msec

Disk stats (read/write):
    dm-0: ios=253819/229, merge=0/0, ticks=123219/411, in_queue=123633, util=96.48%, aggrios=262207/52, aggrmerge=0/177, aggrticks=127683/74, aggrin_queue=127710, aggrutil=96.02%
  sda: ios=262207/52, merge=0/177, ticks=127683/74, in_queue=127710, util=96.02%

FIO random writes:
randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.0.9
Starting 1 process

randomwrites: (groupid=0, jobs=1): err= 0: pid=19120: Tue May 29 22:38:09 2018
  write: io=1024.3MB, bw=162433KB/s, iops=40608 , runt=  6457msec
  cpu          : usr=4.29%, sys=27.99%, ctx=14326, majf=0, minf=20
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=1024.3MB, aggrb=162432KB/s, minb=162432KB/s, maxb=162432KB/s, mint=6457msec, maxt=6457msec

Disk stats (read/write):
    dm-0: ios=0/260581, merge=0/0, ticks=0/381573, in_queue=381638, util=98.60%, aggrios=0/262211, aggrmerge=0/7, aggrticks=0/384531, aggrin_queue=384497, aggrutil=98.34%
  sda: ios=0/262211, merge=0/7, ticks=0/384531, in_queue=384497, util=98.34%

Code (Text):

-------------------------------------------
ramdisk DD tests - memory bandwidth
-------------------------------------------

dd if=/dev/zero of=sb-io-test bs=128k count=1k conv=fdatasync
1024+0 records in
1024+0 records out
134217728 bytes (134 MB) copied, 0.0802074 s, 1.7 GB/s

dd if=/dev/zero of=sb-io-test bs=8k count=16k conv=fdatasync
16384+0 records in
16384+0 records out
134217728 bytes (134 MB) copied, 0.114051 s, 1.2 GB/s

dd if=/dev/zero of=sb-io-test bs=128k count=1k oflag=dsync
1024+0 records in
1024+0 records out
134217728 bytes (134 MB) copied, 0.0798963 s, 1.7 GB/s

dd if=/dev/zero of=sb-io-test bs=8k count=16k oflag=dsync
16384+0 records in
16384+0 records out
134217728 bytes (134 MB) copied, 0.110998 s, 1.2 GB/s

Code (Text):

-------------------------------------------
ramdisk ioping tests - memory bandwidth
-------------------------------------------


Running IOPing I/O ramdisk benchmark...

IOPing I/O: ./ioping -c 10 .
4.0 KiB from . (tmpfs tmpfs): request=1 time=2 us
4.0 KiB from . (tmpfs tmpfs): request=2 time=17 us
4.0 KiB from . (tmpfs tmpfs): request=3 time=13 us
4.0 KiB from . (tmpfs tmpfs): request=4 time=13 us
4.0 KiB from . (tmpfs tmpfs): request=5 time=12 us
4.0 KiB from . (tmpfs tmpfs): request=6 time=13 us
4.0 KiB from . (tmpfs tmpfs): request=7 time=12 us
4.0 KiB from . (tmpfs tmpfs): request=8 time=10 us
4.0 KiB from . (tmpfs tmpfs): request=9 time=10 us
4.0 KiB from . (tmpfs tmpfs): request=10 time=10 us

--- . (tmpfs tmpfs) ioping statistics ---
10 requests completed in 9.0 s, 89.3 k iops, 348.8 MiB/s
min/avg/max/mdev = 2 us / 11 us / 17 us / 3 us

IOPing seek rate: ./ioping -R .

--- . (tmpfs tmpfs) ioping statistics ---
817.1 k requests completed in 3.0 s, 599.1 k iops, 2.3 GiB/s
min/avg/max/mdev = 0 us / 1 us / 39 us / 0 us

IOPing sequential: ./ioping -RL .

--- . (tmpfs tmpfs) ioping statistics ---
33.8 k requests completed in 3.0 s, 18.2 k iops, 4.4 GiB/s
min/avg/max/mdev = 40 us / 55 us / 138 us / 6 us

IOPing cached: ./ioping -RC .

--- . (tmpfs tmpfs) ioping statistics ---
1.4 M requests completed in 3.0 s, 508.7 k iops, 1.9 GiB/s
min/avg/max/mdev = 0 us / 1 us / 655 us / 1 us

Code (Text):

-------------------------------------------
Running bandwidth benchmark...
-------------------------------------------

----------------------------------------------
Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
Download Cachefly: 131MB/s

-------------------------------------------
USA bandwidth tests...
-------------------------------------------

----------------------------------------------
Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
Download Linode, Atlanta, GA, USA: 121MB/s
----------------------------------------------
Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
Download Linode, Dallas, TX, USA: 158MB/s
----------------------------------------------
Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
Download Leaseweb, Manassas, VA, USA: 56.7MB/s
----------------------------------------------
Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
Download Softlayer, Seattle, WA, USA: 42.0MB/s
----------------------------------------------
Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
Download Softlayer, San Jose, CA, USA: 40.9MB/s
----------------------------------------------
Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
Download Softlayer, Washington, DC, USA: 42.6MB/s
----------------------------------------------
Download from VersaWeb, Las Vegas, Nevada (http://lg.las1.as53340.net/100MB.test)
Download VersaWeb, Las Vegas, Nevada: 10.6MB/s
----------------------------------------------
Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
Download OVH, BHS, Canada: 16.0MB/s
----------------------------------------------
Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Los Angeles, California: 78.3MB/s
----------------------------------------------
Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Seattle, Washington: 50.3MB/s
----------------------------------------------
Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Dallas, Texas: 227MB/s
----------------------------------------------
Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Chicago, Illinois: 86.0MB/s
----------------------------------------------
Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Atlanta, Georgia: 129MB/s
----------------------------------------------
Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Miami, Florida: 78.5MB/s
----------------------------------------------
Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, New York / New Jersey: 57.8MB/s

-------------------------------------------
Asia bandwidth tests...
-------------------------------------------

----------------------------------------------
Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
Download Linode, Tokyo, JP: 19.5MB/s
----------------------------------------------
Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
Download Softlayer, Singapore: 11.0MB/s
----------------------------------------------
Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Tokyo, Japan: 16.6MB/s

-------------------------------------------
Europe bandwidth tests...
-------------------------------------------

----------------------------------------------
Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
Download Linode, London, UK: 18.9MB/s
----------------------------------------------
Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
Download OVH, Paris, France: 15.5MB/s
----------------------------------------------
Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
Download SmartDC, Rotterdam, Netherlands: 8.54MB/s
----------------------------------------------
Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Amsterdam, Netherlands: 19.4MB/s
----------------------------------------------
Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, London, UK: 20.4MB/s
----------------------------------------------
Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Paris, France: 20.1MB/s

-------------------------------------------
Australia bandwidth tests...
-------------------------------------------

----------------------------------------------
Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
Download Vultr, Sydney, Australia: 11.8MB/s

Code (Text):

-------------------------------------------
Running Axel multi-threaded bandwidth benchmark...
-------------------------------------------

----------------------------------------------
Axel Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
Axel Download Cachefly: 196.07MB/s

-------------------------------------------
USA bandwidth tests...
-------------------------------------------

----------------------------------------------
Axel Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
Axel Download Linode, Atlanta, GA, USA: 73.74MB/s
----------------------------------------------
Axel Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
Axel Download Linode, Dallas, TX, USA: 189.70MB/s
----------------------------------------------
Axel Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
Axel Download Leaseweb, Manassas, VA, USA: 93.61MB/s
----------------------------------------------
Axel Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
Axel Download Softlayer, Seattle, WA, USA: 40.08MB/s
----------------------------------------------
Axel Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
Axel Download Softlayer, San Jose, CA, USA: 39.24MB/s
----------------------------------------------
Axel Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
Axel Download Softlayer, Washington, DC, USA: 20.08MB/s
----------------------------------------------
Axel Download from VersaWeb, Las Vegas, Nevada (http://lg.las1.as53340.net/100MB.test)
Axel Download VersaWeb, Las Vegas, Nevada: 32.66MB/s
----------------------------------------------
Axel Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
Axel Download OVH, BHS, Canada: 31.86MB/s
----------------------------------------------
Axel Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Los Angeles, California: 103.38MB/s
----------------------------------------------
Axel Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Seattle, Washington: 64.46MB/s
----------------------------------------------
Axel Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Dallas, Texas: 300.59MB/s
----------------------------------------------
Axel Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Chicago, Illinois: 142.36MB/s
----------------------------------------------
Axel Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Atlanta, Georgia: 131.72MB/s
----------------------------------------------
Axel Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Miami, Florida: 91.56MB/s
----------------------------------------------
Axel Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, New York / New Jersey: 77.20MB/s

-------------------------------------------
Asia bandwidth tests...
-------------------------------------------

----------------------------------------------
Axel Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
Axel Download Linode, Tokyo, JP: 25.89MB/s
----------------------------------------------
Axel Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
Axel Download Softlayer, Singapore: 9.18MB/s
----------------------------------------------
Axel Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Tokyo, Japan: 27.31MB/s

-------------------------------------------
Europe bandwidth tests...
-------------------------------------------

----------------------------------------------
Axel Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
Axel Download Linode, London, UK: 29.93MB/s
----------------------------------------------
Axel Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
Axel Download OVH, Paris, France: 24.54MB/s
----------------------------------------------
Axel Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
Axel Download SmartDC, Rotterdam, Netherlands: 9.31MB/s
----------------------------------------------
Axel Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Amsterdam, Netherlands: 26.01MB/s
----------------------------------------------
Axel Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, London, UK: 31.38MB/s
----------------------------------------------
Axel Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Paris, France: 29.49MB/s

-------------------------------------------
Australia bandwidth tests...
-------------------------------------------

----------------------------------------------
Axel Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
Axel Download Vultr, Sydney, Australia: 15.91MB/s

Code (Text):

-------------------------------------------
Running ping tests...
-------------------------------------------

----------------------------------------------
Pings (cachefly.cachefly.net):
PING vip1.g5.cachefly.net (205.234.175.175) 56(84) bytes of data.
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=1 ttl=58 time=0.407 ms
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=2 ttl=58 time=0.470 ms
64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=3 ttl=58 time=0.679 ms

--- vip1.g5.cachefly.net ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 0.407/0.518/0.679/0.119 ms

----------------------------------------------
Pings (syd-au-ping.vultr.com):
PING syd-au-ping.vultr.com (108.61.212.117) 56(84) bytes of data.
64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=1 ttl=51 time=197 ms
64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=2 ttl=51 time=197 ms
64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=3 ttl=51 time=197 ms

--- syd-au-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 197.334/197.441/197.631/0.386 ms

----------------------------------------------
Pings (hnd-jp-ping.vultr.com):
PING hnd-jp-ping.vultr.com (108.61.201.151) 56(84) bytes of data.
64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=1 ttl=49 time=145 ms
64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=2 ttl=49 time=145 ms
64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=3 ttl=49 time=145 ms

--- hnd-jp-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 145.630/145.671/145.700/0.441 ms

----------------------------------------------
Pings (lax-ca-us-ping.vultr.com):
PING lax-ca-us-ping.vultr.com (108.61.219.200) 56(84) bytes of data.
64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=1 ttl=54 time=29.5 ms
64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=2 ttl=54 time=29.7 ms
64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=3 ttl=54 time=29.7 ms

--- lax-ca-us-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 29.526/29.690/29.786/0.116 ms

----------------------------------------------
Pings (wa-us-ping.vultr.com):
PING wa-us-ping.vultr.com (108.61.194.105) 56(84) bytes of data.
64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=1 ttl=56 time=45.7 ms
64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=2 ttl=56 time=45.8 ms
64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=3 ttl=56 time=46.0 ms

--- wa-us-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 45.793/45.879/46.032/0.108 ms

----------------------------------------------
Pings (tx-us-ping.vultr.com):
PING tx-us-ping.vultr.com (108.61.224.175) 56(84) bytes of data.
64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=1 ttl=55 time=0.662 ms
64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=2 ttl=55 time=1.06 ms
64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=3 ttl=55 time=0.807 ms

--- tx-us-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2000ms
rtt min/avg/max/mdev = 0.662/0.843/1.062/0.168 ms

----------------------------------------------
Pings (il-us-ping.vultr.com):
PING il-us-ping.vultr.com (107.191.51.12) 56(84) bytes of data.
64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=1 ttl=55 time=26.9 ms
64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=2 ttl=55 time=27.0 ms
64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=3 ttl=55 time=27.0 ms

--- il-us-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 26.954/26.994/27.020/0.028 ms

----------------------------------------------
Pings (ga-us-ping.vultr.com):
PING ga-us-ping.vultr.com (108.61.193.166) 56(84) bytes of data.
64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=1 ttl=54 time=18.6 ms
64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=2 ttl=54 time=18.7 ms
64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=3 ttl=54 time=18.6 ms

--- ga-us-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 18.612/18.680/18.744/0.053 ms

----------------------------------------------
Pings (fl-us-ping.vultr.com):
PING fl-us-ping.vultr.com (104.156.244.232) 56(84) bytes of data.
64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=1 ttl=54 time=33.5 ms
64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=2 ttl=54 time=33.5 ms
64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=3 ttl=54 time=33.7 ms

--- fl-us-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 33.533/33.602/33.735/0.176 ms

----------------------------------------------
Pings (nj-us-ping.vultr.com):
PING nj-us-ping.vultr.com (108.61.149.182) 56(84) bytes of data.
64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=1 ttl=54 time=46.3 ms
64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=2 ttl=54 time=46.4 ms
64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=3 ttl=54 time=46.5 ms

--- nj-us-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 46.397/46.458/46.542/0.186 ms

----------------------------------------------
Pings (fra-de-ping.vultr.com):
PING fra-de-ping.vultr.com (108.61.210.117) 56(84) bytes of data.
64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=1 ttl=52 time=130 ms
64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=2 ttl=52 time=130 ms
64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=3 ttl=52 time=130 ms

--- fra-de-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 130.619/130.677/130.710/0.298 ms

----------------------------------------------
Pings (ams-nl-ping.vultr.com):
PING ams-nl-ping.vultr.com (108.61.198.102) 56(84) bytes of data.
64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=1 ttl=51 time=123 ms
64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=2 ttl=51 time=123 ms
64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=3 ttl=51 time=123 ms

--- ams-nl-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 123.408/123.482/123.520/0.052 ms

----------------------------------------------
Pings (lon-gb-ping.vultr.com):
PING lon-gb-ping.vultr.com (108.61.196.101) 56(84) bytes of data.
64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=1 ttl=52 time=107 ms
64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=2 ttl=52 time=107 ms
64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=3 ttl=52 time=107 ms

--- lon-gb-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 107.330/107.405/107.498/0.384 ms

----------------------------------------------
Pings (par-fr-ping.vultr.com):
PING par-fr-ping.vultr.com (108.61.209.127) 56(84) bytes of data.
64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=1 ttl=52 time=109 ms
64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=2 ttl=52 time=109 ms
64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=3 ttl=52 time=109 ms

--- par-fr-ping.vultr.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 109.225/109.360/109.560/0.408 ms

----------------------------------------------
Pings (VersaWeb Las Vegas):
PING 104.143.15.254 (104.143.15.254) 56(84) bytes of data.
From 192.228.109.50 icmp_seq=1 Time to live exceeded
From 192.228.109.50 icmp_seq=2 Time to live exceeded
From 192.228.109.50 icmp_seq=3 Time to live exceeded

--- 104.143.15.254 ping statistics ---
3 packets transmitted, 0 received, +3 errors, 100% packet loss, time 2002ms


----------------------------------------------
Pings (VersaWeb Seattle):
PING 76.164.234.1 (76.164.234.1) 56(84) bytes of data.
64 bytes from 76.164.234.1: icmp_seq=1 ttl=54 time=54.9 ms
64 bytes from 76.164.234.1: icmp_seq=2 ttl=54 time=55.0 ms
64 bytes from 76.164.234.1: icmp_seq=3 ttl=54 time=54.9 ms

--- 76.164.234.1 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 54.960/55.008/55.089/0.057 ms

----------------------------------------------
Pings (OVH Canada):
PING bhs.proof.ovh.net (192.99.19.165) 56(84) bytes of data.
64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=1 ttl=54 time=36.0 ms
64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=2 ttl=54 time=36.0 ms
64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=3 ttl=54 time=36.0 ms

--- bhs.proof.ovh.net ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 36.029/36.063/36.084/0.156 ms

----------------------------------------------
Pings (10gbps.io Frankfurt):
PING 195.181.174.20 (195.181.174.20) 56(84) bytes of data.
64 bytes from 195.181.174.20: icmp_seq=1 ttl=57 time=122 ms
64 bytes from 195.181.174.20: icmp_seq=2 ttl=57 time=122 ms
64 bytes from 195.181.174.20: icmp_seq=3 ttl=57 time=122 ms

--- 195.181.174.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 122.802/122.806/122.811/0.003 ms

----------------------------------------------
Pings (10gbps.io London):
PING 185.59.221.20 (185.59.221.20) 56(84) bytes of data.
64 bytes from 185.59.221.20: icmp_seq=1 ttl=51 time=107 ms
64 bytes from 185.59.221.20: icmp_seq=2 ttl=51 time=107 ms
64 bytes from 185.59.221.20: icmp_seq=3 ttl=51 time=107 ms

--- 185.59.221.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 107.713/107.718/107.722/0.003 ms

----------------------------------------------
Pings (10gbps.io Paris):
PING 185.93.2.193 (185.93.2.193) 56(84) bytes of data.
64 bytes from 185.93.2.193: icmp_seq=1 ttl=51 time=130 ms
64 bytes from 185.93.2.193: icmp_seq=2 ttl=51 time=130 ms
64 bytes from 185.93.2.193: icmp_seq=3 ttl=51 time=130 ms

--- 185.93.2.193 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 130.198/130.263/130.336/0.420 ms

----------------------------------------------
Pings (10gbps.io Singapore):
PING 203.174.85.38 (203.174.85.38) 56(84) bytes of data.
64 bytes from 203.174.85.38: icmp_seq=1 ttl=54 time=206 ms
64 bytes from 203.174.85.38: icmp_seq=2 ttl=54 time=206 ms
64 bytes from 203.174.85.38: icmp_seq=3 ttl=54 time=206 ms

--- 203.174.85.38 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 206.487/206.518/206.559/0.372 ms

----------------------------------------------
Pings (10gbps.io Stockholm):
PING 185.76.9.10 (185.76.9.10) 56(84) bytes of data.
64 bytes from 185.76.9.10: icmp_seq=1 ttl=54 time=144 ms
64 bytes from 185.76.9.10: icmp_seq=2 ttl=54 time=144 ms
64 bytes from 185.76.9.10: icmp_seq=3 ttl=54 time=144 ms

--- 185.76.9.10 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 144.432/144.535/144.609/0.445 ms

----------------------------------------------
Pings (10gbps.io Moscow):
PING 87.245.204.20 (87.245.204.20) 56(84) bytes of data.
64 bytes from 87.245.204.20: icmp_seq=1 ttl=56 time=161 ms
64 bytes from 87.245.204.20: icmp_seq=2 ttl=56 time=161 ms
64 bytes from 87.245.204.20: icmp_seq=3 ttl=56 time=161 ms

--- 87.245.204.20 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 161.127/161.154/161.183/0.464 ms

----------------------------------------------
Pings (10gbps.io Miami):
PING 195.181.162.195 (195.181.162.195) 56(84) bytes of data.
64 bytes from 195.181.162.195: icmp_seq=1 ttl=56 time=30.9 ms
64 bytes from 195.181.162.195: icmp_seq=2 ttl=56 time=30.9 ms
64 bytes from 195.181.162.195: icmp_seq=3 ttl=56 time=30.8 ms

--- 195.181.162.195 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2002ms
rtt min/avg/max/mdev = 30.858/30.913/30.968/0.044 ms

Code (Text):

-------------------------------------------
Running mtr tests...
-------------------------------------------

----------------------------------------------
mtr --report -w 200 --report-cycles=10 cachefly.cachefly.net
Start: Tue May 29 22:42:31 2018
HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                    0.0%    10    1.1   1.0   0.8   1.2   0.0
  2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                     0.0%    10    0.8   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                     0.0%    10    0.5   0.6   0.5   1.5   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.8   1.2   0.5   4.2   0.9
  6.|-- et-0-0-49.cr10-dal3.ip4.gtt.net  0.0%    10    0.6   1.7   0.5   6.7   2.0
  7.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
  8.|-- vip1.G-anycast1.cachefly.net     0.0%    10    0.4   0.5   0.4   0.7   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.atlanta.linode.com
Start: Tue May 29 22:42:47 2018
HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                  0.0%    10    0.8   0.9   0.8   1.1   0.0
  2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                   0.0%    10    0.6   0.6   0.6   0.7   0.0
  4.|-- 144.168.32.1                   0.0%    10    0.5   1.6   0.5  11.6   3.4
  5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.6   0.7   0.5   1.3   0.0
  6.|-- xe-5-0-2.cr1-atl1.ip4.gtt.net  0.0%    10   18.5  18.5  18.4  18.7   0.0
  7.|-- ip4.gtt.net                    0.0%    10   18.9  19.0  18.9  19.1   0.0
  8.|-- 74.207.239.19                  0.0%    10   19.2  18.9  18.8  19.2   0.0
  9.|-- speedtest.atlanta.linode.com   0.0%    10   23.3  20.8  18.7  25.3   2.5

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.dallas.linode.com
Start: Tue May 29 22:43:04 2018
HOST: hostname         Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                0.0%    10    0.8   0.9   0.7   1.2   0.0
  2.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                 0.0%    10    0.7   0.7   0.6   0.9   0.0
  4.|-- 144.168.32.1                 0.0%    10    0.6   0.6   0.5   0.6   0.0
  5.|-- eqix-ix-da.linode.com        0.0%    10    1.4   1.4   1.3   1.5   0.0
  6.|-- 45.79.12.3                   0.0%    10    1.4   1.6   1.4   1.9   0.0
  7.|-- speedtest.dallas.linode.com  0.0%    10    1.3   1.3   1.2   1.4   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 mirror.us.leaseweb.net
Start: Tue May 29 22:43:22 2018
HOST: hostname              Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                     0.0%    10    1.0   2.0   0.8  11.9   3.4
  2.|-- ???                              100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                      0.0%    10    0.7   0.8   0.6   1.7   0.0
  4.|-- 144.168.32.1                      0.0%    10    0.6   0.5   0.4   0.6   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net        0.0%    10    0.8   3.3   0.6  15.8   5.5
  6.|-- xe-3-1-3.cr0-was1.ip4.gtt.net     0.0%    10   36.6  36.7  36.2  37.5   0.0
  7.|-- ip4.gtt.net                       0.0%    10   34.1  34.4  34.1  34.6   0.0
  8.|-- po-1.ce01.wdc-01.us.leaseweb.net  0.0%    10   33.8  33.7  33.6  33.8   0.0
  9.|-- 207.244.94.80                     0.0%    10   33.8  33.7  33.6  33.8   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.sea01.softlayer.com
Start: Tue May 29 22:43:39 2018
HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                            0.0%    10    0.8   1.0   0.8   1.3   0.0
  2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                             0.0%    10    0.7   0.7   0.6   0.7   0.0
  4.|-- 144.168.32.1                             0.0%    10    0.6   0.6   0.5   0.7   0.0
  5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.6   0.7   0.6   1.2   0.0
  6.|-- ae5.cbs01.eq01.dal03.networklayer.com   80.0%    10    1.9   1.9   1.9   2.0   0.0
  7.|-- ae1.cbs01.cs01.den01.networklayer.com    0.0%    10   19.8  19.9  19.7  20.1   0.0
  8.|-- ae0.cbs01.wb01.sea02.networklayer.com    0.0%    10   45.4  45.7  45.3  47.3   0.5
  9.|-- 77.12.2da9.ip4.static.sl-reverse.com     0.0%    10   44.6  46.6  44.6  62.6   5.6
 10.|-- ae0.dar01.sr01.sea01.networklayer.com    0.0%    10   44.8  44.7  44.5  44.8   0.0
 11.|-- po1.fcr01.sr01.sea01.networklayer.com    0.0%    10   42.7  43.4  42.7  47.5   1.4
 12.|-- speedtest.sea01.softlayer.com            0.0%    10   44.6  44.7  44.6  44.9   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.sjc01.softlayer.com
Start: Tue May 29 22:43:55 2018
HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                            0.0%    10    0.9   0.9   0.7   1.1   0.0
  2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                             0.0%    10    0.7   0.8   0.6   1.7   0.0
  4.|-- 144.168.32.1                             0.0%    10    0.6   0.6   0.5   0.7   0.0
  5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.6   2.0   0.6  13.7   4.1
  6.|-- ae5.cbs01.eq01.dal03.networklayer.com   80.0%    10    1.5   1.5   1.5   1.6   0.0
  7.|-- ae8.cbs01.dr01.dal04.networklayer.com   90.0%    10    5.0   5.0   5.0   5.0   0.0
  8.|-- ae2.cbs01.cs01.lax01.networklayer.com   60.0%    10   30.7  30.6  30.3  30.9   0.0
  9.|-- ae7.cbs02.cs01.lax01.networklayer.com   60.0%    10   30.8  30.7  30.5  30.8   0.0
 10.|-- ae0.cbs02.eq01.sjc02.networklayer.com   60.0%    10   38.0  37.7  37.4  38.0   0.0
 11.|-- ae24.bbr01.eq01.sjc02.networklayer.com   0.0%    10   37.1  37.0  36.8  37.3   0.0
 12.|-- ae5.dar01.sjc01.networklayer.com         0.0%    10   39.2  39.1  38.8  40.2   0.3
 13.|-- po1.fcr01.sr01.sjc01.networklayer.com    0.0%    10   37.3  37.3  37.1  38.6   0.3
 14.|-- speedtest.sjc01.softlayer.com            0.0%    10   37.2  37.1  37.0  37.2   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.wdc01.softlayer.com
Start: Tue May 29 22:44:11 2018
HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                            0.0%    10    0.8   0.9   0.7   1.2   0.0
  2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                             0.0%    10    0.7   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                             0.0%    10    0.5   1.4   0.5   6.0   1.9
  5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.7   1.1   0.5   5.1   1.4
  6.|-- ae5.cbs02.eq01.dal03.networklayer.com   70.0%    10    1.5   1.5   1.5   1.5   0.0
  7.|-- ae0.cbs01.tl01.atl01.networklayer.com   40.0%    10   19.2  19.2  18.9  19.5   0.0
  8.|-- ae0.cbs01.eq01.wdc02.networklayer.com   30.0%    10   31.4  31.6  31.3  31.9   0.0
  9.|-- ae29.bbr02.eq01.wdc02.networklayer.com   0.0%    10   31.7  33.1  31.7  42.5   3.3
 10.|-- ae1.dar01.wdc01.networklayer.com         0.0%    10   31.2  31.4  31.0  32.4   0.3
 11.|-- po1.fcr01.sr01.wdc01.networklayer.com    0.0%    10   31.2  31.3  31.0  32.1   0.0
 12.|-- speedtest.wdc01.softlayer.com            0.0%    10   29.3  29.4  29.2  29.6   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.tokyo.linode.com
Start: Tue May 29 22:44:27 2018
HOST: hostname            Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                   0.0%    10    1.0   1.0   0.8   1.2   0.0
  2.|-- ???                            100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                    0.0%    10    0.6   0.7   0.6   0.9   0.0
  4.|-- 144.168.32.1                    0.0%    10    0.5   1.5   0.5  10.0   2.9
  5.|-- ae32.cr11-dal3.ip4.gtt.net      0.0%    10    0.6   1.0   0.5   1.7   0.0
  6.|-- et-0-0-67.cr4-lax2.ip4.gtt.net  0.0%    10   36.8  28.8  27.4  36.8   2.9
  7.|-- ip4.gtt.net                     0.0%    10   27.5  36.2  27.4  78.5  18.4
  8.|-- lacGCS001.int-gw.kddi.ne.jp     0.0%    10   27.6  28.5  27.5  37.4   3.0
  9.|-- 106.187.12.1                    0.0%    10  130.6 145.3 129.9 274.4  45.4
 10.|-- 27.85.134.162                   0.0%    10  139.9 140.0 139.7 141.1   0.0
 11.|-- cm-fcu204.kddnet.ad.jp          0.0%    10  134.1 134.3 130.2 140.5   4.1
 12.|-- 124.215.199.170                 0.0%    10  135.1 135.2 135.1 135.3   0.0
 13.|-- speedtest.tokyo.linode.com      0.0%    10  136.3 136.1 135.9 136.5   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.sng01.softlayer.com
Start: Tue May 29 22:44:46 2018
HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                            0.0%    10    0.8   1.1   0.8   2.1   0.0
  2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                             0.0%    10    0.6   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                             0.0%    10    0.5   0.7   0.4   2.6   0.6
  5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.7   4.5   0.6  39.1  12.1
  6.|-- ae5.cbs01.eq01.dal03.networklayer.com   50.0%    10    1.7   2.2   1.5   3.0   0.5
  7.|-- ae8.cbs01.dr01.dal04.networklayer.com   70.0%    10    2.6   2.6   2.6   2.6   0.0
  8.|-- ae2.cbs01.cs01.lax01.networklayer.com   60.0%    10   30.3  30.3  30.2  30.4   0.0
  9.|-- ae7.cbs02.cs01.lax01.networklayer.com   90.0%    10   30.3  30.3  30.3  30.3   0.0
 10.|-- ae0.cbs02.eq01.sjc02.networklayer.com   50.0%    10   39.7  39.5  39.2  39.7   0.0
 11.|-- ae24.bbr02.eq01.sjc02.networklayer.com   0.0%    10   38.6  39.1  38.6  41.7   0.8
 12.|-- ae0.bbr01.eq01.tok01.networklayer.com    0.0%    10  137.6 138.2 137.6 140.4   0.7
 13.|-- ae5.cbs01.eq01.tok01.networklayer.com   60.0%    10  138.7 138.7 138.5 138.9   0.0
 14.|-- ae0.cbs01.eq01.sng02.networklayer.com   22.2%     9  207.4 207.5 207.3 207.7   0.0
 15.|-- ad.13.2da9.ip4.static.sl-reverse.com     0.0%     9  217.4 219.2 217.2 233.6   5.4
 16.|-- ae5.dar01.sng01.networklayer.com         0.0%     9  216.1 217.5 216.1 227.1   3.6
 17.|-- po1.fcr01.sr03.sng01.networklayer.com    0.0%     9  211.4 227.1 211.2 304.8  30.1
 18.|-- speedtest.sng01.softlayer.com            0.0%     9  215.6 215.7 215.6 215.8   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 speedtest.london.linode.com
Start: Tue May 29 22:45:03 2018
HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                    0.0%    10    0.9   1.0   0.9   1.1   0.0
  2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                     0.0%    10    0.7   0.7   0.6   0.9   0.0
  4.|-- 144.168.32.1                    10.0%    10    0.5   1.4   0.5   8.0   2.4
  5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.5   0.9   0.5   3.0   0.7
  6.|-- et-0-0-55.cr11-lon2.ip4.gtt.net  0.0%    10  119.1 119.9 118.7 126.9   2.4
  7.|-- ip4.gtt.net                      0.0%    10  119.9 120.5 119.8 122.2   0.6
  8.|-- 109.74.207.27                    0.0%    10  119.7 119.9 119.7 120.2   0.0
  9.|-- speedtest.london.linode.com      0.0%    10  119.5 119.7 119.5 119.9   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 mirror.i3d.net
Start: Tue May 29 22:45:19 2018
HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                        0.0%    10    0.8   0.9   0.8   1.1   0.0
  2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                         0.0%    10    0.7   0.7   0.6   0.9   0.0
  4.|-- 144.168.32.1                         0.0%    10    0.5   2.2   0.5  16.8   5.1
  5.|-- eqix-da1.misi3d.com                  0.0%    10    0.6   1.0   0.6   2.6   0.5
  6.|-- 10ge.iadr0-dfwr0.csva01.iad.i3d.net  0.0%    10   40.8  40.0  35.6  46.4   4.0
  7.|-- 10ge.lr0-iadr0.th-n.lhr.i3d.net      0.0%    10  107.5 107.9 107.3 110.8   1.0
  8.|-- 30ge.cr0-lr0.smartdc.rtm.i3d.net     0.0%    10  113.7 114.0 113.5 116.2   0.7
  9.|-- 100ge.br3-cr0.smartdc.rtm.i3d.net    0.0%    10  113.5 113.3 113.2 113.5   0.0
 10.|-- hosted-by.i3d.net                    0.0%    10  113.6 113.5 113.4 113.6   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 syd-au-ping.vultr.com
Start: Tue May 29 22:45:36 2018
HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                            0.0%    10    1.0   1.1   0.7   2.3   0.3
  2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                             0.0%    10    0.6   0.8   0.6   1.7   0.0
  4.|-- 144.168.32.1                             0.0%    10    0.5   3.2   0.5  27.0   8.4
  5.|-- eqix-da1.vocus.com                       0.0%    10   38.0  37.7  37.3  38.7   0.3
  6.|-- bundle-153.cor02.lax01.ca.vocus.net      0.0%    10  201.8 201.8 201.7 202.1   0.0
  7.|-- 100g-0-0-0-0.cor02.sjc01.ca.vocus.net    0.0%    10  192.7 193.1 192.5 197.0   1.2
  8.|-- 100g-0-0-0-0.cor01.sjc01.ca.vocus.net    0.0%    10  197.6 197.7 197.6 197.9   0.0
  9.|-- BE-200.cor02.syd04.nsw.VOCUS.net.au      0.0%    10  201.9 201.9 201.8 202.0   0.0
 10.|-- bundle-101.bdr01.syd03.nsw.vocus.net.au  0.0%    10  202.1 202.3 202.0 203.6   0.3
 11.|-- static-73.7.255.49.in-addr.VOCUS.net.au  0.0%    10  197.8 197.7 197.6 197.9   0.0
 12.|-- xe-1-0-1.gw102.sy3.ap.equinix.com        0.0%    10  197.5 200.6 197.5 226.6   9.1
 13.|-- 180.189.25.6                            10.0%    10  201.9 202.5 201.7 206.7   1.4
 14.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
 15.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
 16.|-- 108.61.212.117.vultr.com                 0.0%    10  197.5 197.5 197.4 197.7   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 hnd-jp-ping.vultr.com
Start: Tue May 29 22:45:55 2018
HOST: hostname                        Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                               0.0%    10    0.9   1.0   0.9   1.4   0.0
  2.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                                0.0%    10    0.7   0.7   0.6   0.7   0.0
  4.|-- 144.168.32.1                                0.0%    10    0.6   0.6   0.5   0.7   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net                  0.0%    10    1.1   2.4   0.5  11.7   3.3
  6.|-- as2914.cr11-dal3.ip4.gtt.net                0.0%    10    0.9   1.0   0.8   1.3   0.0
  7.|-- ae-1.r23.dllstx09.us.bb.gin.ntt.net         0.0%    10    8.8   2.3   0.8   8.8   2.7
  8.|-- ae-8.r23.snjsca04.us.bb.gin.ntt.net         0.0%    10   39.2  39.2  38.9  40.7   0.5
  9.|-- ae-21.r30.tokyjp05.jp.bb.gin.ntt.net       20.0%    10  145.8 145.5 145.3 145.8   0.0
 10.|-- ae-2.r02.tokyjp05.jp.bb.gin.ntt.net         0.0%    10  144.0 144.1 144.0 144.5   0.0
 11.|-- ce-0-14-0-1.r02.tokyjp05.jp.ce.gin.ntt.net  0.0%    10  146.5 148.8 146.3 160.5   4.6
 12.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
 13.|-- vl516-ds1-b5-r2605.tyo1.choopa.net          0.0%    10  146.8 146.8 146.7 146.9   0.0
 14.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
 15.|-- 108.61.201.151.vultr.com                    0.0%    10  146.0 145.8 145.7 146.1   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 lax-ca-us-ping.vultr.com
Start: Tue May 29 22:46:13 2018
HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                  0.0%    10    0.8   1.3   0.8   2.1   0.0
  2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                   0.0%    10    0.7   0.6   0.6   0.7   0.0
  4.|-- 144.168.32.1                   0.0%    10    0.5   0.7   0.5   1.6   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.9   3.0   0.5  12.8   5.0
  6.|-- et-8-3-0.cr2-lax2.ip4.gtt.net  0.0%    10   27.5  27.6  27.4  27.9   0.0
  7.|-- as20473-gw.lax20.ip4.gtt.net   0.0%    10   29.6  33.4  29.6  39.8   3.9
  8.|-- 10.68.1.162                    0.0%    10   33.4  35.9  32.8  47.6   5.3
  9.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
 10.|-- 108.61.219.200.vultr.com       0.0%    10   29.8  29.8  29.7  29.8   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 wa-us-ping.vultr.com
Start: Tue May 29 22:46:29 2018
HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                  0.0%    10    0.8   1.0   0.8   1.2   0.0
  2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                   0.0%    10    0.8   0.8   0.6   1.5   0.0
  4.|-- 144.168.32.1                   0.0%    10    0.6   1.4   0.5   8.5   2.4
  5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.8   3.9   0.5  16.1   5.2
  6.|-- xe-1-0-2.cr3-sea2.ip4.gtt.net  0.0%    10   45.9  45.9  45.8  46.2   0.0
  7.|-- choopa-gw.ip4.gtt.net          0.0%    10   46.1  46.0  45.9  46.1   0.0
  8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  9.|-- 108.61.194.105.vultr.com       0.0%    10   46.0  46.0  45.8  46.1   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 tx-us-ping.vultr.com
Start: Tue May 29 22:46:47 2018
HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                  0.0%    10    0.8   0.9   0.8   1.3   0.0
  2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                   0.0%    10    0.7   0.7   0.6   1.0   0.0
  4.|-- 144.168.32.1                   0.0%    10    0.6   0.6   0.5   1.0   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.6   1.8   0.5  11.9   3.5
  6.|-- xe-3-0-0.cr0-dal2.ip4.gtt.net  0.0%    10    0.7   1.1   0.7   3.4   0.7
  7.|-- ip4.gtt.net                   70.0%    10    0.7   2.3   0.7   5.4   2.5
  8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  9.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
 10.|-- 108.61.224.175.vultr.com       0.0%    10    0.7   0.8   0.7   1.1   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 il-us-ping.vultr.com
Start: Tue May 29 22:47:03 2018
HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                       0.0%    10    0.9   1.0   0.8   1.8   0.0
  2.|-- ???                                100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                        0.0%    10    0.6   0.8   0.5   2.3   0.5
  4.|-- 144.168.32.1                        0.0%    10    0.5   2.1   0.5  16.4   5.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net          0.0%    10    1.6   0.9   0.5   1.6   0.0
  6.|-- xe-4-3-7.cr1-chi1.ip4.gtt.net       0.0%    10   26.1  26.4  26.1  28.4   0.5
  7.|-- ip4.gtt.net                         0.0%    10   28.7  28.8  28.1  29.5   0.0
  8.|-- vl820-ds1-b5-gj178.chi2.choopa.net  0.0%    10   27.8  27.9  27.5  30.4   0.7
  9.|-- ???                                100.0    10    0.0   0.0   0.0   0.0   0.0
 10.|-- 107.191.51.12.vultr.com             0.0%    10   27.1  27.1  27.0  27.3   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 ga-us-ping.vultr.com
Start: Tue May 29 22:47:21 2018
HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                        0.0%    10    0.8   1.0   0.8   1.9   0.0
  2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                         0.0%    10    0.7   0.7   0.6   0.7   0.0
  4.|-- 144.168.32.1                         0.0%    10    0.6   0.5   0.5   0.6   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10    0.8   1.3   0.5   5.9   1.6
  6.|-- et-0-0-67.cr10-dal3.ip4.gtt.net      0.0%    10    0.7   1.7   0.6   8.1   2.4
  7.|-- dls-b21-link.telia.net               0.0%    10    0.9   2.8   0.6   9.9   3.4
  8.|-- atl-b22-link.telia.net               0.0%    10   18.8  28.8  18.8 107.3  27.6
  9.|-- atl-b21-link.telia.net               0.0%    10   18.6  18.6  18.6  18.7   0.0
 10.|-- vultr-ic-319646-atl-b21.c.telia.net  0.0%    10   19.0  18.8  18.6  19.0   0.0
 11.|-- 10.77.0.78                           0.0%    10   21.9  23.7  21.7  34.6   4.3
 12.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
 13.|-- 108.61.193.166.vultr.com             0.0%    10   18.7  18.8  18.6  19.1   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 fl-us-ping.vultr.com
Start: Tue May 29 22:47:38 2018
HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                 0.0%    10    1.0   1.1   0.8   2.1   0.0
  2.|-- ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                  0.0%    10    0.7   0.6   0.5   0.8   0.0
  4.|-- 144.168.32.1                  0.0%    10    0.5   0.7   0.5   2.1   0.3
  5.|-- ae32.cr11-dal3.ip4.gtt.net    0.0%    10    1.4   1.6   0.5   8.2   2.3
  6.|-- cr2-mia1.ip4.gtt.net          0.0%    10   29.6  30.0  29.5  32.9   0.8
  7.|-- as20473-gw.mia12.ip4.gtt.net  0.0%    10   31.9  30.6  30.3  31.9   0.5
  8.|-- 10.73.1.26                    0.0%    10   30.4  31.0  30.2  37.9   2.4
  9.|-- ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
 10.|-- 104.156.244.232               0.0%    10   33.7  33.7  33.6  33.8   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 nj-us-ping.vultr.com
Start: Tue May 29 22:47:55 2018
HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                    0.0%    10    1.0   0.9   0.8   1.2   0.0
  2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                     0.0%    10    0.7   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                     0.0%    10   12.2   1.7   0.5  12.2   3.7
  5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    2.4   5.5   0.5  12.6   4.1
  6.|-- xe-8-2-3.cr2-nyc6.ip4.gtt.net    0.0%    10   45.8  47.2  45.7  59.5   4.3
  7.|-- as20473-gw.nyc62.ip4.gtt.net     0.0%    10   48.3  48.2  47.0  51.3   1.5
  8.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
  9.|-- vl139-c4-3-b5-2.pnj1.choopa.net  0.0%    10   47.1  47.1  46.9  47.2   0.0
 10.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
 11.|-- 108.61.149.182.vultr.com         0.0%    10   40.6  43.0  40.5  46.7   3.1

----------------------------------------------
mtr --report -w 200 --report-cycles=10 fra-de-ping.vultr.com
Start: Tue May 29 22:48:11 2018
HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                  0.0%    10    0.8   0.8   0.7   1.0   0.0
  2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                   0.0%    10    1.1   0.8   0.7   1.1   0.0
  4.|-- 144.168.32.1                   0.0%    10    0.6   1.4   0.5   8.6   2.5
  5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.8   0.9   0.6   1.5   0.0
  6.|-- xe-8-2-0.cr1-fra2.ip4.gtt.net  0.0%    10  124.5 125.2 124.5 127.5   1.0
  7.|-- ip4.gtt.net                   80.0%    10  130.7 130.8 130.7 130.9   0.0
  8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  9.|-- 108.61.210.117.vultr.com       0.0%    10  130.8 130.8 130.7 131.0   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 ams-nl-ping.vultr.com
Start: Tue May 29 22:48:28 2018
HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                        0.0%    10    1.1   1.2   0.8   2.0   0.0
  2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                         0.0%    10    1.0   0.9   0.6   1.8   0.0
  4.|-- 144.168.32.1                         0.0%    10    0.5   0.6   0.5   1.1   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10   13.6   2.7   0.6  13.6   4.1
  6.|-- as2914.cr11-dal3.ip4.gtt.net         0.0%    10    0.9   1.0   0.7   1.2   0.0
  7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net  0.0%    10    1.3   1.1   0.6   3.3   0.6
  8.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  0.0%    10   37.6  37.7  37.5  38.4   0.0
  9.|-- ae-0.r23.asbnva02.us.bb.gin.ntt.net  0.0%    10   42.0  38.4  37.5  42.0   1.4
 10.|-- ae-2.r25.amstnl02.nl.bb.gin.ntt.net  0.0%    10  125.6 123.9 122.6 131.2   2.7
 11.|-- ae-1.a02.amstnl02.nl.bb.gin.ntt.net  0.0%    10  123.5 123.5 122.6 126.8   1.2
 12.|-- 81.20.72.122                        20.0%    10  123.7 124.5 123.5 129.0   1.8
 13.|-- vl10-ds1-b5-51917.ams1.choopa.net   50.0%    10  127.4 177.7 127.4 293.9  68.8
 14.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
 15.|-- 108.61.198.102.vultr.com             0.0%    10  123.6 124.2 123.5 129.4   1.8

----------------------------------------------
mtr --report -w 200 --report-cycles=10 lon-gb-ping.vultr.com
Start: Tue May 29 22:48:45 2018
HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                         0.0%    10    0.8   1.1   0.8   2.5   0.3
  2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                          0.0%    10    0.7   0.7   0.5   0.7   0.0
  4.|-- 144.168.32.1                          0.0%    10    0.6   2.4   0.5  18.8   5.7
  5.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    2.4   1.1   0.6   2.4   0.3
  6.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    1.1   0.9   0.7   1.3   0.0
  7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.0   1.3   0.8   2.8   0.5
  8.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net   0.0%    10   37.6  38.5  37.6  40.4   0.5
  9.|-- ae-5.r25.nycmny01.us.bb.gin.ntt.net   0.0%    10   41.5  41.0  40.2  45.4   1.5
 10.|-- ae-1.r24.nycmny01.us.bb.gin.ntt.net   0.0%    10   43.7  44.7  43.0  50.3   2.6
 11.|-- ae-9.r24.londen12.uk.bb.gin.ntt.net   0.0%    10  116.0 116.2 116.0 116.7   0.0
 12.|-- ae-21.r00.londen10.uk.bb.gin.ntt.net  0.0%    10  107.7 107.6 107.5 107.8   0.0
 13.|-- 5.158.213.46                          0.0%    10  111.8 110.3 108.0 115.1   2.4
 14.|-- 10.69.1.90                            0.0%    10  110.6 109.3 108.3 114.1   1.7
 15.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
 16.|-- 108.61.196.101.vultr.com              0.0%    10  107.8 107.6 107.4 107.8   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 par-fr-ping.vultr.com
Start: Tue May 29 22:49:02 2018
HOST: hostname              Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                     0.0%    10    1.7   1.0   0.8   1.7   0.0
  2.|-- ???                              100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                      0.0%    10    0.7   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                      0.0%    10    0.5   0.5   0.5   0.6   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net        0.0%    10    1.1   1.1   0.5   3.1   0.7
  6.|-- xe-5-1-5.cr0-par7.ip4.gtt.net     0.0%    10  118.0 118.0 117.9 118.1   0.0
  7.|-- ip4.gtt.net                       0.0%    10  113.6 113.7 113.6 114.3   0.0
  8.|-- 93-134-167-89.packetexchange.net  0.0%    10  112.8 112.8 112.4 114.1   0.0
  9.|-- ???                              100.0    10    0.0   0.0   0.0   0.0   0.0
 10.|-- 108.61.209.127.vultr.com          0.0%    10  109.5 109.5 109.4 109.6   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 VersaWeb Las Vegas
Start: Tue May 29 22:49:19 2018
HOST: hostname                    Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                           0.0%    10    0.9   0.9   0.8   1.1   0.0
  2.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                            0.0%    10    0.6   0.6   0.6   0.7   0.0
  4.|-- 144.168.32.1                            0.0%    10    0.6   0.6   0.5   1.0   0.0
  5.|-- 10gigabitethernet3-1.core1.dal1.he.net  0.0%    10    0.6   0.6   0.5   0.7   0.0
  6.|-- 100ge4-2.core1.phx2.he.net              0.0%    10   24.0  23.5  19.4  29.1   3.7
  7.|-- 100ge11-2.core1.lax2.he.net             0.0%    10   28.2  31.3  28.2  38.7   3.8
  8.|-- 10ge4-3.core1.las1.he.net               0.0%    10   44.1  38.2  35.3  45.1   3.8
  9.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
 10.|-- 192.228.109.50                          0.0%    10   35.0  36.8  35.0  43.0   2.7
 11.|-- 192.228.109.49                          0.0%    10   35.2  37.6  35.1  44.3   3.8
 12.|-- 192.228.109.50                          0.0%    10   42.6  39.5  35.1  46.5   4.7
 13.|-- 192.228.109.49                          0.0%    10   39.2  37.7  35.0  44.0   3.5
 14.|-- 192.228.109.50                          0.0%    10   35.5  38.1  35.1  46.2   3.9
 15.|-- 192.228.109.49                          0.0%    10   35.2  36.4  35.1  43.3   2.6
 16.|-- 192.228.109.50                          0.0%    10   35.2  39.3  35.1  46.5   4.4
 17.|-- 192.228.109.49                          0.0%    10   35.1  37.3  35.0  43.5   3.2
 18.|-- 192.228.109.50                          0.0%    10   44.1  40.5  35.1  46.8   5.0
 19.|-- 192.228.109.49                          0.0%    10   38.6  37.4  35.0  43.3   3.1
 20.|-- 192.228.109.50                          0.0%    10   35.2  38.8  35.2  45.8   4.3
 21.|-- 192.228.109.49                          0.0%    10   35.3  36.2  35.1  42.5   2.4
 22.|-- 192.228.109.50                          0.0%    10   35.5  39.7  35.1  46.3   4.7
 23.|-- 192.228.109.49                          0.0%    10   35.4  37.0  35.2  42.7   3.0
 24.|-- 192.228.109.50                          0.0%    10   41.7  39.8  35.1  46.0   4.5
 25.|-- 192.228.109.49                          0.0%    10   37.8  38.3  35.2  45.9   3.8
 26.|-- 192.228.109.50                          0.0%    10   35.3  38.4  35.2  46.8   4.7
 27.|-- 192.228.109.49                          0.0%    10   45.8  38.2  35.2  45.9   4.4
 28.|-- 192.228.109.50                          0.0%    10   35.4  39.5  35.2  48.5   4.8
 29.|-- 192.228.109.49                          0.0%    10   35.2  37.5  35.2  46.3   3.7
 30.|-- 192.228.109.50                          0.0%    10   40.8  39.4  35.2  45.2   4.2

----------------------------------------------
mtr --report -w 200 --report-cycles=10 VersaWeb Seattle
Start: Tue May 29 22:49:39 2018
HOST: hostname                   Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                          0.0%    10    1.1   1.0   0.8   1.2   0.0
  2.|-- ???                                   100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                           0.0%    10    0.6   0.6   0.6   0.8   0.0
  4.|-- 144.168.32.1                           0.0%    10    0.7   0.6   0.5   0.7   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net             0.0%    10    0.8   1.8   0.5  11.6   3.4
  6.|-- et-0-0-71.cr10-dal3.ip4.gtt.net        0.0%    10    0.5   2.2   0.5  10.7   3.3
  7.|-- be3045.ccr41.dfw03.atlas.cogentco.com  0.0%    10    1.3   1.0   0.7   1.3   0.0
  8.|-- be2764.ccr32.dfw01.atlas.cogentco.com  0.0%    10    1.3   1.2   1.0   1.3   0.0
  9.|-- be2433.ccr22.mci01.atlas.cogentco.com  0.0%    10   10.9  11.1  10.8  11.4   0.0
 10.|-- be3036.ccr22.den01.atlas.cogentco.com  0.0%    10   22.3  22.4  22.0  22.6   0.0
 11.|-- be3038.ccr21.slc01.atlas.cogentco.com  0.0%    10   32.4  32.4  32.3  32.6   0.0
 12.|-- be2085.ccr21.sea02.atlas.cogentco.com  0.0%    10   56.4  55.6  55.3  56.4   0.0
 13.|-- 38.142.48.250                          0.0%    10   55.5  55.1  54.9  55.5   0.0
 14.|-- 76.164.234.1                           0.0%    10   55.1  55.1  55.0  55.3   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 OVH Canada
Start: Tue May 29 22:49:56 2018
HOST: hostname         Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                0.0%    10    1.4   1.3   0.8   2.4   0.5
  2.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                 0.0%    10    0.8   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                 0.0%    10    0.5   1.3   0.5   6.5   1.7
  5.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
  6.|-- be100-1241.chi-5-a9.il.us    0.0%    10   20.5  20.4  20.2  20.6   0.0
  7.|-- be100-1324.bhs-g2-nc5.qc.ca 10.0%    10   36.8  68.7  36.8 173.0  51.0
  8.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
  9.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
 10.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
 11.|-- bhs.proof.ovh.net            0.0%    10   36.1  36.2  36.1  36.3   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 10gbps.io Frankfurt:
Start: Tue May 29 22:50:12 2018
HOST: hostname                             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                                    0.0%    10    1.1   1.2   0.7   3.3   0.5
  2.|-- ???                                             100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                                     0.0%    10    0.7   0.7   0.6   0.9   0.0
  4.|-- 144.168.32.1                                     0.0%    10    0.5   3.9   0.5  30.8   9.5
  5.|-- ae32.cr11-dal3.ip4.gtt.net                       0.0%    10    1.1   7.4   0.5  26.6   8.5
  6.|-- et-0-0-71.cr10-dal3.ip4.gtt.net                  0.0%    10    0.6   3.8   0.5  23.1   7.1
  7.|-- be3045.ccr41.dfw03.atlas.cogentco.com            0.0%    10    1.0   1.0   0.8   1.3   0.0
  8.|-- be2763.ccr31.dfw01.atlas.cogentco.com            0.0%    10    0.9   1.2   0.9   1.5   0.0
  9.|-- be2432.ccr21.mci01.atlas.cogentco.com            0.0%    10   11.5  11.3  11.0  12.3   0.0
 10.|-- be2831.ccr41.ord01.atlas.cogentco.com            0.0%    10   23.2  23.4  23.1  23.7   0.0
 11.|-- be2717.ccr21.cle04.atlas.cogentco.com            0.0%    10   39.3  39.3  39.1  39.6   0.0
 12.|-- be2993.ccr31.yyz02.atlas.cogentco.com            0.0%    10   39.3  39.2  39.0  39.6   0.0
 13.|-- be3259.ccr21.ymq01.atlas.cogentco.com            0.0%    10   46.6  46.6  46.4  46.7   0.0
 14.|-- be3042.ccr21.lpl01.atlas.cogentco.com            0.0%    10  112.9 113.1 112.8 114.8   0.5
 15.|-- be2182.ccr41.ams03.atlas.cogentco.com            0.0%    10  118.4 118.5 118.3 119.2   0.0
 16.|-- be2813.ccr41.fra03.atlas.cogentco.com            0.0%    10  125.9 126.2 125.9 126.4   0.0
 17.|-- be2501.rcr21.b015749-1.fra03.atlas.cogentco.com  0.0%    10  129.7 129.6 129.5 129.7   0.0
 18.|-- 149.14.157.122                                   0.0%    10  123.0 123.0 122.9 123.1   0.0
 19.|-- frankfurt-20.cdn77.com                           0.0%    10  122.9 123.0 122.9 123.1   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 10gbps.io London:
Start: Tue May 29 22:50:30 2018
HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                  0.0%    10    4.5   1.5   0.7   4.5   1.0
  2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                   0.0%    10    0.6   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                   0.0%    10   16.6   2.2   0.5  16.6   5.1
  5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    2.4   0.9   0.5   2.4   0.5
  6.|-- xe-2-3-7.cr1-lon1.ip4.gtt.net  0.0%    10  111.3 113.2 110.6 133.8   7.2
  7.|-- ip4.gtt.net                    0.0%    10  109.1 109.0 108.8 109.1   0.0
  8.|-- london-20.cdn77.com            0.0%    10  107.9 126.5 107.8 294.1  58.9

----------------------------------------------
mtr --report -w 200 --report-cycles=10 10gbps.io Paris:
Start: Tue May 29 22:50:47 2018
HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                         0.0%    10    1.0   0.8   0.7   1.0   0.0
  2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                          0.0%    10    0.6   0.7   0.6   0.9   0.0
  4.|-- 144.168.32.1                          0.0%    10    0.5   0.5   0.5   0.6   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    0.6   1.6   0.5   6.8   2.0
  6.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    0.8   0.9   0.8   1.2   0.0
  7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.0   0.9   0.7   1.3   0.0
  8.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  20.0%    10   42.4  38.3  37.6  42.4   1.6
  9.|-- ae-0.r23.asbnva02.us.bb.gin.ntt.net   0.0%    10   38.2  38.3  37.6  40.2   0.5
 10.|-- ae-2.r25.amstnl02.nl.bb.gin.ntt.net   0.0%    10  123.2 123.4 123.1 124.7   0.3
 11.|-- ae-3.r24.amstnl02.nl.bb.gin.ntt.net   0.0%    10  124.4 124.6 123.7 127.9   1.2
 12.|-- ae-14.r02.parsfr02.fr.bb.gin.ntt.net  0.0%    10  139.1 138.8 138.6 139.1   0.0
 13.|-- 81.25.206.50                          0.0%    10  134.5 134.5 134.5 134.6   0.0
 14.|-- paris-kvm-1.datapacket.com            0.0%    10  130.6 130.5 130.3 130.6   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 10gbps.io Singapore:
Start: Tue May 29 22:51:04 2018
HOST: hostname                         Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                                0.0%    10    0.9   1.2   0.8   3.2   0.7
  2.|-- ???                                         100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                                 0.0%    10    2.2   0.8   0.6   2.2   0.5
  4.|-- 144.168.32.1                                 0.0%    10    0.5   0.5   0.5   0.6   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net                   0.0%    10    0.9   0.9   0.5   2.4   0.5
  6.|-- et-0-0-71.cr3-lax2.ip4.gtt.net               0.0%    10   32.2  32.9  32.1  36.3   1.1
  7.|-- singapore-telecommunications-gw.ip4.gtt.net  0.0%    10   30.5  30.0  29.8  30.5   0.0
  8.|-- 203.208.151.181                              0.0%    10  202.8 203.9 202.7 214.0   3.5
  9.|-- 203.208.177.110                              0.0%    10  206.7 206.7 206.6 206.8   0.0
 10.|-- singapore-latency-38.cdn77.com               0.0%    10  206.5 206.5 206.5 206.6   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 10gbps.io Stockholm:
Start: Tue May 29 22:51:20 2018
HOST: hostname                             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                                    0.0%    10    0.8   0.9   0.8   1.4   0.0
  2.|-- ???                                             100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                                     0.0%    10    0.8   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                                     0.0%    10    0.6   0.7   0.5   1.6   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net                       0.0%    10    1.0   2.5   0.5  12.2   3.6
  6.|-- et-0-0-71.cr10-dal3.ip4.gtt.net                  0.0%    10    8.8   2.3   0.5   8.8   2.6
  7.|-- be3045.ccr41.dfw03.atlas.cogentco.com            0.0%    10    1.2   1.0   0.7   1.3   0.0
  8.|-- be2763.ccr31.dfw01.atlas.cogentco.com            0.0%    10    1.5   1.2   0.9   1.5   0.0
  9.|-- be2432.ccr21.mci01.atlas.cogentco.com            0.0%    10   11.0  11.1  10.9  11.3   0.0
 10.|-- be2831.ccr41.ord01.atlas.cogentco.com            0.0%    10   23.5  23.4  23.2  23.6   0.0
 11.|-- be2717.ccr21.cle04.atlas.cogentco.com            0.0%    10   39.4  39.3  39.1  39.5   0.0
 12.|-- be2993.ccr31.yyz02.atlas.cogentco.com            0.0%    10   39.3  39.3  39.0  39.5   0.0
 13.|-- be3259.ccr21.ymq01.atlas.cogentco.com            0.0%    10   46.5  46.5  46.3  46.8   0.0
 14.|-- be3042.ccr21.lpl01.atlas.cogentco.com            0.0%    10  114.3 113.2 112.8 114.3   0.5
 15.|-- be2182.ccr41.ams03.atlas.cogentco.com            0.0%    10  119.8 118.8 118.3 120.1   0.5
 16.|-- be2815.ccr41.ham01.atlas.cogentco.com            0.0%    10  126.2 125.8 125.5 126.3   0.0
 17.|-- be2281.ccr21.sto03.atlas.cogentco.com            0.0%    10  144.6 144.6 144.3 144.8   0.0
 18.|-- be2759.rcr21.b015775-1.sto03.atlas.cogentco.com  0.0%    10  144.8 144.8 144.7 145.0   0.0
 19.|-- datacamp.demarc.cogentco.com                     0.0%    10  144.6 144.5 144.4 144.6   0.0
 20.|-- stockholm-10.cdn77.com                           0.0%    10  144.5 144.6 144.5 144.8   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 10gbps.io Moscow:
Start: Tue May 29 22:51:39 2018
HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                    0.0%    10    0.9   1.1   0.8   2.1   0.0
  2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                     0.0%    10    0.7   0.7   0.6   0.8   0.0
  4.|-- 144.168.32.1                     0.0%    10    0.6   0.7   0.5   1.5   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.7   1.0   0.6   1.4   0.0
  6.|-- et-0-0-49.cr11-fra2.ip4.gtt.net  0.0%    10  124.6 126.4 124.5 132.2   2.4
  7.|-- ip4.gtt.net                      0.0%    10  125.4 129.2 124.5 135.9   4.4
  8.|-- ae1-3.RT.MR.MSK.RU.retn.net      0.0%    10  160.9 160.9 160.7 161.0   0.0
  9.|-- moscow-20.cdn77.com              0.0%    10  161.0 161.0 160.8 161.3   0.0

----------------------------------------------
mtr --report -w 200 --report-cycles=10 10gbps.io Miami:
Start: Tue May 29 22:51:55 2018
HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 23.227.170.41                         0.0%    10    0.8   0.9   0.8   1.1   0.0
  2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
  3.|-- 144.168.41.1                          0.0%    10    0.8   0.7   0.6   0.9   0.0
  4.|-- 144.168.32.1                          0.0%    10    0.6   0.6   0.5   0.7   0.0
  5.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    0.8   2.9   0.6  21.8   6.6
  6.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    0.9   0.9   0.7   1.2   0.0
  7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.1   1.5   0.8   4.2   0.8
  8.|-- ae-6.r21.miamfl02.us.bb.gin.ntt.net   0.0%    10   31.2  34.8  31.1  52.5   6.8
  9.|-- ae-11.r04.miamfl02.us.bb.gin.ntt.net  0.0%    10   31.5  31.3  31.1  31.6   0.0
 10.|-- 165.254.21.26                         0.0%    10   31.1  31.0  30.9  31.1   0.0
 11.|-- miami-kvm-1.datapacket.com            0.0%    10   31.1  31.0  30.9  31.2   0.0

Code (Text):

-------------------------------------------
Check system entropy pool availability
-------------------------------------------

entropy_avail: 4067
entropy_avail: 4067
entropy_avail: 4067
entropy_avail: 4067

Code (Text):

-------------------------------------------
OpenSSL System Benchmark
-------------------------------------------

OpenSSL 1.0.2k-fips  26 Jan 2017
-------------------------------------------
openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
md5             213496.28k   564443.43k  1222713.26k  1713823.40k  1995218.94k
sha1            242100.10k   726612.27k  1648164.01k  2430477.99k  2842607.62k
rc4            2135021.25k  2250702.04k  1870626.56k  1786817.19k  1825710.08k
aes-128 cbc     464521.95k   506218.54k   524225.11k  1146538.67k  1153253.38k
aes-256 cbc     337201.43k   368087.06k   372200.02k   825446.40k   809585.32k
sha256          229713.51k   527339.16k  1052762.54k  1285456.90k  1395223.21k
                  sign    verify    sign/s verify/s
rsa 2048 bits 0.000183s 0.000005s   5463.2 188311.7
rsa 4096 bits 0.001202s 0.000019s    832.1  53698.4
                              sign    verify    sign/s verify/s
 256 bit ecdsa (nistp256)   0.0000s   0.0000s  95317.3  43956.0
-------------------------------------------
openssl speed -evp aes256 -multi 4
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
evp            2881380.42k  3077439.87k  3190454.10k  3189763.41k  3100381.90k
-------------------------------------------
openssl speed -evp aes128 -multi 4
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
evp            3710002.50k  4200615.40k  4264497.92k  4247090.52k  4369874.94k

Code (Text):

-------------------------------------------
Running mysqlslap
-------------------------------------------

mysqlslap --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-secondary-indexes=5 --number-int-cols=5 --number-char-cols=5 --number-of-queries=25000 --auto-generate-sql-unique-query-number=40 --auto-generate-sql-unique-write-number=40 --auto-generate-sql-write-number=1000 --concurrency=64 --iterations=10 --engine=myisam
Benchmark
        Running for engine myisam
        Average number of seconds to run all queries: 1.787 seconds
        Minimum number of seconds to run all queries: 1.686 seconds
        Maximum number of seconds to run all queries: 1.959 seconds
        Number of clients running queries: 64
        Average number of queries per client: 390

Dropping the database is potentially a very bad thing to do.
Any data stored in the database will be destroyed.

Do you really want to drop the 'test' database [y/N] Database "test" dropped

Code (Text):

-------------------------------------------
System PHP Info
-------------------------------------------

CPU: 4 x Intel Core Processor (Skylake, IBRS)
              total        used        free      shared  buff/cache   available
Mem:          15886        1532       13007          30        1346       13981
Low:          15886        2878       13007
High:             0           0           0
Swap:          1023           0        1023
----------------------------------------------
PHP 5.6.36 (cli) (built: May 29 2018 21:55:41)
Copyright (c) 1997-2016 The PHP Group
Zend Engine v2.6.0, Copyright (c) 1998-2016 Zend Technologies
    with Zend OPcache v7.0.6-dev, Copyright (c) 1999-2016, by Zend Technologies
----------------------------------------------
Configuration File (php.ini) Path: /usr/local/lib
Loaded Configuration File:         /usr/local/lib/php.ini
Scan for additional .ini files in: /etc/centminmod/php.d
Additional .ini files parsed:      /etc/centminmod/php.d/a_customphp.ini,
/etc/centminmod/php.d/curlcainfo.ini,
/etc/centminmod/php.d/geoip.ini,
/etc/centminmod/php.d/igbinary.ini,
/etc/centminmod/php.d/imagick.ini,
/etc/centminmod/php.d/mailparse.ini,
/etc/centminmod/php.d/memcache.ini,
/etc/centminmod/php.d/memcached.ini,
/etc/centminmod/php.d/redis.ini,
/etc/centminmod/php.d/zendopcache.ini

----------------------------------------------
[PHP Modules]
bcmath
bz2
calendar
Core
ctype
curl
date
dom
enchant
ereg
exif
filter
ftp
gd
geoip
gettext
gmp
hash
iconv
igbinary
imagick
imap
intl
json
ldap
libxml
mailparse
mbstring
mcrypt
memcache
memcached
mhash
mysql
mysqli
mysqlnd
openssl
pcntl
pcre
PDO
pdo_mysql
pdo_sqlite
Phar
posix
pspell
readline
redis
Reflection
session
shmop
SimpleXML
snmp
soap
sockets
SPL
sqlite3
standard
sysvmsg
sysvsem
sysvshm
tidy
tokenizer
xml
xmlreader
xmlrpc
xmlwriter
xsl
Zend OPcache
zip
zlib

[Zend Modules]
Zend OPcache

Code (Text):

-------------------------------------------
Run PHP test Zend/bench.php
-------------------------------------------

simple             0.058
simplecall         0.089
simpleucall        0.087
simpleudcall       0.090
mandel             0.152
mandel2            0.215
ackermann(7)       0.079
ary(50000)         0.023
ary2(50000)        0.021
ary3(2000)         0.134
fibo(30)           0.290
hash1(50000)       0.030
hash2(500)         0.026
heapsort(20000)    0.062
matrix(20)         0.065
nestedloop(12)     0.115
sieve(30)          0.079
strcat(200000)     0.010
------------------------
Total              1.628
real: 1.69s user: 1.63s sys: 0.04s cpu: 98% maxmem: 31372 KB cswaits: 5

simple             0.069
simplecall         0.096
simpleucall        0.091
simpleudcall       0.092
mandel             0.153
mandel2            0.204
ackermann(7)       0.080
ary(50000)         0.021
ary2(50000)        0.020
ary3(2000)         0.130
fibo(30)           0.299
hash1(50000)       0.030
hash2(500)         0.026
heapsort(20000)    0.062
matrix(20)         0.067
nestedloop(12)     0.105
sieve(30)          0.078
strcat(200000)     0.010
------------------------
Total              1.632
real: 1.70s user: 1.64s sys: 0.04s cpu: 98% maxmem: 31368 KB cswaits: 5

simple             0.060
simplecall         0.101
simpleucall        0.091
simpleudcall       0.095
mandel             0.158
mandel2            0.225
ackermann(7)       0.078
ary(50000)         0.020
ary2(50000)        0.021
ary3(2000)         0.130
fibo(30)           0.291
hash1(50000)       0.030
hash2(500)         0.025
heapsort(20000)    0.060
matrix(20)         0.063
nestedloop(12)     0.109
sieve(30)          0.081
strcat(200000)     0.011
------------------------
Total              1.651
real: 1.71s user: 1.66s sys: 0.03s cpu: 99% maxmem: 31372 KB cswaits: 5

bench.php results from 3 runs
1.628
1.632
1.651

bench.php avg: 1.6370
Avg: real: 1.70s user: 1.64s sys: 0.04s cpu: 98.33% maxmem: 31370.67KB cswaits: 5.00
created results log at /home/phpbench_logs/bench_290518-223702.log
server PHP info log at /home/phpbench_logs/bench_phpinfo_290518-223702.log

Code (Text):

-------------------------------------------
Run PHP test Zend/micro_bench.php
-------------------------------------------

empty_loop         0.091
func()             0.281    0.190
undef_func()       0.283    0.192
int_func()         0.268    0.176
$x = self::$x      0.195    0.103
self::$x = 0       0.199    0.108
isset(self::$x)    0.195    0.103
empty(self::$x)    0.195    0.103
$x = Foo::$x       0.189    0.098
Foo::$x = 0        0.179    0.088
isset(Foo::$x)     0.164    0.073
empty(Foo::$x)     0.178    0.087
self::f()          0.309    0.218
Foo::f()           0.278    0.187
$x = $this->x      0.177    0.086
$this->x = 0       0.240    0.148
$this->x += 2      0.207    0.116
++$this->x         0.174    0.082
--$this->x         0.171    0.080
$this->x++         0.196    0.105
$this->x--         0.189    0.098
isset($this->x)    0.170    0.078
empty($this->x)    0.187    0.096
$this->f()         0.327    0.235
$x = Foo::TEST     0.186    0.095
new Foo()          0.555    0.463
$x = TEST          0.139    0.048
$x = $_GET         0.179    0.088
$x = $GLOBALS['v'] 0.246    0.155
$x = $hash['v']    0.196    0.105
$x = $str[0]       0.263    0.172
$x = $a ?: null    0.172    0.081
$x = $f ?: tmp     0.249    0.157
$x = $f ? $f : $a  0.193    0.102
$x = $f ? $f : tmp 0.242    0.151
------------------------
Total              7.665
real: 7.76s user: 7.67s sys: 0.03s cpu: 99% maxmem: 19412 KB cswaits: 6

empty_loop         0.103
func()             0.310    0.207
undef_func()       0.328    0.225
int_func()         0.290    0.188
$x = self::$x      0.207    0.104
self::$x = 0       0.225    0.123
isset(self::$x)    0.204    0.102
empty(self::$x)    0.198    0.096
$x = Foo::$x       0.179    0.077
Foo::$x = 0        0.185    0.082
isset(Foo::$x)     0.177    0.075
empty(Foo::$x)     0.212    0.109
self::f()          0.347    0.245
Foo::f()           0.302    0.199
$x = $this->x      0.189    0.087
$this->x = 0       0.241    0.139
$this->x += 2      0.205    0.102
++$this->x         0.174    0.072
--$this->x         0.174    0.071
$this->x++         0.193    0.091
$this->x--         0.200    0.097
isset($this->x)    0.183    0.080
empty($this->x)    0.207    0.105
$this->f()         0.331    0.229
$x = Foo::TEST     0.190    0.088
new Foo()          0.580    0.478
$x = TEST          0.147    0.044
$x = $_GET         0.191    0.089
$x = $GLOBALS['v'] 0.254    0.151
$x = $hash['v']    0.216    0.114
$x = $str[0]       0.276    0.173
$x = $a ?: null    0.171    0.068
$x = $f ?: tmp     0.241    0.138
$x = $f ? $f : $a  0.189    0.087
$x = $f ? $f : tmp 0.242    0.139
------------------------
Total              8.062
real: 8.13s user: 8.10s sys: 0.01s cpu: 99% maxmem: 19412 KB cswaits: 4

empty_loop         0.095
func()             0.302    0.207
undef_func()       0.322    0.227
int_func()         0.279    0.184
$x = self::$x      0.218    0.123
self::$x = 0       0.206    0.111
isset(self::$x)    0.213    0.118
empty(self::$x)    0.224    0.129
$x = Foo::$x       0.189    0.094
Foo::$x = 0        0.192    0.097
isset(Foo::$x)     0.165    0.070
empty(Foo::$x)     0.175    0.080
self::f()          0.330    0.234
Foo::f()           0.302    0.207
$x = $this->x      0.179    0.084
$this->x = 0       0.218    0.123
$this->x += 2      0.227    0.132
++$this->x         0.161    0.066
--$this->x         0.160    0.065
$this->x++         0.182    0.087
$this->x--         0.186    0.090
isset($this->x)    0.167    0.072
empty($this->x)    0.185    0.090
$this->f()         0.303    0.207
$x = Foo::TEST     0.186    0.091
new Foo()          0.550    0.455
$x = TEST          0.141    0.046
$x = $_GET         0.174    0.079
$x = $GLOBALS['v'] 0.238    0.143
$x = $hash['v']    0.185    0.090
$x = $str[0]       0.245    0.150
$x = $a ?: null    0.157    0.062
$x = $f ?: tmp     0.225    0.130
$x = $f ? $f : $a  0.177    0.082
$x = $f ? $f : tmp 0.221    0.126
------------------------
Total              7.681
real: 7.75s user: 7.70s sys: 0.02s cpu: 99% maxmem: 19412 KB cswaits: 4

micro_bench.php results from 3 runs
7.665
8.062
7.681

micro_bench.php avg: 7.8027
Avg: real: 7.88s user: 7.82s sys: 0.02s cpu: 99.00% maxmem: 19412.00KB cswaits: 4.67
created results log at /home/phpbench_logs/bench_micro_290518-223702.log
server PHP info log at /home/phpbench_logs/bench_phpinfo_290518-223702.log

Code (Text):

-------------------------------------------
Running UnixBench
-------------------------------------------

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: hostname: GNU/Linux
   OS: GNU/Linux -- 3.10.0-693.17.1.el7.x86_64 -- #1 SMP Thu Jan 25 20:13:58 UTC 2018
   Machine: x86_64 (x86_64)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   CPU 1: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   CPU 2: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   CPU 3: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
          Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   22:57:06 up  1:30,  2 users,  load average: 2.06, 1.79, 0.92; runlevel 3
------------------------------------------------------------------------

Code (Text):

Benchmark Run: Tue May 29 2018 22:57:06 - 23:21:07
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       35758127.3 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4304.1 MWIPS (9.8 s, 7 samples)
Execl Throughput                               2058.2 lps   (29.9 s, 2 samples)
Pipe Throughput                              530656.8 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                  97339.9 lps   (10.0 s, 7 samples)
Process Creation                               6253.8 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   5337.1 lpm   (60.0 s, 2 samples)
Shell Scripts (16 concurrent)                   986.0 lpm   (60.1 s, 2 samples)
Shell Scripts (8 concurrent)                   1820.9 lpm   (60.0 s, 2 samples)
System Call Overhead                         423882.9 lps   (10.0 s, 7 samples)

System Benchmarks Partial Index              BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   35758127.3   3064.1
Double-Precision Whetstone                       55.0       4304.1    782.6
Execl Throughput                                 43.0       2058.2    478.6
Pipe Throughput                               12440.0     530656.8    426.6
Pipe-based Context Switching                   4000.0      97339.9    243.3
Process Creation                                126.0       6253.8    496.3
Shell Scripts (1 concurrent)                     42.4       5337.1   1258.7
Shell Scripts (16 concurrent)                     ---        986.0      ---
Shell Scripts (8 concurrent)                      6.0       1820.9   3034.8
System Call Overhead                          15000.0     423882.9    282.6
                                                                   ========
System Benchmarks Index Score (Partial Only)                          736.6

------------------------------------------------------------------------

Code (Text):

Benchmark Run: Tue May 29 2018 23:21:07 - 23:45:09
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables      141336372.4 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                    16985.5 MWIPS (9.7 s, 7 samples)
Execl Throughput                               9127.0 lps   (29.9 s, 2 samples)
Pipe Throughput                             2019568.4 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 384351.9 lps   (10.0 s, 7 samples)
Process Creation                              24267.2 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  14733.1 lpm   (60.0 s, 2 samples)
Shell Scripts (16 concurrent)                   940.6 lpm   (60.1 s, 2 samples)
Shell Scripts (8 concurrent)                   1964.7 lpm   (60.1 s, 2 samples)
System Call Overhead                        1528515.5 lps   (10.0 s, 7 samples)

System Benchmarks Partial Index              BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0  141336372.4  12111.1
Double-Precision Whetstone                       55.0      16985.5   3088.3
Execl Throughput                                 43.0       9127.0   2122.6
Pipe Throughput                               12440.0    2019568.4   1623.4
Pipe-based Context Switching                   4000.0     384351.9    960.9
Process Creation                                126.0      24267.2   1926.0
Shell Scripts (1 concurrent)                     42.4      14733.1   3474.8
Shell Scripts (16 concurrent)                     ---        940.6      ---
Shell Scripts (8 concurrent)                      6.0       1964.7   3274.5
System Call Overhead                          15000.0    1528515.5   1019.0
                                                                   ========
System Benchmarks Index Score (Partial Only)                         2412.2

Code (Text):

-------------------------------------------
centminmodbench.sh completed
-------------------------------------------

centminmodbench.sh Total Run Time: 4069.046255312 seconds

 

The ssdnodes' Intel Xeon Gold Skylake cpu cryptographic performance is excellent.

• Hardware assisted AES-NI benchmarks (-evp aes256/aes128) for OpenSSL 1.0.2k system was core for core 14.6-15.9% faster than my Core i7 4790K Haswell dedicated server when doing 4 cpu core OpenSSL benchmarks.
• Non hardware assisted RSA2048 and ECDSA 256bit numbers were decent given the cpu clock speed differences.
• Though aes-128/256 cbc (55-56% faster) & RSA4096 (12% faster) numbers also had Intel Xeon Gold Skylake cpu ahead.

OpenSSL 1.0.2k

ssdnodes 4 cpu KVM VPS with Intel Xeon Gold @2.0Ghz testing 4 cpu cores

Code (Text):

openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
md5             213496.28k   564443.43k  1222713.26k  1713823.40k  1995218.94k
sha1            242100.10k   726612.27k  1648164.01k  2430477.99k  2842607.62k
rc4            2135021.25k  2250702.04k  1870626.56k  1786817.19k  1825710.08k
aes-128 cbc     464521.95k   506218.54k   524225.11k  1146538.67k  1153253.38k
aes-256 cbc     337201.43k   368087.06k   372200.02k   825446.40k   809585.32k
sha256          229713.51k   527339.16k  1052762.54k  1285456.90k  1395223.21k
                  sign    verify    sign/s verify/s
rsa 2048 bits 0.000183s 0.000005s   5463.2 188311.7
rsa 4096 bits 0.001202s 0.000019s    832.1  53698.4
                              sign    verify    sign/s verify/s
 256 bit ecdsa (nistp256)   0.0000s   0.0000s  95317.3  43956.0

Code (Text):

openssl speed -evp aes256 -multi 4
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
evp            2881380.42k  3077439.87k  3190454.10k  3189763.41k  3100381.90k

Code (Text):

openssl speed -evp aes128 -multi 4
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
evp            3710002.50k  4200615.40k  4264497.92k  4247090.52k  4369874.94k

OVH MC-32 Core i7 4790K @4.0Ghz testing 4 cpu cores

Code (Text):

openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
md5             309081.96k   909020.01k  2007314.43k  2892954.97k  3318060.37k
sha1            370151.29k  1079533.23k  2556416.85k  3802567.34k  4573760.17k
rc4            1845346.84k  2870001.94k  3317960.02k  3647107.75k  3445921.11k
aes-128 cbc     554475.18k   718358.34k   733911.98k   735152.81k   740898.13k
aes-256 cbc     483109.95k   513416.62k   516881.58k   522907.31k   518318.76k
sha256          317988.24k   631856.34k  1173121.28k  1495389.53k  1691871.91k
                  sign    verify    sign/s verify/s
rsa 2048 bits 0.000156s 0.000006s   6408.1 163333.3
rsa 4096 bits 0.001346s 0.000020s    742.9  48931.0
                              sign    verify    sign/s verify/s
 256 bit ecdsa (nistp256)   0.0000s   0.0000s 125000.0  49382.7

Code (Text):

openssl speed -evp aes256 -multi 4
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
evp            2410075.73k  2644676.54k  2690798.85k  2702209.02k  2704706.22k

Code (Text):

openssl speed -evp aes128 -multi 4
OpenSSL 1.0.2k-fips  26 Jan 2017
built on: reproducible build, date unspecified
options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
evp            3388483.24k  3666193.11k  3721211.05k  3765229.91k  3770414.42k

OpenSSL 1.1.0h

Update: lets compare that to Nginx's OpenSSL 1.1.0h version

ssdnodes 4 cpu KVM VPS with Intel Xeon Gold @2.0Ghz testing 4 cpu cores

Code (Text):

openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
OpenSSL 1.1.0h  27 Mar 2018
built on: reproducible build, date unspecified
options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
compiler: gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
md5             396445.87k   875119.47k  1574116.01k  2007837.94k  2009653.25k  2121318.40k
sha1            419296.15k   994685.01k  1993751.55k  2615454.38k  2952407.72k  2808550.74k
rc4            2065836.56k  2152900.52k  1764360.53k  1711937.54k  1637782.87k  1682363.73k
aes-128 cbc     416092.43k   469209.32k   486252.12k  1113088.34k  1096198.83k  1108437.67k
aes-256 cbc     311762.70k   344587.58k   341664.26k   810475.52k   828497.92k   818528.26k
sha256          250588.72k   572098.54k  1014667.01k  1279746.39k  1371223.38k  1373739.94k
                  sign    verify    sign/s verify/s
rsa 2048 bits 0.000196s 0.000006s   5114.0 174387.4
rsa 4096 bits 0.001304s 0.000020s    766.8  49864.6
                              sign    verify    sign/s verify/s
 256 bit ecdsa (nistp256)   0.0000s   0.0000s  80092.4  40119.0

Code (Text):

openssl speed -evp aes256 -multi 4
OpenSSL 1.1.0h  27 Mar 2018
built on: reproducible build, date unspecified
options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
compiler: gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
evp            2173022.90k  2858526.29k  2932427.26k  3002174.12k  2999560.87k  2943554.90k

Code (Text):

openssl speed -evp aes128 -multi 4
OpenSSL 1.1.0h  27 Mar 2018
built on: reproducible build, date unspecified
options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
compiler: gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
evp            2467888.79k  3840917.70k  4038786.56k  3989851.82k  4024898.90k  4017466.03k

OVH MC-32 Core i7 4790K @4.0Ghz testing 4 cpu cores

Code (Text):

openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
OpenSSL 1.1.0h  27 Mar 2018
built on: reproducible build, date unspecified
options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
compiler: ccache gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
md5             630215.01k  1398410.41k  2259497.30k  3106526.21k  3307732.99k  3354329.09k
sha1            659653.66k  1558602.43k  3103942.23k  4174210.73k  4393052.84k  3509938.86k
rc4            2101010.91k  3434050.94k  3815523.24k  3996416.00k  4170437.97k  4168979.80k
aes-128 cbc     617708.81k   691342.93k   732358.40k   737779.03k   731130.54k   740786.18k
aes-256 cbc     455975.31k   410253.35k   521641.22k   524214.61k   494804.99k   525287.42k
sha256          284005.43k   634975.19k  1334041.86k  1991359.49k  2106032.13k  2163190.44k
                  sign    verify    sign/s verify/s
rsa 2048 bits 0.000125s 0.000005s   7968.3 181818.2
rsa 4096 bits 0.001340s 0.000020s    746.1  49232.2
                              sign    verify    sign/s verify/s
 256 bit ecdsa (nistp256)   0.0000s   0.0000s 113538.7  48210.3

Code (Text):

openssl speed -evp aes256 -multi 4
OpenSSL 1.1.0h  27 Mar 2018
built on: reproducible build, date unspecified
options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
compiler: ccache gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
evp            2083167.42k  2601779.48k  2693292.63k  2702125.74k  2704482.30k  2704583.34k

Code (Text):

openssl speed -evp aes128 -multi 4
OpenSSL 1.1.0h  27 Mar 2018
built on: reproducible build, date unspecified
options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
compiler: ccache gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
evp            2933207.49k  3677225.64k  3748412.59k  3766041.26k  3770477.23k  3767719.25k

 

Let's try to figure out which specific Intel Xeon Gold Skylake cpu is being used as /proc/cpuinfo is lacking specific model number.

Code (Text):

processor       : 3
vendor_id       : GenuineIntel
cpu family      : 6
model           : 94
model name      : Intel Core Processor (Skylake, IBRS)
stepping        : 3
microcode       : 0x1
cpu MHz         : 2099.998
cache size      : 4096 KB
physical id     : 0
siblings        : 4
core id         : 3
cpu cores       : 4
apicid          : 3
initial apicid  : 3
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
bogomips        : 4199.99
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 48 bits virtual
power management:

Code (Text):

journalctl -b --no-pager | grep -C1 microcode
May 29 21:28:25 centos7 kernel: NET: Registered protocol family 17
May 29 21:28:25 centos7 kernel: microcode: CPU0 sig=0x506e3, pf=0x1, revision=0x1
May 29 21:28:25 centos7 kernel: microcode: CPU1 sig=0x506e3, pf=0x1, revision=0x1
May 29 21:28:25 centos7 kernel: microcode: CPU2 sig=0x506e3, pf=0x1, revision=0x1
May 29 21:28:25 centos7 kernel: microcode: CPU3 sig=0x506e3, pf=0x1, revision=0x1

According to https://en.wikichip.org/wiki/intel/xeon_gold/ only the following Intel Xeon Gold Skylake based cpus have base clocks of ~2.1Ghz

• Intel Xeon Gold 6130 - 16C/32T
• Intel Xeon Gold 6130F - 16C/32T
• Intel Xeon Gold 6130T - 16C/32T
• Intel Xeon Gold 6152 - 22C/44T

So depending on overall cpu core/thread utilisation at VPS host node level, the 4 cpu core/thread KVM VPS clock speed can possibly turbo boost with 2 cpu cores up to 3.70Ghz for normal loads, 3.60Ghz for AVX2 loads and 3.50Ghz for AVX512 work loads. Intel Xeon Gold 6130 variants can all turbo boost normal work loads at all 16 core work loads to 2.80Ghz while Intel Xeon Gold 6152 can turbo boost normal workloads with 16 cores to 3.10Ghz or all 22 cores to 2.80Ghz.

Intel Xeon Gold 6130 cpu clock and turbo boost profiles



Intel Gold 6130F cpu clock and turbo boost profiles



Intel Gold 6130T cpu clock and turbo boost profiles



Intel Gold 6152 cpu clock and turbo boost profiles

 

FYI ssdnodes extended the sale until end of May 31st. So sale ends in ~22hrs. My referral link

 

ssdnodes folks blog has covered using Docker on their KVM VPSes, so thought I'd give it a try with Percona Monitoring and Management PMM Tool Percona Monitoring and Management for Databases. Very useful if you need to dig deep into MySQL/MariaDB/Percona usage and monitoring

Code (Text):

pmm-admin list    
pmm-admin 1.11.0

PMM Server      | 127.0.0.1:8448 (password-protected)
Client Name     | domain.com
Client Address  | 172.17.0.1
Service Manager | linux-systemd

-------------- -------------------- ----------- -------- ----------------------------------------- --------------------------------------------------------------------------------------
SERVICE TYPE   NAME                 LOCAL PORT  RUNNING  DATA SOURCE                               OPTIONS                                                                              
-------------- -------------------- ----------- -------- ----------------------------------------- --------------------------------------------------------------------------------------
mysql:queries  domain.com  -           YES      root:***@unix(/var/lib/mysql/mysql.sock)  query_source=slowlog, query_examples=true, slow_log_rotation=true, retain_slow_logs=1
linux:metrics  domain.com  42000       YES      -                                                                                                                              
mysql:metrics  domain.com  42002       YES      root:***@unix(/var/lib/mysql/mysql.sock) 

 

Percona PMM doesn't touch Centmin Mod Nginx etc it's purely from Docker container running on same server. But yes all graphs are out of box provided.

 

+1 PMM has come along way since I first used it

I posted my theories on other web host forums - the gist is Dallas location they use Incero and they're known for doing very heavy discount deals on server hardware when you prepay in advance like 1-3yrs. If you search webhostingtalk.com forum for Incero past dedicated server deals they can offer high end dual Xeon servers which usually hosts charge US$499-699/month for at sometimes discounted US$199-299/month if you prepay up to 3yrs in advance. That's probably why ssdnodes does the same to get the cash flow to pay upstream with Incero.

Incero heavy discounts for long term contracts are enticing but personally I wouldn't use Incero myself/directly due to how Gordon has treated the LET customers in the past where getting on his wrong side would result in termination of all your account/servers. Never happened me to but lots of reports if you search of other folks experiences. But Incero seems to treat their high end hosting/colocation clients well i.e. ssdnodes, vpsdime, backupsy etc. But for me I rather not take the risk going Incero direct. Lots of my consulting clients that I do server optimisations and web host search/evaluations for have also skipped Incero during their research for similar reasons. Update: November 28, 2018 - interestingly Incero where ssdnodes colocates their servers was acquired by very good web host Hivelocity recently Hivelocity Acquires Incero ! - one of the best news this year in my books - combines Hivelocity's great service and network with Incero's great network and server hardware and Incero ex-owner Gordon is no longer part of the picture !

I only prepaid for 1yr not 3yrs just to see and well this ssdnodes VPS will be used for more Centmin Mod LEMP development testing - so Ways To Support Centmin Mod

 

Centmin Mod 123.09beta01 compiles Nginx server using GCC 7.3.1 compiler by default these days. Let's check which native architecture GCC 7.3.1 picks up for Nginx builds. From GCC 7.3.1 native output looks like march/mtune = skylake is used. Definitely ssdnodes is the cheapest way to get access to Intel Xeon Gold Skylake based processors if you want to compile and built your binaries with i.e. Nginx

Code (Text):

cat /root/centminlogs/gcc_native.log
  -m128bit-long-double                  [enabled]
  -m64                                  [enabled]
  -m80387                               [enabled]
  -mabm                                 [enabled]
  -madx                                 [enabled]
  -maes                                 [enabled]
  -malign-stringops                     [enabled]
  -march=                               skylake
  -mavx                                 [enabled]
  -mavx2                                [enabled]
  -mavx512bw                            [enabled]
  -mavx512cd                            [enabled]
  -mavx512dq                            [enabled]
  -mavx512f                             [enabled]
  -mavx512vl                            [enabled]
  -mbmi                                 [enabled]
  -mbmi2                                [enabled]
  -mclflushopt                          [enabled]
  -mclwb                                [enabled]
  -mcx16                                [enabled]
  -mf16c                                [enabled]
  -mfancy-math-387                      [enabled]
  -mfma                                 [enabled]
  -mfp-ret-in-387                       [enabled]
  -mfsgsbase                            [enabled]
  -mfxsr                                [enabled]
  -mglibc                               [enabled]
  -mhard-float                          [enabled]
  -mhle                                 [enabled]
  -mieee-fp                             [enabled]
  -mlong-double-80                      [enabled]
  -mlzcnt                               [enabled]
  -mmmx                                 [enabled]
  -mmovbe                               [enabled]
  -mpclmul                              [enabled]
  -mpopcnt                              [enabled]
  -mprfchw                              [enabled]
  -mpush-args                           [enabled]
  -mrdrnd                               [enabled]
  -mrdseed                              [enabled]
  -mred-zone                            [enabled]
  -mrtm                                 [enabled]
  -msahf                                [enabled]
  -msse                                 [enabled]
  -msse2                                [enabled]
  -msse3                                [enabled]
  -msse4                                [enabled]
  -msse4.1                              [enabled]
  -msse4.2                              [enabled]
  -mssse3                               [enabled]
  -mstv                                 [enabled]
  -mtls-direct-seg-refs                 [enabled]
  -mtune-ctrl=             
  -mtune=                               skylake
  -mvzeroupper                          [enabled]
  -mxsave                               [enabled]
  -mxsavec                              [enabled]
  -mxsaveopt                            [enabled]

Code (Text):

lscpu
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                4
On-line CPU(s) list:   0-3
Thread(s) per core:    1
Core(s) per socket:    4
Socket(s):             1
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 94
Model name:            Intel Core Processor (Skylake, IBRS)
Stepping:              3
CPU MHz:               2099.998
BogoMIPS:              4199.99
Hypervisor vendor:     KVM
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              4096K
NUMA node0 CPU(s):     0-3
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1

 

very close i'd say for cpu as probably turbo boost on upcloud E5-2687w v4 is higher on 4 cpu threads but upcloud faster clock speed memory i suppose

ssdnodes
sysbench cpu
1 thread = 417 events/s
4 thread = 1556 events/s

ssdnodes
sysbench mem
1 thread = 3028.81 MiB/sec
4 thread = 9395.38 MiB/sec

upcloud
sysbench cpu
1 thread = 414 events/s
4 thread = 1647 events/s

upcloud
sysbench mem
1 thread = 4733.67 MiB/sec
4 thread = 14952.90 MiB/sec