Want more timely Centmin Mod News Updates?
Become a Member

Benchmarks SSDNodes ssdnodes.com upto 91% discount on KVM VPS until May 31, 2018

Discussion in 'Virtual Private Server (VPS) hosting' started by eva2000, May 30, 2018.

  1. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Just came across ssdnodes.com 7yr anniversary discount deal at The 7-Year Anniversary Sale, from SSD Nodes. Update: they extended the sale until end of May 31st - sale ends in ~22hrs. Discounts are for prepayment 1yr or 3yr in advance though. My referral link ;)

    upload_2018-5-30_7-34-55.png

    Servers use latest Intel Xeon Gold Skylake based cpus apparently

    Code (Text):
    cat /proc/cpuinfo
    processor       : 0
    vendor_id       : GenuineIntel
    cpu family      : 6
    model           : 94
    model name      : Intel Core Processor (Skylake, IBRS)
    stepping        : 3
    microcode       : 0x1
    cpu MHz         : 2099.998
    cache size      : 4096 KB
    physical id     : 0
    siblings        : 4
    core id         : 0
    cpu cores       : 4
    apicid          : 0
    initial apicid  : 0
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 13
    wp              : yes
    flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    bogomips        : 4199.99
    clflush size    : 64
    cache_alignment : 64
    address sizes   : 46 bits physical, 48 bits virtual
    power management:
    
    processor       : 1
    vendor_id       : GenuineIntel
    cpu family      : 6
    model           : 94
    model name      : Intel Core Processor (Skylake, IBRS)
    stepping        : 3
    microcode       : 0x1
    cpu MHz         : 2099.998
    cache size      : 4096 KB
    physical id     : 0
    siblings        : 4
    core id         : 1
    cpu cores       : 4
    apicid          : 1
    initial apicid  : 1
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 13
    wp              : yes
    flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    bogomips        : 4199.99
    clflush size    : 64
    cache_alignment : 64
    address sizes   : 46 bits physical, 48 bits virtual
    power management:
    
    processor       : 2
    vendor_id       : GenuineIntel
    cpu family      : 6
    model           : 94
    model name      : Intel Core Processor (Skylake, IBRS)
    stepping        : 3
    microcode       : 0x1
    cpu MHz         : 2099.998
    cache size      : 4096 KB
    physical id     : 0
    siblings        : 4
    core id         : 2
    cpu cores       : 4
    apicid          : 2
    initial apicid  : 2
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 13
    wp              : yes
    flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    bogomips        : 4199.99
    clflush size    : 64
    cache_alignment : 64
    address sizes   : 46 bits physical, 48 bits virtual
    power management:
    
    processor       : 3
    vendor_id       : GenuineIntel
    cpu family      : 6
    model           : 94
    model name      : Intel Core Processor (Skylake, IBRS)
    stepping        : 3
    microcode       : 0x1
    cpu MHz         : 2099.998
    cache size      : 4096 KB
    physical id     : 0
    siblings        : 4
    core id         : 3
    cpu cores       : 4
    apicid          : 3
    initial apicid  : 3
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 13
    wp              : yes
    flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    bogomips        : 4199.99
    clflush size    : 64
    cache_alignment : 64
    address sizes   : 46 bits physical, 48 bits virtual
    power management:
    

     
    • Like Like x 1
  2. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x

    Centmin Mod 123.09beta01 Installation Times



    Code (Text):
    yum -y update; curl -O https://centminmod.com/betainstaller.sh && chmod 0700 betainstaller.sh && bash betainstaller.sh

    Code (Text):
    ---------------------------------------------------------------------------
    Total Curl Installer YUM or DNF Time: 175.6731 seconds
    Total YUM Time: 12.901646257 seconds
    Total YUM or DNF + Source Download Time: 42.8064
    Total Nginx First Time Install Time: 209.7187
    Total PHP First Time Install Time: 206.4821
    Download Zip From Github Time: 1.4480
    Total Time Other eg. source compiles: 305.9028
    Total Centmin Mod Install Time: 764.9099
    ---------------------------------------------------------------------------
    Total Install Time (curl yum + cm install + zip download): 942.0310 seconds
    ---------------------------------------------------------------------------
    4 Intel Core Processor (Skylake, IBRS)
    4 2099.998
    ---------------------------------------------------------------------------
    

    Code (Text):
    *************************************************
    * Post-Install Check List....
    *************************************************
    
    --------------------------------------------------------
    Check ccache Version:
    --------------------------------------------------------
    ccache version 3.4.1
    
    Copyright (C) 2002-2007 Andrew Tridgell
    Copyright (C) 2009-2018 Joel Rosdahl
    
    This program is free software; you can redistribute it and/or modify it under
    the terms of the GNU General Public License as published by the Free Software
    Foundation; either version 3 of the License, or (at your option) any later
    version.
    
    --------------------------------------------------------
    Check Nginx Version:
    --------------------------------------------------------
    nginx version: nginx/1.13.12 (290518-214917)
    built by gcc 7.3.1 20180303 (Red Hat 7.3.1-5) (GCC)
    built with OpenSSL 1.1.0h  27 Mar 2018
    TLS SNI support enabled
    configure arguments: --with-ld-opt='-ljemalloc -Wl,-z,relro -Wl,-rpath,/usr/local/lib' --with-cc-opt='-m64 -march=native -DTCP_FASTOPEN=23 -g -O3 -fstack-protector-strong -flto -fuse-ld=gold --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wimplicit-fallthrough=0 -fcode-hoisting -Wp,-D_FORTIFY_SOURCE=2 -gsplit-dwarf' --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --build=290518-214917 --with-compat --with-http_stub_status_module --with-http_secure_link_module --with-libatomic --with-http_gzip_static_module --with-http_sub_module --with-http_addition_module --with-http_image_filter_module=dynamic --with-http_geoip_module --with-stream_geoip_module --with-stream_realip_module --with-stream_ssl_preread_module --with-threads --with-stream=dynamic --with-stream_ssl_module --with-http_realip_module --add-dynamic-module=../ngx-fancyindex-0.4.2 --add-module=../ngx_cache_purge-2.4.2 --add-module=../ngx_devel_kit-0.3.0 --add-dynamic-module=../set-misc-nginx-module-0.32 --add-dynamic-module=../echo-nginx-module-0.61 --add-module=../redis2-nginx-module-0.15 --add-module=../ngx_http_redis-0.3.7 --add-module=../memc-nginx-module-0.18 --add-module=../srcache-nginx-module-0.31 --add-dynamic-module=../headers-more-nginx-module-0.33 --with-pcre=../pcre-8.42 --with-pcre-jit --with-zlib=../zlib-cloudflare-1.3.0 --with-http_ssl_module --with-http_v2_module --with-openssl=../openssl-1.1.0h --with-openssl-opt='enable-ec_nistp_64_gcc_128'
    
    --------------------------------------------------------
    Check PHP-FPM Version:
    --------------------------------------------------------
    PHP 5.6.36 (cli) (built: May 29 2018 21:55:41)
    Copyright (c) 1997-2016 The PHP Group
    Zend Engine v2.6.0, Copyright (c) 1998-2016 Zend Technologies
        with Zend OPcache v7.0.6-dev, Copyright (c) 1999-2016, by Zend Technologies
    
    --------------------------------------------------------
    Check MariaDB installed RPM Versions:
    --------------------------------------------------------
    MariaDB-common-10.1.33-1.el7.centos.x86_64
    MariaDB-client-10.1.33-1.el7.centos.x86_64
    MariaDB-devel-10.1.33-1.el7.centos.x86_64
    MariaDB-compat-10.1.33-1.el7.centos.x86_64
    MariaDB-server-10.1.33-1.el7.centos.x86_64
    MariaDB-shared-10.1.33-1.el7.centos.x86_64
    
    --------------------------------------------------------
    Check Memcached Server Version:
    --------------------------------------------------------
    memcached 1.5.8
    
    --------------------------------------------------------
    Check CSF Firewall Version:
    --------------------------------------------------------
    csf: v12.04 (generic)
    
    --------------------------------------------------------
    Check Siege Benchmark Version:
    --------------------------------------------------------
    SIEGE 4.0.4
    
    Copyright (C) 2017 by Jeffrey Fulmer, et al.
    This is free software; see the source for copying conditions.
    There is NO warranty; not even for MERCHANTABILITY or FITNESS
    FOR A PARTICULAR PURPOSE.
    
    
    --------------------------------------------------------
    Check mysqlreport version:
    --------------------------------------------------------
    mysqlreport v3.5-maria11 Jul 4 2013
    
    --------------------------------------------------------
    Check pure-ftpd Version:
    --------------------------------------------------------
    pure-ftpd v1.0.42
    
    --------------------------------------------------------
    Check YUM Repo List
    --------------------------------------------------------
    Loaded plugins: fastestmirror, priorities, versionlock
    Loading mirror speeds from cached hostfile
     * base: mirror.hostduplex.com
     * epel: fedora-epel.mirror.lstn.net
     * extras: repos.dfw.quadranet.com
     * rpmforge: mirror.lstn.net
     * updates: pubmirrors.dal.corespace.com
    279 packages excluded due to repository priority protections
    repo id                 repo name                                    status
    base/7/x86_64           CentOS-7 - Base                              7,658+2,253
    centos-sclo-rh/x86_64   CentOS-7 - SCLo rh                              7,371+96
    centos-sclo-sclo/x86_64 CentOS-7 - SCLo sclo                                 521
    *epel/x86_64            Extra Packages for Enterprise Linux 7 - x86_  11,603+974
    extras/7/x86_64         CentOS-7 - Extras                                    305
    mariadb                 MariaDB                                             44+2
    rpmforge                RHEL 7 - RPMforge.net - dag                      136+109
    updates/7/x86_64        CentOS-7 - Updates                               495+137
    repolist: 28,133
    
    --------------------------------------------------------
    mytimes check:
    /usr/bin/mytimes
    --------------------------------------------------------
    Tue May 29 21:59:17 UTC 2018    [UTC]
    Wed May 30 07:59:17 AEST 2018   [Australia/Brisbane]
    Tue May 29 14:59:17 PDT 2018    [America/Los_Angeles]
    Tue May 29 16:59:17 CDT 2018    [America/Chicago]
    Tue May 29 17:59:17 EDT 2018    [America/New_York]
    Tue May 29 17:59:17 EDT 2018    [America/Montreal]
    Tue May 29 22:59:17 BST 2018    [Europe/London]
    Tue May 29 23:59:17 CEST 2018   [Europe/Berlin]
    Wed May 30 04:59:17 +07 2018    [Asia/Bangkok]
    Wed May 30 04:59:17 +07 2018    [Asia/Ho_Chi_Minh]
    Wed May 30 04:59:17 WIB 2018    [Asia/Jakarta]
    Wed May 30 05:59:17 +08 2018    [Asia/Kuala_Lumpur]
    Wed May 30 05:59:17 +08 2018    [Asia/Singapore]
    --------------------------------------------------------
    


    Nginx HTTP/2 HTTPS benchmarks



    https_bench.sh Nginx HTTP/2 HTTPS benchmarks.

    There's 8x h2load test configurations in total. h2load HTTP/2 HTTPS load test tool will be run single threaded so tests only 1 cpu core of the system:
    • h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    • h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    • h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    • h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    • h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    • h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    • h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    • h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    Code (Text):
    -------------------------------------------------------------------------------------------
    System Information
    -------------------------------------------------------------------------------------------
    
    3.10.0-693.17.1.el7.x86_64
    
    CentOS Linux release 7.5.1804 (Core)
    
    Centmin Mod
    -------------------------------------------------------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 94
    Model name:            Intel Core Processor (Skylake, IBRS)
    Stepping:              3
    CPU MHz:               2099.998
    BogoMIPS:              4199.99
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    
    CPU Flags
     fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    
    -------------------------------------------------------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
    0   0    0      0    0:0:0      yes
    1   0    0      1    1:1:1      yes
    2   0    0      2    2:2:2      yes
    3   0    0      3    3:3:3      yes
    
    -------------------------------------------------------------------------------------------
                  total        used        free      shared  buff/cache   available
    Mem:          15886         831       14830          30         224       14748
    Low:          15886        1055       14830
    High:             0           0           0
    Swap:          1023           0        1023
    
    -------------------------------------------------------------------------------------------
    Filesystem                       Size  Used Avail Use% Mounted on
    /dev/mapper/centos_centos7-root   78G  6.4G   68G   9% /
    devtmpfs                         7.8G     0  7.8G   0% /dev
    tmpfs                            7.8G     0  7.8G   0% /dev/shm
    tmpfs                            7.8G   17M  7.8G   1% /run
    tmpfs                            7.8G     0  7.8G   0% /sys/fs/cgroup
    /dev/sda1                       1014M  264M  751M  26% /boot
    tmpfs                            1.6G     0  1.6G   0% /run/user/0
    tmpfs                            7.8G  324K  7.8G   1% /tmp
    

    Code (Text):
    -------------------------------------------------------------------------------------------
    nginx version: nginx/1.13.12 (290518-214917)
    built by gcc 7.3.1 20180303 (Red Hat 7.3.1-5) (GCC)
    built with OpenSSL 1.1.0h  27 Mar 2018
    TLS SNI support enabled
    configure arguments: --with-ld-opt='-ljemalloc -Wl,-z,relro -Wl,-rpath,/usr/local/lib' --with-cc-opt='-m64 -march=native -DTCP_FASTOPEN=23 -g -O3 -fstack-protector-strong -flto -fuse-ld=gold --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wimplicit-fallthrough=0 -fcode-hoisting -Wp,-D_FORTIFY_SOURCE=2 -gsplit-dwarf' --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --build=290518-214917 --with-compat --with-http_stub_status_module --with-http_secure_link_module --with-libatomic --with-http_gzip_static_module --with-http_sub_module --with-http_addition_module --with-http_image_filter_module=dynamic --with-http_geoip_module --with-stream_geoip_module --with-stream_realip_module --with-stream_ssl_preread_module --with-threads --with-stream=dynamic --with-stream_ssl_module --with-http_realip_module --add-dynamic-module=../ngx-fancyindex-0.4.2 --add-module=../ngx_cache_purge-2.4.2 --add-module=../ngx_devel_kit-0.3.0 --add-dynamic-module=../set-misc-nginx-module-0.32 --add-dynamic-module=../echo-nginx-module-0.61 --add-module=../redis2-nginx-module-0.15 --add-module=../ngx_http_redis-0.3.7 --add-module=../memc-nginx-module-0.18 --add-module=../srcache-nginx-module-0.31 --add-dynamic-module=../headers-more-nginx-module-0.33 --with-pcre=../pcre-8.42 --with-pcre-jit --with-zlib=../zlib-cloudflare-1.3.0 --with-http_ssl_module --with-http_v2_module --with-openssl=../openssl-1.1.0h --with-openssl-opt='enable-ec_nistp_64_gcc_128'
    

    Code (Text):
    -------------------------------------------------------------------------------------------
    h2load --version
    h2load nghttp2/1.31.1
    -------------------------------------------------------------------------------------------
    
    h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-RSA-AES128-GCM-SHA256
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 219.29ms, 4560.17 req/s, 9.89MB/s
    requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                         min         max         mean         sd        +/- sd
    time for request:     3.04ms     37.92ms     11.03ms      3.71ms    62.20%
    time for connect:    30.98ms     83.37ms     63.77ms     18.31ms    63.00%
    time to 1st byte:    38.47ms     98.69ms     76.83ms     22.19ms    69.00%
    req/s           :      46.28      111.96       65.50       26.73    69.00%
    -------------------------------------------------------------------------------------------
    
    h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-RSA-AES256-GCM-SHA384
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 305.36ms, 3274.78 req/s, 7.10MB/s
    requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                         min         max         mean         sd        +/- sd
    time for request:      678us     46.22ms     17.10ms      7.07ms    71.90%
    time for connect:    14.89ms    112.99ms     86.67ms     28.69ms    83.00%
    time to 1st byte:    24.06ms    139.42ms    111.26ms     36.50ms    85.00%
    req/s           :      33.31      175.96       54.34       48.31    85.00%
    -------------------------------------------------------------------------------------------
    

    Code (Text):
    h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-ECDSA-AES128-GCM-SHA256
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 225.36ms, 4437.34 req/s, 9.62MB/s
    requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                         min         max         mean         sd        +/- sd
    time for request:     1.23ms     24.44ms     13.11ms      5.34ms    71.80%
    time for connect:    42.95ms     70.45ms     62.76ms     10.23ms    76.00%
    time to 1st byte:    67.43ms     81.44ms     74.18ms      3.84ms    60.00%
    req/s           :      45.43      108.33       56.37       21.59    84.00%
    -------------------------------------------------------------------------------------------
    
    h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c100 -n1000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-ECDSA-AES256-GCM-SHA384
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 261.21ms, 3828.26 req/s, 8.30MB/s
    requests: 1000 total, 1000 started, 1000 done, 1000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 1000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 2.17MB (2274000) total, 154.39KB (158100) headers (space savings 29.73%), 2.00MB (2093000) data
                         min         max         mean         sd        +/- sd
    time for request:      307us     22.50ms     17.67ms      5.18ms    87.70%
    time for connect:    40.15ms     65.14ms     59.52ms      8.42ms    83.00%
    time to 1st byte:    62.68ms     81.45ms     71.14ms      5.64ms    58.00%
    req/s           :      38.92      135.86       46.18       22.31    94.00%
    -------------------------------------------------------------------------------------------
    

    Code (Text):
    h2load --ciphers=ECDHE-RSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-RSA-AES128-GCM-SHA256
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 1.30s, 4600.38 req/s, 9.97MB/s
    requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                         min         max         mean         sd        +/- sd
    time for request:      462us    123.40ms     46.25ms     12.59ms    89.88%
    time for connect:    39.25ms    311.85ms    261.97ms     64.69ms    89.67%
    time to 1st byte:    49.63ms    366.89ms    317.90ms     75.70ms    92.67%
    req/s           :      15.44      160.96       25.95       36.38    92.67%
    -------------------------------------------------------------------------------------------
    
    h2load --ciphers=ECDHE-RSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-RSA-AES256-GCM-SHA384
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 1.16s, 5154.79 req/s, 11.17MB/s
    requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                         min         max         mean         sd        +/- sd
    time for request:      452us    110.39ms     38.50ms     12.47ms    85.58%
    time for connect:    44.00ms    303.16ms    250.01ms     71.96ms    88.33%
    time to 1st byte:    59.25ms    350.25ms    298.97ms     84.14ms    88.33%
    req/s           :      17.43      112.83       28.30       29.26    88.33%
    -------------------------------------------------------------------------------------------
    

    Code (Text):
    h2load --ciphers=ECDHE-ECDSA-AES128-GCM-SHA256 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-ECDSA-AES128-GCM-SHA256
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 1.22s, 4920.71 req/s, 10.66MB/s
    requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                         min         max         mean         sd        +/- sd
    time for request:      808us     56.45ms     46.33ms     12.76ms    90.30%
    time for connect:   125.46ms    247.05ms    178.62ms     31.27ms    66.67%
    time to 1st byte:   181.94ms    301.46ms    215.84ms     34.09ms    87.67%
    req/s           :      16.55       72.33       20.79       13.52    93.33%
    -------------------------------------------------------------------------------------------
    
    h2load --ciphers=ECDHE-ECDSA-AES256-GCM-SHA384 -H 'Accept-Encoding: gzip' -c300 -n6000 https://http2.domain.com
    TLS Protocol: TLSv1.2
    Cipher: ECDHE-ECDSA-AES256-GCM-SHA384
    Server Temp Key: ECDH P-256 256 bits
    Application protocol: h2
    
    finished in 1.09s, 5529.35 req/s, 11.98MB/s
    requests: 6000 total, 6000 started, 6000 done, 6000 succeeded, 0 failed, 0 errored, 0 timeout
    status codes: 6000 2xx, 0 3xx, 0 4xx, 0 5xx
    traffic: 13.00MB (13629000) total, 926.07KB (948300) headers (space savings 29.76%), 11.98MB (12558000) data
                         min         max         mean         sd        +/- sd
    time for request:      388us     63.53ms     37.82ms     13.23ms    83.22%
    time for connect:   115.11ms    238.77ms    178.21ms     27.32ms    78.67%
    time to 1st byte:   178.67ms    286.84ms    208.59ms     28.50ms    88.33%
    req/s           :      18.61       56.01       24.75       12.89    84.67%
    

    Code (Text):
    -------------------------------------------------------------------------------------------
    h2load load statistics
    -------------------------------------------------------------------------------------------
    sar -q -s 22:06:18
    Linux 3.10.0-693.17.1.el7.x86_64 (hostname)     05/29/2018      _x86_64_        (4 CPU)
    
    10:06:18 PM   runq-sz  plist-sz   ldavg-1   ldavg-5  ldavg-15   blocked
    10:06:19 PM         0       160      0.43      0.60      0.93         0
    10:06:20 PM         1       160      0.43      0.60      0.93         0
    10:06:21 PM         0       160      0.43      0.60      0.93         0
    10:06:22 PM         0       160      0.43      0.60      0.93         0
    10:06:23 PM         0       160      0.43      0.60      0.93         0
    10:06:24 PM         1       160      0.39      0.59      0.92         0
    10:06:25 PM         1       160      0.39      0.59      0.92         0
    10:06:26 PM         0       160      0.39      0.59      0.92         0
    10:06:27 PM         1       160      0.39      0.59      0.92         0
    10:06:28 PM         1       160      0.39      0.59      0.92         0
    10:06:29 PM         1       160      0.36      0.58      0.92         0
    10:06:30 PM         1       160      0.36      0.58      0.92         0
    10:06:31 PM         0       160      0.36      0.58      0.92         0
    10:06:32 PM         0       160      0.36      0.58      0.92         0
    10:06:33 PM         0       160      0.36      0.58      0.92         0
    10:06:34 PM         1       161      0.33      0.57      0.91         0
    10:06:35 PM         1       160      0.33      0.57      0.91         0
    10:06:36 PM         0       160      0.33      0.57      0.91         0
    10:06:37 PM         0       160      0.33      0.57      0.91         0
    10:06:38 PM         0       160      0.33      0.57      0.91         0
    10:06:39 PM         0       160      0.39      0.58      0.91         0
    10:06:40 PM         1       160      0.39      0.58      0.91         0
    10:06:41 PM         0       160      0.39      0.58      0.91         0
    10:06:42 PM         1       160      0.39      0.58      0.91         0
    10:06:43 PM         1       160      0.39      0.58      0.91         0
    10:06:44 PM         1       160      0.36      0.57      0.91         0
    10:06:45 PM         0       160      0.36      0.57      0.91         0
    10:06:46 PM         0       160      0.36      0.57      0.91         0
    10:06:47 PM         0       160      0.36      0.57      0.91         0
    10:06:48 PM         1       160      0.36      0.57      0.91         0
    10:06:49 PM         1       160      0.33      0.56      0.90         0
    10:06:50 PM         1       160      0.33      0.56      0.90         0
    10:06:51 PM         1       160      0.33      0.56      0.90         0
    10:06:52 PM         1       160      0.33      0.56      0.90         0
    10:06:53 PM         1       160      0.33      0.56      0.90         0
    10:06:54 PM        11       171      0.30      0.55      0.90         1
    10:06:55 PM         1       160      0.30      0.55      0.90         0
    10:06:56 PM         1       160      0.30      0.55      0.90         0
    10:06:57 PM         1       160      0.30      0.55      0.90         0
    10:06:58 PM         1       160      0.30      0.55      0.90         0
    10:06:59 PM         1       162      0.28      0.54      0.89         0
    10:07:00 PM         1       160      0.28      0.54      0.89         0
    10:07:01 PM         0       160      0.28      0.54      0.89         0
    10:07:02 PM         0       160      0.28      0.54      0.89         0
    10:07:03 PM         1       160      0.28      0.54      0.89         0
    10:07:04 PM         1       160      0.26      0.53      0.89         0
    10:07:05 PM         1       160      0.26      0.53      0.89         0
    10:07:06 PM         1       160      0.26      0.53      0.89         0
    10:07:07 PM         1       160      0.26      0.53      0.89         0
    10:07:08 PM         1       160      0.26      0.53      0.89         0
    10:07:09 PM         1       160      0.23      0.52      0.89         0
    10:07:10 PM         1       160      0.23      0.52      0.89         0
    10:07:11 PM         0       160      0.23      0.52      0.89         0
    10:07:12 PM         0       160      0.23      0.52      0.89         0
    10:07:13 PM         0       160      0.23      0.52      0.89         0
    10:07:14 PM         5       163      0.22      0.51      0.88         0
    10:07:15 PM         0       160      0.22      0.51      0.88         0
    10:07:16 PM         0       160      0.22      0.51      0.88         0
    10:07:17 PM         0       160      0.22      0.51      0.88         0
    10:07:18 PM         1       160      0.22      0.51      0.88         0
    10:07:19 PM         0       160      0.20      0.50      0.88         0
    10:07:20 PM         1       160      0.20      0.50      0.88         0
    10:07:21 PM         1       160      0.20      0.50      0.88         0
    10:07:22 PM         1       160      0.20      0.50      0.88         0
    10:07:23 PM         1       160      0.20      0.50      0.88         0
    10:07:24 PM         1       160      0.18      0.49      0.87         0
    10:07:25 PM         1       160      0.18      0.49      0.87         0
    10:07:26 PM         1       160      0.18      0.49      0.87         0
    10:07:27 PM         1       160      0.18      0.49      0.87         0
    10:07:28 PM         1       160      0.18      0.49      0.87         0
    10:07:29 PM         0       160      0.17      0.49      0.87         0
    10:07:30 PM         0       160      0.17      0.49      0.87         0
    10:07:31 PM         1       160      0.17      0.49      0.87         0
    10:07:32 PM         0       160      0.17      0.49      0.87         0
    10:07:33 PM         0       160      0.17      0.49      0.87         0
    10:07:34 PM         1       160      0.15      0.48      0.86         0
    10:07:35 PM         0       160      0.15      0.48      0.86         0
    10:07:36 PM         1       160      0.15      0.48      0.86         0
    10:07:37 PM         1       160      0.15      0.48      0.86         0
    10:07:38 PM         1       160      0.15      0.48      0.86         0
    10:07:39 PM         1       160      0.14      0.47      0.86         0
    10:07:40 PM         2       162      0.14      0.47      0.86         0
    10:07:41 PM         1       170      0.14      0.47      0.86         0
    10:07:42 PM         0       160      0.14      0.47      0.86         0
    10:07:43 PM         0       160      0.14      0.47      0.86         0
    10:07:44 PM         0       160      0.13      0.46      0.85         0
    10:07:45 PM         0       160      0.13      0.46      0.85         0
    10:07:46 PM         0       160      0.13      0.46      0.85         0
    10:07:47 PM         1       160      0.13      0.46      0.85         0
    10:07:48 PM         1       160      0.13      0.46      0.85         0
    10:07:49 PM         0       160      0.12      0.45      0.85         0
    10:07:50 PM         1       160      0.12      0.45      0.85         0
    10:07:51 PM         1       160      0.12      0.45      0.85         0
    10:07:52 PM         0       160      0.12      0.45      0.85         0
    10:07:53 PM         0       160      0.12      0.45      0.85         0
    10:07:54 PM         0       160      0.11      0.45      0.84         0
    10:07:55 PM         0       160      0.11      0.45      0.84         0
    10:07:56 PM         1       160      0.11      0.45      0.84         0
    10:07:57 PM         0       160      0.11      0.45      0.84         0
    10:07:58 PM         1       160      0.11      0.45      0.84         0
    10:07:59 PM         1       160      0.10      0.44      0.84         0
    10:08:00 PM         1       160      0.10      0.44      0.84         0
    10:08:01 PM         1       160      0.10      0.44      0.84         0
    10:08:02 PM         2       162      0.10      0.44      0.84         0
    10:08:03 PM         0       160      0.10      0.44      0.84         0
    10:08:04 PM         0       160      0.09      0.43      0.83         0
    10:08:05 PM         0       160      0.09      0.43      0.83         0
    10:08:06 PM         1       160      0.09      0.43      0.83         0
    10:08:07 PM         1       160      0.09      0.43      0.83         0
    10:08:08 PM         1       160      0.09      0.43      0.83         0
    10:08:09 PM         1       160      0.09      0.43      0.83         0
    10:08:10 PM         0       162      0.09      0.43      0.83         0
    10:08:11 PM         1       162      0.09      0.43      0.83         0
    10:08:12 PM         0       162      0.09      0.43      0.83         0
    10:08:13 PM         0       162      0.09      0.43      0.83         0
    10:08:14 PM         0       162      0.08      0.42      0.83         0
    10:08:15 PM         0       162      0.08      0.42      0.83         0
    10:08:16 PM         0       162      0.08      0.42      0.83         0
    10:08:17 PM         0       162      0.08      0.42      0.83         0
    10:08:18 PM         1       162      0.08      0.42      0.83         0
    10:08:19 PM         1       162      0.07      0.41      0.82         0
    10:08:20 PM         1       162      0.07      0.41      0.82         0
    10:08:21 PM         1       162      0.07      0.41      0.82         0
    10:08:22 PM         1       162      0.07      0.41      0.82         0
    10:08:23 PM         1       164      0.07      0.41      0.82         0
    10:08:24 PM         0       160      0.23      0.44      0.83         0
    10:08:25 PM         0       160      0.23      0.44      0.83         0
    10:08:26 PM         0       160      0.23      0.44      0.83         0
    10:08:27 PM         1       160      0.23      0.44      0.83         0
    10:08:28 PM         1       160      0.23      0.44      0.83         0
    10:08:29 PM         1       160      0.21      0.43      0.82         0
    10:08:30 PM         1       160      0.21      0.43      0.82         0
    10:08:31 PM         1       160      0.21      0.43      0.82         0
    10:08:32 PM         1       160      0.21      0.43      0.82         0
    10:08:33 PM         1       160      0.21      0.43      0.82         0
    10:08:34 PM         1       160      0.19      0.42      0.82         0
    10:08:35 PM         0       160      0.19      0.42      0.82         0
    10:08:36 PM         0       160      0.19      0.42      0.82         0
    10:08:37 PM         0       160      0.19      0.42      0.82         0
    10:08:38 PM         0       160      0.19      0.42      0.82         0
    10:08:39 PM         0       160      0.18      0.42      0.81         0
    10:08:40 PM         1       160      0.18      0.42      0.81         0
    10:08:41 PM         1       160      0.18      0.42      0.81         0
    10:08:42 PM         1       160      0.18      0.42      0.81         0
    10:08:43 PM         1       160      0.18      0.42      0.81         0
    10:08:44 PM         1       162      0.16      0.41      0.81         0
    10:08:45 PM         1       167      0.16      0.41      0.81         0
    10:08:46 PM         0       160      0.16      0.41      0.81         0
    10:08:47 PM         0       160      0.16      0.41      0.81         0
    10:08:48 PM         0       160      0.16      0.41      0.81         0
    10:08:49 PM         1       160      0.15      0.40      0.81         0
    10:08:50 PM         1       160      0.15      0.40      0.81         0
    10:08:51 PM         1       160      0.15      0.40      0.81         0
    10:08:52 PM         1       160      0.15      0.40      0.81         0
    10:08:53 PM         1       160      0.15      0.40      0.81         0
    10:08:54 PM         0       160      0.14      0.40      0.80         0
    10:08:55 PM         0       160      0.14      0.40      0.80         0
    10:08:56 PM         0       160      0.14      0.40      0.80         0
    10:08:57 PM         0       160      0.14      0.40      0.80         0
    10:08:58 PM         0       160      0.14      0.40      0.80         0
    10:08:59 PM         0       160      0.13      0.39      0.80         0
    10:09:00 PM         0       160      0.13      0.39      0.80         0
    10:09:01 PM         1       160      0.13      0.39      0.80         0
    10:09:02 PM         1       160      0.13      0.39      0.80         0
    10:09:03 PM         1       160      0.13      0.39      0.80         0
    10:09:04 PM         1       160      0.12      0.38      0.79         0
    10:09:05 PM         1       160      0.12      0.38      0.79         0
    Average:            1       160      0.21      0.48      0.86         0
    -------------------------------------------------------------------------------------------
    

    Code (Text):
    sar -r -s 22:06:18
    Linux 3.10.0-693.17.1.el7.x86_64 (hostname)     05/29/2018      _x86_64_        (4 CPU)
    
    10:06:18 PM kbmemfree kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
    10:06:19 PM  15183956   1083684      6.66     11496    149864   7918596     45.73    800848     92364       192
    10:06:20 PM  15183988   1083652      6.66     11496    149788   7918596     45.73    800972     92400       220
    10:06:21 PM  15183988   1083652      6.66     11496    149788   7918596     45.73    800972     92400       220
    10:06:22 PM  15183988   1083652      6.66     11496    149788   7918596     45.73    800972     92400       220
    10:06:23 PM  15183988   1083652      6.66     11504    149800   7918596     45.73    801008     92404       392
    10:06:24 PM  15183988   1083652      6.66     11508    149804   7918596     45.73    801016     92404         4
    10:06:25 PM  15183988   1083652      6.66     11508    149804   7918596     45.73    801016     92404         4
    10:06:26 PM  15183988   1083652      6.66     11508    149804   7918596     45.73    801016     92404         4
    10:06:27 PM  15183988   1083652      6.66     11508    149812   7918596     45.73    801020     92408        16
    10:06:28 PM  15183988   1083652      6.66     11508    149816   7918596     45.73    801024     92408        20
    10:06:29 PM  15183988   1083652      6.66     11516    149816   7918596     45.73    801028     92412       108
    10:06:30 PM  15183988   1083652      6.66     11516    149820   7918596     45.73    801028     92412       112
    10:06:31 PM  15183988   1083652      6.66     11516    149820   7918596     45.73    801028     92412       112
    10:06:32 PM  15183988   1083652      6.66     11516    149824   7918596     45.73    801036     92412       116
    10:06:33 PM  15183988   1083652      6.66     11516    149828   7918596     45.73    801036     92412       120
    10:06:34 PM  15178836   1088804      6.69     11524    149832   7940612     45.86    805540     92424       132
    10:06:35 PM  15182448   1085192      6.67     11524    149832   7918596     45.73    801052     92424       132
    10:06:36 PM  15182504   1085136      6.67     11524    149836   7918596     45.73    801052     92424       136
    10:06:37 PM  15182592   1085048      6.67     11524    149840   7918596     45.73    801056     92424       140
    10:06:38 PM  15182592   1085048      6.67     11524    149840   7918596     45.73    801060     92424       140
    10:06:39 PM  15183308   1084332      6.67     11524    149844   7918596     45.73    801424     92204       152
    10:06:40 PM  15183612   1084028      6.66     11532    149948   7918596     45.73    801284     92300       312
    10:06:41 PM  15183612   1084028      6.66     11532    149948   7918596     45.73    801284     92300       312
    10:06:42 PM  15183612   1084028      6.66     11532    149952   7918596     45.73    801284     92300       316
    10:06:43 PM  15183612   1084028      6.66     11532    149956   7918596     45.73    801288     92300       320
    10:06:44 PM  15183612   1084028      6.66     11532    149956   7918596     45.73    801288     92300       320
    10:06:45 PM  15183612   1084028      6.66     11540    149960   7918596     45.73    801296     92300       324
    10:06:46 PM  15183612   1084028      6.66     11540    149960   7918596     45.73    801296     92300       324
    10:06:47 PM  15183612   1084028      6.66     11540    149972   7918596     45.73    801300     92316       336
    10:06:48 PM  15183612   1084028      6.66     11540    149972   7918596     45.73    801308     92316       336
    10:06:49 PM  15183612   1084028      6.66     11540    149976   7918596     45.73    801308     92316       340
    10:06:50 PM  15183612   1084028      6.66     11540    149980   7918596     45.73    801324     92308       344
    10:06:51 PM  15183612   1084028      6.66     11548    149980   7918596     45.73    801324     92308       344
    10:06:52 PM  15183612   1084028      6.66     11548    149984   7918596     45.73    801324     92308       348
    10:06:53 PM  15183612   1084028      6.66     11548    149984   7918596     45.73    801324     92308       348
    10:06:54 PM  15165616   1102024      6.77     11548    149988   8160772     47.13    819728     92308       352
    10:06:55 PM  15182248   1085392      6.67     11548    149996   7918596     45.73    801360     92316       356
    10:06:56 PM  15182248   1085392      6.67     11556    150000   7918596     45.73    801360     92320       376
    10:06:57 PM  15182248   1085392      6.67     11556    150000   7918596     45.73    801364     92320       376
    10:06:58 PM  15182248   1085392      6.67     11556    150004   7918596     45.73    801364     92324       380
    10:06:59 PM  15172560   1095080      6.73     11556    150008   7932200     45.81    812396     92324       140
    10:07:00 PM  15182948   1084692      6.67     11556    150008   7918596     45.73    801328     92324       140
    10:07:01 PM  15183136   1084504      6.67     11564    150080   7918596     45.73    801340     92400       220
    10:07:02 PM  15183212   1084428      6.67     11564    150120   7918596     45.73    801360     92420       336
    10:07:03 PM  15183212   1084428      6.67     11564    150120   7918596     45.73    801364     92420       336
    10:07:04 PM  15183212   1084428      6.67     11564    150120   7918596     45.73    801364     92420        44
    10:07:05 PM  15183212   1084428      6.67     11564    150128   7918596     45.73    801368     92420         8
    10:07:06 PM  15183212   1084428      6.67     11564    150132   7918596     45.73    801372     92420        12
    10:07:07 PM  15183212   1084428      6.67     11572    150132   7918596     45.73    801396     92432       104
    10:07:08 PM  15183212   1084428      6.67     11572    150136   7918596     45.73    801396     92432       108
    10:07:09 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801400     92432       112
    10:07:10 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801404     92432       112
    10:07:11 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801404     92432       112
    10:07:12 PM  15183212   1084428      6.67     11572    150140   7918596     45.73    801404     92432       112
    10:07:13 PM  15183088   1084552      6.67     11580    150152   7918596     45.73    801412     92432       124
    10:07:14 PM  15180908   1086732      6.68     11580    150156   7984644     46.11    803764     92432       128
    10:07:15 PM  15181688   1085952      6.68     11580    150164   7918596     45.73    801436     92440       140
    10:07:16 PM  15181728   1085912      6.68     11580    150164   7918596     45.73    801436     92440       140
    10:07:17 PM  15181848   1085792      6.67     11580    150168   7918596     45.73    801436     92440       144
    10:07:18 PM  15181848   1085792      6.67     11580    150172   7918596     45.73    801440     92440       148
    10:07:19 PM  15181848   1085792      6.67     11588    150172   7918596     45.73    801444     92440       148
    10:07:20 PM  15182248   1085392      6.67     11588    150172   7918596     45.73    801536     92440       148
    10:07:21 PM  15182408   1085232      6.67     11588    150284   7918596     45.73    801440     92544       284
    10:07:22 PM  15182408   1085232      6.67     11588    150284   7918596     45.73    801444     92544       284
    10:07:23 PM  15182408   1085232      6.67     11588    150284   7918596     45.73    801444     92544       284
    10:07:24 PM  15182408   1085232      6.67     11588    150292   7918596     45.73    801448     92544       292
    10:07:25 PM  15182408   1085232      6.67     11596    150288   7918596     45.73    801456     92544         0
    10:07:26 PM  15182408   1085232      6.67     11596    150296   7918596     45.73    801456     92544         8
    10:07:27 PM  15182408   1085232      6.67     11596    150300   7918596     45.73    801456     92544        12
    10:07:28 PM  15182408   1085232      6.67     11596    150304   7918596     45.73    801460     92552        16
    10:07:29 PM  15182408   1085232      6.67     11596    150304   7918596     45.73    801464     92552        16
    10:07:30 PM  15182408   1085232      6.67     11604    150308   7918596     45.73    801464     92556        80
    10:07:31 PM  15182408   1085232      6.67     11604    150312   7918596     45.73    801468     92556        88
    10:07:32 PM  15182408   1085232      6.67     11604    150312   7918596     45.73    801472     92556        88
    10:07:33 PM  15182408   1085232      6.67     11604    150316   7918596     45.73    801472     92556        92
    10:07:34 PM  15182408   1085232      6.67     11604    150316   7918596     45.73    801472     92556        92
    10:07:35 PM  15181364   1086276      6.68     11612    150320   7918596     45.73    801500     92568       128
    10:07:36 PM  15181416   1086224      6.68     11612    150328   7918596     45.73    801500     92572       136
    10:07:37 PM  15181416   1086224      6.68     11612    150328   7918596     45.73    801500     92572       136
    10:07:38 PM  15181416   1086224      6.68     11612    150332   7918596     45.73    801512     92568       140
    10:07:39 PM  15181416   1086224      6.68     11612    150336   7918596     45.73    801512     92568       144
    10:07:40 PM  15158968   1108672      6.82     11620    150340   7940580     45.86    824264     92572       156
    10:07:41 PM  15174924   1092716      6.72     11620    150852   7959624     45.97    808020     93076       672
    10:07:42 PM  15181260   1086380      6.68     11620    151144   7918596     45.73    801636     93076       672
    10:07:43 PM  15181432   1086208      6.68     11620    150952   7918596     45.73    801500     93164       784
    10:07:44 PM  15181432   1086208      6.68     11620    150952   7918596     45.73    801500     93164       784
    10:07:45 PM  15181432   1086208      6.68     11628    150956   7918596     45.73    801504     93164       812
    10:07:46 PM  15181432   1086208      6.68     11628    150960   7918596     45.73    801508     93164       816
    10:07:47 PM  15181432   1086208      6.68     11628    150964   7918596     45.73    801532     93172       820
    10:07:48 PM  15181432   1086208      6.68     11628    150964   7918596     45.73    801532     93172       820
    10:07:49 PM  15181432   1086208      6.68     11628    150964   7918596     45.73    801532     93172       820
    10:07:50 PM  15181432   1086208      6.68     11628    150972   7918596     45.73    801540     93172       828
    10:07:51 PM  15181432   1086208      6.68     11636    150964   7918596     45.73    801544     93172         0
    10:07:52 PM  15181432   1086208      6.68     11636    150964   7918596     45.73    801544     93172         0
    10:07:53 PM  15181432   1086208      6.68     11636    150980   7918596     45.73    801560     93172        16
    10:07:54 PM  15181432   1086208      6.68     11636    150980   7918596     45.73    801564     93172        16
    10:07:55 PM  15180700   1086940      6.68     11636    150980   7918596     45.73    801860     93172        16
    10:07:56 PM  15181060   1086580      6.68     11644    150996   7918596     45.73    801588     93168        52
    10:07:57 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
    10:07:58 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
    10:07:59 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
    10:08:00 PM  15181060   1086580      6.68     11644    151000   7918596     45.73    801596     93176       136
    10:08:01 PM  15181060   1086580      6.68     11652    150992   7918596     45.73    801596     93176       136
    10:08:02 PM  15154764   1112876      6.84     11652    151308   7940580     45.86    826496     93380       476
    10:08:03 PM  15179872   1087768      6.69     11652    151488   7918596     45.73    801712     93464       848
    10:08:04 PM  15180092   1087548      6.69     11652    151624   7918596     45.73    801600     93776       804
    10:08:05 PM  15180092   1087548      6.69     11652    151628   7918596     45.73    801604     93776       808
    10:08:06 PM  15180092   1087548      6.69     11652    151632   7918596     45.73    801608     93776       812
    10:08:07 PM  15180092   1087548      6.69     11660    151624   7918596     45.73    801608     93780       812
    10:08:08 PM  15180092   1087548      6.69     11660    151624   7918596     45.73    801608     93780       812
    10:08:09 PM  15180092   1087548      6.69     11660    151624   7918596     45.73    801608     93780       812
    10:08:10 PM  15178672   1088968      6.69     11668    151632   7921644     45.75    803072     93340       840
    10:08:11 PM  15178672   1088968      6.69     11668    151640   7921644     45.75    803124     93344       844
    10:08:12 PM  15178672   1088968      6.69     11668    151640   7921644     45.75    803124     93344       844
    10:08:13 PM  15178672   1088968      6.69     11668    151640   7921644     45.75    803124     93344       844
    10:08:14 PM  15178432   1089208      6.70     11668    151656   7921644     45.75    803420     93208       860
    10:08:15 PM  15177036   1090604      6.70     11676    151668   7921644     45.75    803444     93220       868
    10:08:16 PM  15177036   1090604      6.70     11676    151668   7921644     45.75    803444     93220       868
    10:08:17 PM  15177036   1090604      6.70     11676    151676   7921644     45.75    803444     93228       876
    10:08:18 PM  15177036   1090604      6.70     11676    151680   7921644     45.75    803448     93228       880
    10:08:19 PM  15177036   1090604      6.70     11676    151680   7921644     45.75    803448     93228       880
    10:08:20 PM  15177036   1090604      6.70     11676    151684   7921644     45.75    803468     93228       884
    10:08:21 PM  15177160   1090480      6.70     11684    151680   7921644     45.75    803472     93228       888
    10:08:22 PM  15177160   1090480      6.70     11684    151688   7921644     45.75    803476     93228       884
    10:08:23 PM  15153932   1113708      6.85     11684    151692   7939532     45.85    827248     93236       888
    10:08:24 PM  15179296   1088344      6.69     11684    152212   7918596     45.73    802404     93744      1408
    10:08:25 PM  15179552   1088088      6.69     11684    152304   7918596     45.73    802356     93752      1500
    10:08:26 PM  15179552   1088088      6.69     11692    152308   7918596     45.73    802372     93756      1328
    10:08:27 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
    10:08:28 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
    10:08:29 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
    10:08:30 PM  15179536   1088104      6.69     11692    152312   7918596     45.73    802376     93760      1336
    10:08:31 PM  15179536   1088104      6.69     11700    152324   7918596     45.73    802388     93760      1368
    10:08:32 PM  15179412   1088228      6.69     11700    152324   7918596     45.73    802392     93760      1368
    10:08:33 PM  15179412   1088228      6.69     11700    152324   7918596     45.73    802392     93760      1368
    10:08:34 PM  15179412   1088228      6.69     11700    152324   7918596     45.73    802392     93760      1368
    10:08:35 PM  15178608   1089032      6.69     11700    152336   7918596     45.73    802404     93768      1384
    10:08:36 PM  15178884   1088756      6.69     11700    152340   7918596     45.73    802404     93768       164
    10:08:37 PM  15178884   1088756      6.69     11708    152332   7918596     45.73    802404     93768       164
    10:08:38 PM  15178884   1088756      6.69     11708    152332   7918596     45.73    802404     93768       164
    10:08:39 PM  15178884   1088756      6.69     11708    152348   7918596     45.73    802412     93776       172
    10:08:40 PM  15178884   1088756      6.69     11708    152352   7918596     45.73    802416     93776       176
    10:08:41 PM  15178884   1088756      6.69     11708    152352   7918596     45.73    802416     93776       176
    10:08:42 PM  15179008   1088632      6.69     11716    152356   7918596     45.73    802420     93776       180
    10:08:43 PM  15179008   1088632      6.69     11716    152360   7918596     45.73    802424     93776       184
    10:08:44 PM  15154092   1113548      6.85     11716    152360   7936484     45.83    826688     93784       192
    10:08:45 PM  15255936   1011704      6.22     11716    152840   7760884     44.82    725044     94180       676
    10:08:46 PM  15178536   1089104      6.69     11716    152840   7918596     45.73    802564     94180       676
    10:08:47 PM  15178788   1088852      6.69     11724    152984   7918596     45.73    802400     94388       828
    10:08:48 PM  15178788   1088852      6.69     11724    152988   7918596     45.73    802400     94388       832
    10:08:49 PM  15178788   1088852      6.69     11724    152988   7918596     45.73    802400     94388       832
    10:08:50 PM  15178788   1088852      6.69     11724    152996   7918596     45.73    802408     94388       840
    10:08:51 PM  15178788   1088852      6.69     11724    152996   7918596     45.73    802412     94388       840
    10:08:52 PM  15178788   1088852      6.69     11732    153000   7918596     45.73    802440     94388       844
    10:08:53 PM  15178788   1088852      6.69     11732    153004   7918596     45.73    802444     94388       848
    10:08:54 PM  15178788   1088852      6.69     11732    153004   7918596     45.73    802444     94388       848
    10:08:55 PM  15177404   1090236      6.70     11732    153008   7918596     45.73    802472     94396       856
    10:08:56 PM  15177492   1090148      6.70     11732    153012   7918596     45.73    802472     94396       736
    10:08:57 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
    10:08:58 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
    10:08:59 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
    10:09:00 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
    10:09:01 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
    10:09:02 PM  15177548   1090092      6.70     11740    153004   7918596     45.73    802472     94396       736
    10:09:03 PM  15177548   1090092      6.70     11748    152996   7918596     45.73    802472     94396       736
    10:09:04 PM  15177548   1090092      6.70     11748    152996   7918596     45.73    802472     94396       736
    10:09:05 PM  15177548   1090092      6.70     11748    153036   7918596     45.73    802496     94400       700
    Average:     15180726   1086914      6.68     11621    151034   7920689     45.74    802173     93060       454
    -------------------------------------------------------------------------------------------
    
    h2load tests completed using temp /etc/hosts entry:
    server-ip-mask http2.domain.com #h2load
    
    centmin mod local code last commit:
    
    b31b485 George Liu Tue, 29 May 2018 04:14:41 +1000
    update inc/mariadb_install103.inc
    
     
  3. bassie

    bassie Well-Known Member

    1,025
    246
    63
    Apr 29, 2016
    Ratings:
    +726
    Local Time:
    12:50 PM
    It is Dallas, US only.
     
  4. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Yeah Dallas only :)
     
  5. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x

    sysbench benchmarks



    Giving my updated sysbench benchmark scripts a whirl :)

    Sysbench CPU benchmarks - 1 thread. Single thread sysbench cpu benchmark was within 79% the performance of a single thread Intel Core i7 4790K clocked at 4.0Ghz with Turbo boost to 4.40Ghz !
    Code (Text):
    ./sysbench.sh cpu
    -------------------------------------------
    System Information
    -------------------------------------------
    
    3.10.0-693.17.1.el7.x86_64
    
    CentOS Linux release 7.5.1804 (Core)
    
    Centmin Mod
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 94
    Model name:            Intel Core Processor (Skylake, IBRS)
    Stepping:              3
    CPU MHz:               2099.998
    BogoMIPS:              4199.99
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    
    CPU Flags
     fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    
    CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
    0   0    0      0    0:0:0      yes
    1   0    0      1    1:1:1      yes
    2   0    0      2    2:2:2      yes
    3   0    0      3    3:3:3      yes
    
                  total        used        free      shared  buff/cache   available
    Mem:          15886         831       14609          30         445       14722
    Low:          15886        1276       14609
    High:             0           0           0
    Swap:          1023           0        1023
    
    Filesystem                       Size  Used Avail Use% Mounted on
    /dev/mapper/centos_centos7-root   78G  6.4G   68G   9% /
    devtmpfs                         7.8G     0  7.8G   0% /dev
    tmpfs                            7.8G     0  7.8G   0% /dev/shm
    tmpfs                            7.8G   17M  7.8G   1% /run
    tmpfs                            7.8G     0  7.8G   0% /sys/fs/cgroup
    /dev/sda1                       1014M  264M  751M  26% /boot
    tmpfs                            1.6G     0  1.6G   0% /run/user/0
    tmpfs                            7.8G  324K  7.8G   1% /tmp
    

    Code (Text):
    sysbench cpu --cpu-max-prime=20000 --threads=1 run
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    prime: 20000
    events/s: 417.49
    time: 10.0010s
    min: 2.15
    avg: 2.39
    max: 3.06
    95th: 2.61
    
    | cpu sysbench | threads: | events/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- |
    | 1.0.14 | 1 | 417.49 | 10.0010s | 2.15 | 2.39 | 3.06 | 2.61 |
    
    sysbench,threads,events/s,time,min,avg,max,95th
    1.0.14,1,417.49,10.0010s,2.15,2.39,3.06,2.61
    

    Sysbench CPU benchmarks - 4 thread
    Code (Text):
    sysbench cpu --cpu-max-prime=20000 --threads=4 run
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    prime: 20000
    events/s: 1556.59
    time: 10.0025s
    min: 2.15
    avg: 2.57
    max: 22.97
    95th: 2.76
    
    | cpu sysbench | threads: | events/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- |
    | 1.0.14 | 4 | 1556.59 | 10.0025s | 2.15 | 2.57 | 22.97 | 2.76 |
    
    sysbench,threads,events/s,time,min,avg,max,95th
    1.0.14,4,1556.59,10.0025s,2.15,2.57,22.97,2.76
    

    Sysbench Memory benchmarks - 1 thread
    Code (Text):
    ./sysbench.sh mem
    
    sysbench memory --threads=1 --memory-block-size=1K --memory-scope=global --memory-total-size=1G --memory-oper=read run
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    block-size: 1KiB
    total-size: 1024MiB
    operation: read
    scope: global
    total-ops: 1048576 (3101502.60 per second)
    transferred (3028.81 MiB/sec)
    time: 0.3365s
    min: 0.00
    avg: 0.00
    max: 0.05
    95th: 0.00
    
    | memory sysbench | sysbench | threads: | block-size: | total-size: | operation: | total-ops: | transferred | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | memory | 1.0.14 | 1 | 1KiB | 1024MiB | read | 1048576 | 3028.81 | 0.3365s | 0.00 | 0.00 | 0.05 | 0.00 |
    
    sysbench,sysbench,threads,block-size,total-size,operation,total-ops,transferred,time,min,avg,max,95th
    memory,1.0.14,1,1KiB,1024MiB,read,1048576,3028.81,0.3365s,0.00,0.00,0.05,0.00
    

    Sysbench Memory benchmarks - 4 thread
    Code (Text):
    sysbench memory --threads=4 --memory-block-size=1K --memory-scope=global --memory-total-size=1G --memory-oper=read run
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    block-size: 1KiB
    total-size: 1024MiB
    operation: read
    scope: global
    total-ops: 1048576 (9620871.55 per second)
    transferred (9395.38 MiB/sec)
    time: 0.1074s
    min: 0.00
    avg: 0.00
    max: 0.07
    95th: 0.00
    
    | memory sysbench | sysbench | threads: | block-size: | total-size: | operation: | total-ops: | transferred | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | memory | 1.0.14 | 4 | 1KiB | 1024MiB | read | 1048576 | 9395.38 | 0.1074s | 0.00 | 0.00 | 0.07 | 0.00 |
    
    sysbench,sysbench,threads,block-size,total-size,operation,total-ops,transferred,time,min,avg,max,95th
    memory,1.0.14,4,1KiB,1024MiB,read,1048576,9395.38,0.1074s,0.00,0.00,0.07,0.00
    

    Sysbench FileIO benchmarks - 1 thread
    Code (Text):
    ./sysbench.sh file
    
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=seqrd prepare
    
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqrd-threads-1-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential read test
    reads/s: 9463.79
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 36.97
    written-MiB/s: 0.00
    time: 10.0002s
    min: 0.07
    avg: 0.11
    max: 8.65
    95th: 0.13
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 1 | 4KiB | I/O | read | 9463.79 | 0.00 | 0.00 | 36.97 | 0.00 | 10.0002s | 0.07 | 0.11 | 8.65 | 0.13 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,1,4KiB,I/O,read,9463.79,0.00,0.00,36.97,0.00,10.0002s,0.07,0.11,8.65,0.13
    

    Code (Text):
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqwr-threads-1-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential write (creation) test
    reads/s: 0.00
    writes/s: 6368.91
    fsyncs/s: 8145.01
    read-MiB/s: 0.00
    written-MiB/s: 24.88
    time: 10.0001s
    min: 0.02
    avg: 0.07
    max: 9.33
    95th: 0.11
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 1 | 4KiB | I/O | write | 0.00 | 6368.91 | 8145.01 | 0.00 | 24.88 | 10.0001s | 0.02 | 0.07 | 9.33 | 0.11 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,1,4KiB,I/O,write,0.00,6368.91,8145.01,0.00,24.88,10.0001s,0.02,0.07,9.33,0.11
    

    Code (Text):
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndrd-threads-1-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random read test
    reads/s: 5574.94
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 21.78
    written-MiB/s: 0.00
    time: 10.0002s
    min: 0.07
    avg: 0.18
    max: 8.66
    95th: 0.23
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 1 | 4KiB | I/O | read | 5574.94 | 0.00 | 0.00 | 21.78 | 0.00 | 10.0002s | 0.07 | 0.18 | 8.66 | 0.23 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,1,4KiB,I/O,read,5574.94,0.00,0.00,21.78,0.00,10.0002s,0.07,0.18,8.66,0.23
    

    Code (Text):
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndwr-threads-1-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random write test
    reads/s: 0.00
    writes/s: 6370.71
    fsyncs/s: 8152.08
    read-MiB/s: 0.00
    written-MiB/s: 24.89
    time: 10.0002s
    min: 0.02
    avg: 0.07
    max: 7.47
    95th: 0.11
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 1 | 4KiB | I/O | write | 0.00 | 6370.71 | 8152.08 | 0.00 | 24.89 | 10.0002s | 0.02 | 0.07 | 7.47 | 0.11 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,1,4KiB,I/O,write,0.00,6370.71,8152.08,0.00,24.89,10.0002s,0.02,0.07,7.47,0.11
    

    Sysbench FileIO benchmarks - 4 thread
    Code (Text):
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqrd-threads-4-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential read test
    reads/s: 32751.29
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 127.93
    written-MiB/s: 0.00
    time: 10.0001s
    min: 0.05
    avg: 0.12
    max: 8.70
    95th: 0.17
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 4 | 4KiB | I/O | read | 32751.29 | 0.00 | 0.00 | 127.93 | 0.00 | 10.0001s | 0.05 | 0.12 | 8.70 | 0.17 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,4,4KiB,I/O,read,32751.29,0.00,0.00,127.93,0.00,10.0001s,0.05,0.12,8.70,0.17
    

    Code (Text):
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqwr-threads-4-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential write (creation) test
    reads/s: 0.00
    writes/s: 7669.29
    fsyncs/s: 9815.53
    read-MiB/s: 0.00
    written-MiB/s: 29.96
    time: 10.0005s
    min: 0.04
    avg: 0.23
    max: 30.78
    95th: 0.24
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 4 | 4KiB | I/O | write | 0.00 | 7669.29 | 9815.53 | 0.00 | 29.96 | 10.0005s | 0.04 | 0.23 | 30.78 | 0.24 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,4,4KiB,I/O,write,0.00,7669.29,9815.53,0.00,29.96,10.0005s,0.04,0.23,30.78,0.24
    

    Code (Text):
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndrd-threads-4-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random read test
    reads/s: 21518.73
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 84.06
    written-MiB/s: 0.00
    time: 10.0002s
    min: 0.06
    avg: 0.19
    max: 8.48
    95th: 0.24
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 4 | 4KiB | I/O | read | 21518.73 | 0.00 | 0.00 | 84.06 | 0.00 | 10.0002s | 0.06 | 0.19 | 8.48 | 0.24 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,4,4KiB,I/O,read,21518.73,0.00,0.00,84.06,0.00,10.0002s,0.06,0.19,8.48,0.24
    

    Code (Text):
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndwr-threads-4-raw.log
    
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random write test
    reads/s: 0.00
    writes/s: 14743.81
    fsyncs/s: 18863.76
    read-MiB/s: 0.00
    written-MiB/s: 57.59
    time: 10.0002s
    min: 0.03
    avg: 0.12
    max: 22.00
    95th: 0.21
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.14 | 4 | 4KiB | I/O | write | 0.00 | 14743.81 | 18863.76 | 0.00 | 57.59 | 10.0002s | 0.03 | 0.12 | 22.00 | 0.21 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.14,4,4KiB,I/O,write,0.00,14743.81,18863.76,0.00,57.59,10.0002s,0.03,0.12,22.00,0.21
    

    Sysbench MySQL OLTP read/write benchmarks - 4 thread
    Code (Text):
    ./sysbench.sh mysqloltpnew
    
    setup sbt database & user
    mysqladmin create database: sbt
    
    MySQL Buffers
    aria_pagecache_buffer_size           1073741824
    aria_sort_buffer_size                268435456
    bulk_insert_buffer_size              8388608
    innodb_buffer_pool_dump_at_shutdown  OFF
    innodb_buffer_pool_dump_now          OFF
    innodb_buffer_pool_dump_pct          100
    innodb_buffer_pool_filename          ib_buffer_pool
    innodb_buffer_pool_instances         4
    innodb_buffer_pool_load_abort        OFF
    innodb_buffer_pool_load_at_startup   OFF
    innodb_buffer_pool_load_now          OFF
    innodb_buffer_pool_populate          OFF
    innodb_buffer_pool_size              4294967296
    innodb_change_buffer_max_size        25
    innodb_change_buffering              all
    innodb_log_buffer_size               16777216
    innodb_sort_buffer_size              2097152
    join_buffer_size                     1048576
    join_buffer_space_limit              2097152
    key_buffer_size                      536870912
    mrr_buffer_size                      262144
    myisam_sort_buffer_size              536870912
    net_buffer_length                    16384
    optimizer_switch                     index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=off
    preload_buffer_size                  32768
    read_buffer_size                     1048576
    read_rnd_buffer_size                 524288
    sort_buffer_size                     2097152
    sql_buffer_result                    OFF
    
    MySQL Limits
    aria_pagecache_division_limit         100
    delayed_insert_limit                  100
    expensive_subquery_limit              100
    ft_query_expansion_limit              20
    innodb_ft_result_cache_limit          2000000000
    join_buffer_space_limit               2097152
    key_cache_division_limit              100
    log_slow_rate_limit                   1
    min_examined_row_limit                0
    open_files_limit                      524288
    optimizer_selectivity_sampling_limit  100
    query_cache_limit                     1048576
    relay_log_space_limit                 0
    sql_select_limit                      18446744073709551615
    thread_pool_stall_limit               500
    updatable_views_with_limit            YES
    
    MySQL Maxes
    aria_max_sort_file_size           9223372036853727232
    extra_max_connections             1
    ft_max_word_len                   84
    group_concat_max_len              1024
    innodb_adaptive_max_sleep_delay   150000
    innodb_compression_pad_pct_max    50
    innodb_file_format_max            Antelope
    innodb_ft_max_token_size          84
    innodb_io_capacity_max            5200
    innodb_max_bitmap_file_size       104857600
    innodb_max_changed_pages          1000000
    innodb_max_dirty_pages_pct        75.000000
    innodb_max_dirty_pages_pct_lwm    0.001000
    innodb_max_purge_lag              0
    innodb_max_purge_lag_delay        0
    innodb_online_alter_log_max_size  134217728
    max_allowed_packet                134217728
    max_binlog_cache_size             18446744073709547520
    max_binlog_size                   1073741824
    max_binlog_stmt_cache_size        18446744073709547520
    max_connect_errors                100000
    max_connections                   900
    max_delayed_threads               20
    max_digest_length                 1024
    max_error_count                   64
    max_heap_table_size               805306368
    max_insert_delayed_threads        20
    max_join_size                     18446744073709551615
    max_length_for_sort_data          1024
    max_long_data_size                134217728
    max_prepared_stmt_count           16382
    max_relay_log_size                1073741824
    max_seeks_for_key                 4294967295
    max_session_mem_used              9223372036854775807
    max_sort_length                   1024
    max_sp_recursion_depth            0
    max_statement_time                0.000000
    max_tmp_tables                    32
    max_user_connections              0
    max_write_lock_count              4294967295
    myisam_max_sort_file_size         4294967296
    slave_max_allowed_packet          1073741824
    slave_parallel_max_queued         131072
    thread_pool_max_threads           1000
    wsrep_max_ws_rows                 0
    wsrep_max_ws_size                 2147483647
    
    MySQL Concurrency
    concurrent_insert           ALWAYS
    innodb_commit_concurrency   0
    innodb_concurrency_tickets  5000
    innodb_thread_concurrency   0
    thread_concurrency          10
    

    Code (Text):
    sysbench prepare database: sbt
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql prepare
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    
    Initializing worker threads...
    
    Creating table 'sbtest3'...
    Creating table 'sbtest4'...
    Creating table 'sbtest1'...
    Creating table 'sbtest2'...
    Inserting 150000 records into 'sbtest3'
    Inserting 150000 records into 'sbtest1'
    Inserting 150000 records into 'sbtest2'
    Inserting 150000 records into 'sbtest4'
    Creating a secondary index on 'sbtest2'...
    Creating a secondary index on 'sbtest4'...
    Creating a secondary index on 'sbtest1'...
    Creating a secondary index on 'sbtest3'...
    Creating table 'sbtest8'...
    Creating table 'sbtest5'...
    Inserting 150000 records into 'sbtest8'
    Creating table 'sbtest6'...
    Inserting 150000 records into 'sbtest5'
    Inserting 150000 records into 'sbtest6'
    Creating table 'sbtest7'...
    Inserting 150000 records into 'sbtest7'
    Creating a secondary index on 'sbtest8'...
    Creating a secondary index on 'sbtest6'...
    Creating a secondary index on 'sbtest5'...
    Creating a secondary index on 'sbtest7'...
    
    +-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
    | Table Name  | Number of Rows | Storage Engine | Data Size | Index Size | Total   | ROW_FORMAT | TABLE_COLLATION |
    +-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
    | sbt.sbtest1 | 150000 Rows    | InnoDB         | 0.06MB    | 0.00MB     | 0.06MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest2 | 148032 Rows    | InnoDB         | 32.56MB   | 2.52MB     | 35.08MB | Dynamic    | utf8_general_ci |
    | sbt.sbtest3 | 148032 Rows    | InnoDB         | 32.56MB   | 0.00MB     | 32.56MB | Dynamic    | utf8_general_ci |
    | sbt.sbtest4 | 148032 Rows    | InnoDB         | 32.56MB   | 2.52MB     | 35.08MB | Dynamic    | utf8_general_ci |
    | sbt.sbtest5 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest6 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest7 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest8 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    +-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
    

    Code (Text):
    sysbench mysql OLTP new benchmark:
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql run
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    
    Running the test with following options:
    Number of threads: 4
    Report intermediate results every 1 second(s)
    Initializing random number generator from seed (1).
    
    
    Initializing worker threads...
    
    Threads started!
    
    [ 1s ] thds: 4 tps: 915.35 qps: 18348.88 (r/w/o: 12852.80/3662.39/1833.69) lat (ms,95%): 8.43 err/s: 0.00 reconn/s: 0.00
    [ 2s ] thds: 4 tps: 1070.11 qps: 21396.16 (r/w/o: 14971.51/4283.43/2141.22) lat (ms,95%): 5.99 err/s: 0.00 reconn/s: 0.00
    [ 3s ] thds: 4 tps: 1172.03 qps: 23446.51 (r/w/o: 16418.35/4684.10/2344.05) lat (ms,95%): 5.18 err/s: 0.00 reconn/s: 0.00
    [ 4s ] thds: 4 tps: 1251.95 qps: 25047.95 (r/w/o: 17531.26/5012.79/2503.89) lat (ms,95%): 4.49 err/s: 0.00 reconn/s: 0.00
    [ 5s ] thds: 4 tps: 1234.03 qps: 24673.61 (r/w/o: 17272.43/4933.12/2468.06) lat (ms,95%): 4.82 err/s: 0.00 reconn/s: 0.00
    [ 6s ] thds: 4 tps: 1304.01 qps: 26076.25 (r/w/o: 18250.17/5218.05/2608.02) lat (ms,95%): 4.74 err/s: 0.00 reconn/s: 0.00
    [ 7s ] thds: 4 tps: 1281.01 qps: 25632.12 (r/w/o: 17944.08/5126.02/2562.01) lat (ms,95%): 4.57 err/s: 0.00 reconn/s: 0.00
    [ 8s ] thds: 4 tps: 1276.90 qps: 25529.99 (r/w/o: 17874.59/5101.60/2553.80) lat (ms,95%): 5.00 err/s: 0.00 reconn/s: 0.00
    [ 9s ] thds: 4 tps: 1375.99 qps: 27494.86 (r/w/o: 19239.90/5503.97/2750.99) lat (ms,95%): 4.10 err/s: 0.00 reconn/s: 0.00
    [ 10s ] thds: 4 tps: 1323.84 qps: 26510.86 (r/w/o: 18566.80/5295.37/2648.69) lat (ms,95%): 4.49 err/s: 0.00 reconn/s: 0.00
    [ 11s ] thds: 4 tps: 1352.35 qps: 27025.98 (r/w/o: 18911.88/5409.40/2704.70) lat (ms,95%): 3.89 err/s: 0.00 reconn/s: 0.00
    [ 12s ] thds: 4 tps: 1303.85 qps: 26083.01 (r/w/o: 18259.90/5215.40/2607.70) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
    [ 13s ] thds: 4 tps: 1287.92 qps: 25763.39 (r/w/o: 18035.88/5151.68/2575.84) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
    [ 14s ] thds: 4 tps: 1336.15 qps: 26703.06 (r/w/o: 18686.14/5344.61/2672.31) lat (ms,95%): 3.82 err/s: 0.00 reconn/s: 0.00
    [ 15s ] thds: 4 tps: 1339.97 qps: 26811.40 (r/w/o: 18771.58/5359.88/2679.94) lat (ms,95%): 3.89 err/s: 0.00 reconn/s: 0.00
    [ 16s ] thds: 4 tps: 1377.99 qps: 27555.88 (r/w/o: 19287.92/5511.98/2755.99) lat (ms,95%): 3.68 err/s: 0.00 reconn/s: 0.00
    [ 17s ] thds: 4 tps: 1266.03 qps: 25334.60 (r/w/o: 17735.42/5067.12/2532.06) lat (ms,95%): 4.41 err/s: 0.00 reconn/s: 0.00
    [ 18s ] thds: 4 tps: 1212.65 qps: 24274.97 (r/w/o: 16994.08/4855.59/2425.30) lat (ms,95%): 5.09 err/s: 0.00 reconn/s: 0.00
    [ 19s ] thds: 4 tps: 1281.39 qps: 25599.88 (r/w/o: 17916.51/5120.58/2562.79) lat (ms,95%): 4.33 err/s: 0.00 reconn/s: 0.00
    [ 20s ] thds: 4 tps: 1244.29 qps: 24888.79 (r/w/o: 17426.05/4974.16/2488.58) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
    [ 21s ] thds: 4 tps: 1159.62 qps: 23191.45 (r/w/o: 16230.71/4641.49/2319.25) lat (ms,95%): 5.57 err/s: 0.00 reconn/s: 0.00
    [ 22s ] thds: 4 tps: 1215.91 qps: 24332.25 (r/w/o: 17035.78/4864.65/2431.83) lat (ms,95%): 5.09 err/s: 0.00 reconn/s: 0.00
    [ 23s ] thds: 4 tps: 1321.79 qps: 26416.73 (r/w/o: 18488.01/5285.15/2643.57) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
    [ 24s ] thds: 4 tps: 1299.99 qps: 26003.75 (r/w/o: 18206.82/5197.95/2598.97) lat (ms,95%): 4.25 err/s: 0.00 reconn/s: 0.00
    [ 25s ] thds: 4 tps: 1243.29 qps: 24884.90 (r/w/o: 17417.13/4980.18/2487.59) lat (ms,95%): 5.00 err/s: 0.00 reconn/s: 0.00
    [ 26s ] thds: 4 tps: 1323.48 qps: 26460.64 (r/w/o: 18526.74/5286.93/2646.96) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
    [ 27s ] thds: 4 tps: 1213.52 qps: 24273.49 (r/w/o: 16983.34/4862.10/2428.05) lat (ms,95%): 4.91 err/s: 0.00 reconn/s: 0.00
    [ 28s ] thds: 4 tps: 1322.95 qps: 26446.97 (r/w/o: 18518.28/5283.79/2644.90) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
    [ 29s ] thds: 4 tps: 1364.96 qps: 27319.22 (r/w/o: 19124.45/5464.84/2729.92) lat (ms,95%): 3.89 err/s: 0.00 reconn/s: 0.00
    [ 30s ] thds: 4 tps: 1369.15 qps: 27370.96 (r/w/o: 19157.08/5476.59/2737.30) lat (ms,95%): 4.25 err/s: 0.00 reconn/s: 0.00
    SQL statistics:
        queries performed:
            read:                            532686
            write:                           152196
            other:                           76098
            total:                           760980
        transactions:                        38049  (1267.88 per sec.)
        queries:                             760980 (25357.60 per sec.)
        ignored errors:                      0      (0.00 per sec.)
        reconnects:                          0      (0.00 per sec.)
    
    General statistics:
        total time:                          30.0084s
        total number of events:              38049
    
    Latency (ms):
             min:                                    1.93
             avg:                                    3.15
             max:                                   48.66
             95th percentile:                        4.74
             sum:                               119915.33
    
    Threads fairness:
        events (avg/stddev):           9512.2500/192.05
        execution time (avg/stddev):   29.9788/0.00
    

    Code (Text):
    sysbench mysql OLTP new summary:
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql run
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    read: 532686
    write: 152196
    other: 76098
    total: 760980
    transactions/s: 1267.88
    queries/s: 25357.60
    time: 30.0084s
    min: 1.93
    avg: 3.15
    max: 48.66
    95th: 4.74
    
    | mysql sysbench | sysbench | threads: | read: | write: | other: | total: | transactions/s: | queries/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | oltp_read_write.lua | 1.0.14 | 4 | 532686 | 152196 | 76098 | 760980 | 1267.88 | 25357.60 | 30.0084s | 1.93 | 3.15 | 48.66 | 4.74 |
    
    sysbench,sysbench,threads,read,write,other,total,transactions/s,queries/s,time,min,avg,max,95th
    oltp_read_write.lua,1.0.14,4,532686,152196,76098,760980,1267.88,25357.60,30.0084s,1.93,3.15,48.66,4.74
    

    Code (Text):
    sysbench mysql cleanup database: sbt
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql cleanup
    sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)
    
    Dropping table 'sbtest1'...
    Dropping table 'sbtest2'...
    Dropping table 'sbtest3'...
    Dropping table 'sbtest4'...
    Dropping table 'sbtest5'...
    Dropping table 'sbtest6'...
    Dropping table 'sbtest7'...
    Dropping table 'sbtest8'...
    


     
  6. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x

    Centminmodbench.sh Benchmarks



    All new VPS/Dedicated servers I get, I will run my centminmodbench.sh benchmark script at bench.centminmod.com to fully evaluate the performance of the server. The results are below:
    • Bandwidth wise ssdnodes's Dallas KVM VPS uses 10Gbps network, so it shows in below single threaded wget and multi-threaded Axel download bandwidth tests with Vultr Dallas test reporting 227MB/s and 300MB/s respectively.
    • Crytographic performance core for core is very good on Intel Xeon Gold Scalable processor with AES-NI hardware assisted AES128/AES256 even beating out 4 cpu OpenSSL benchmark test against my Intel Core i7 4790K Haswell cpu clocked at 4.0Ghz.
    • FFIO disk benchmarks report 94625 random reads and 40608 random write IOPs and 369MB/s random reads and 164MB/s random writes.

    Code (Text):
    -------------------------------------------
    centminmodbench.sh 0.9.7
    http://bench.centminmod.com
    written by: George Liu (eva2000)
    http://centminmod.com
    -------------------------------------------
    
    -------------------------------------------
    System Information
    -------------------------------------------
    
    3.10.0-693.17.1.el7.x86_64
    
    CentOS Linux release 7.5.1804 (Core)
    
    Centmin Mod
    ----------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 94
    Model name:            Intel Core Processor (Skylake, IBRS)
    Stepping:              3
    CPU MHz:               2099.998
    BogoMIPS:              4199.99
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    
    CPU Flags
     fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    
    ----------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
    0   0    0      0    0:0:0      yes
    1   0    0      1    1:1:1      yes
    2   0    0      2    2:2:2      yes
    3   0    0      3    3:3:3      yes
    
    ----------------------------------------------
                  total        used        free      shared  buff/cache   available
    Mem:          15886        1494       13176          30        1215       14033
    Low:          15886        2710       13176
    High:             0           0           0
    Swap:          1023           0        1023
    
    ----------------------------------------------
    Filesystem                       Size  Used Avail Use% Mounted on
    /dev/mapper/centos_centos7-root   78G  6.4G   68G   9% /
    devtmpfs                         7.8G     0  7.8G   0% /dev
    tmpfs                            7.8G     0  7.8G   0% /dev/shm
    tmpfs                            7.8G   17M  7.8G   1% /run
    tmpfs                            7.8G     0  7.8G   0% /sys/fs/cgroup
    /dev/sda1                       1014M  264M  751M  26% /boot
    tmpfs                            1.6G     0  1.6G   0% /run/user/0
    tmpfs                            7.8G  324K  7.8G   1% /tmp
    
    

    Code (Text):
    -------------------------------------------
    disk ioping tests
    -------------------------------------------
    
    
    Running IOPing I/O benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=1 time=115 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=2 time=386 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=3 time=394 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=4 time=385 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=5 time=473 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=6 time=321 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=7 time=379 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=8 time=392 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=9 time=495 us
    4.0 KiB from . (ext4 /dev/mapper/centos_centos7-root): request=10 time=320 us
    
    --- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
    10 requests completed in 9.0 s, 2.7 k iops, 10.7 MiB/s
    min/avg/max/mdev = 115 us / 366 us / 495 us / 98 us
    
    IOPing seek rate: ./ioping -RD .
    
    --- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
    31.1 k requests completed in 3.0 s, 10.5 k iops, 41.1 MiB/s
    min/avg/max/mdev = 68 us / 95 us / 4.8 ms / 35 us
    
    IOPing sequential: ./ioping -RL .
    
    --- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
    9.3 k requests completed in 3.0 s, 3.4 k iops, 839.0 MiB/s
    min/avg/max/mdev = 206 us / 297 us / 9.5 ms / 177 us
    
    IOPing cached: ./ioping -RC .
    
    --- . (ext4 /dev/mapper/centos_centos7-root) ioping statistics ---
    1.7 M requests completed in 3.0 s, 589.9 k iops, 2.3 GiB/s
    min/avg/max/mdev = 0 us / 1 us / 138 us / 0 us
    
    

    Code (Text):
    -------------------------------------------
    disk DD tests
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 1.28657 s, 835 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 1.32992 s, 807 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 1.86451 s, 576 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 8.47124 s, 127 MB/s
    

    Code (Text):
    -------------------------------------------
    disk FIO tests
    -------------------------------------------
    
    
    Running FIO benchmark...
    
    FIO_VERSION = fio-2.0.9
    
    FIO random reads:
    randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    randomreads: Laying out IO file(s) (1 file(s) / 1024MB)
    
    randomreads: (groupid=0, jobs=1): err= 0: pid=19116: Tue May 29 22:38:03 2018
      read : io=1024.3MB, bw=378502KB/s, iops=94625 , runt=  2771msec
      cpu          : usr=7.65%, sys=72.46%, ctx=5507, majf=0, minf=85
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
       READ: io=1024.3MB, aggrb=378501KB/s, minb=378501KB/s, maxb=378501KB/s, mint=2771msec, maxt=2771msec
    
    Disk stats (read/write):
        dm-0: ios=253819/229, merge=0/0, ticks=123219/411, in_queue=123633, util=96.48%, aggrios=262207/52, aggrmerge=0/177, aggrticks=127683/74, aggrin_queue=127710, aggrutil=96.02%
      sda: ios=262207/52, merge=0/177, ticks=127683/74, in_queue=127710, util=96.02%
    
    FIO random writes:
    randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    
    randomwrites: (groupid=0, jobs=1): err= 0: pid=19120: Tue May 29 22:38:09 2018
      write: io=1024.3MB, bw=162433KB/s, iops=40608 , runt=  6457msec
      cpu          : usr=4.29%, sys=27.99%, ctx=14326, majf=0, minf=20
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
      WRITE: io=1024.3MB, aggrb=162432KB/s, minb=162432KB/s, maxb=162432KB/s, mint=6457msec, maxt=6457msec
    
    Disk stats (read/write):
        dm-0: ios=0/260581, merge=0/0, ticks=0/381573, in_queue=381638, util=98.60%, aggrios=0/262211, aggrmerge=0/7, aggrticks=0/384531, aggrin_queue=384497, aggrutil=98.34%
      sda: ios=0/262211, merge=0/7, ticks=0/384531, in_queue=384497, util=98.34%
    
    

    Code (Text):
    -------------------------------------------
    ramdisk DD tests - memory bandwidth
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.0802074 s, 1.7 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.114051 s, 1.2 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.0798963 s, 1.7 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.110998 s, 1.2 GB/s
    

    Code (Text):
    -------------------------------------------
    ramdisk ioping tests - memory bandwidth
    -------------------------------------------
    
    
    Running IOPing I/O ramdisk benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4.0 KiB from . (tmpfs tmpfs): request=1 time=2 us
    4.0 KiB from . (tmpfs tmpfs): request=2 time=17 us
    4.0 KiB from . (tmpfs tmpfs): request=3 time=13 us
    4.0 KiB from . (tmpfs tmpfs): request=4 time=13 us
    4.0 KiB from . (tmpfs tmpfs): request=5 time=12 us
    4.0 KiB from . (tmpfs tmpfs): request=6 time=13 us
    4.0 KiB from . (tmpfs tmpfs): request=7 time=12 us
    4.0 KiB from . (tmpfs tmpfs): request=8 time=10 us
    4.0 KiB from . (tmpfs tmpfs): request=9 time=10 us
    4.0 KiB from . (tmpfs tmpfs): request=10 time=10 us
    
    --- . (tmpfs tmpfs) ioping statistics ---
    10 requests completed in 9.0 s, 89.3 k iops, 348.8 MiB/s
    min/avg/max/mdev = 2 us / 11 us / 17 us / 3 us
    
    IOPing seek rate: ./ioping -R .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    817.1 k requests completed in 3.0 s, 599.1 k iops, 2.3 GiB/s
    min/avg/max/mdev = 0 us / 1 us / 39 us / 0 us
    
    IOPing sequential: ./ioping -RL .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    33.8 k requests completed in 3.0 s, 18.2 k iops, 4.4 GiB/s
    min/avg/max/mdev = 40 us / 55 us / 138 us / 6 us
    
    IOPing cached: ./ioping -RC .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    1.4 M requests completed in 3.0 s, 508.7 k iops, 1.9 GiB/s
    min/avg/max/mdev = 0 us / 1 us / 655 us / 1 us
    
    

    Code (Text):
    -------------------------------------------
    Running bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Download Cachefly: 131MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Download Linode, Atlanta, GA, USA: 121MB/s
    ----------------------------------------------
    Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Download Linode, Dallas, TX, USA: 158MB/s
    ----------------------------------------------
    Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Download Leaseweb, Manassas, VA, USA: 56.7MB/s
    ----------------------------------------------
    Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Seattle, WA, USA: 42.0MB/s
    ----------------------------------------------
    Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, San Jose, CA, USA: 40.9MB/s
    ----------------------------------------------
    Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Washington, DC, USA: 42.6MB/s
    ----------------------------------------------
    Download from VersaWeb, Las Vegas, Nevada (http://lg.las1.as53340.net/100MB.test)
    Download VersaWeb, Las Vegas, Nevada: 10.6MB/s
    ----------------------------------------------
    Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Download OVH, BHS, Canada: 16.0MB/s
    ----------------------------------------------
    Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Los Angeles, California: 78.3MB/s
    ----------------------------------------------
    Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Seattle, Washington: 50.3MB/s
    ----------------------------------------------
    Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Dallas, Texas: 227MB/s
    ----------------------------------------------
    Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Chicago, Illinois: 86.0MB/s
    ----------------------------------------------
    Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Atlanta, Georgia: 129MB/s
    ----------------------------------------------
    Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Miami, Florida: 78.5MB/s
    ----------------------------------------------
    Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, New York / New Jersey: 57.8MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Download Linode, Tokyo, JP: 19.5MB/s
    ----------------------------------------------
    Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Singapore: 11.0MB/s
    ----------------------------------------------
    Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Tokyo, Japan: 16.6MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Download Linode, London, UK: 18.9MB/s
    ----------------------------------------------
    Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Download OVH, Paris, France: 15.5MB/s
    ----------------------------------------------
    Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Download SmartDC, Rotterdam, Netherlands: 8.54MB/s
    ----------------------------------------------
    Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Amsterdam, Netherlands: 19.4MB/s
    ----------------------------------------------
    Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, London, UK: 20.4MB/s
    ----------------------------------------------
    Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Paris, France: 20.1MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Sydney, Australia: 11.8MB/s
    

    Code (Text):
    -------------------------------------------
    Running Axel multi-threaded bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Axel Download Cachefly: 196.07MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Axel Download Linode, Atlanta, GA, USA: 73.74MB/s
    ----------------------------------------------
    Axel Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Axel Download Linode, Dallas, TX, USA: 189.70MB/s
    ----------------------------------------------
    Axel Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Axel Download Leaseweb, Manassas, VA, USA: 93.61MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Seattle, WA, USA: 40.08MB/s
    ----------------------------------------------
    Axel Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, San Jose, CA, USA: 39.24MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Washington, DC, USA: 20.08MB/s
    ----------------------------------------------
    Axel Download from VersaWeb, Las Vegas, Nevada (http://lg.las1.as53340.net/100MB.test)
    Axel Download VersaWeb, Las Vegas, Nevada: 32.66MB/s
    ----------------------------------------------
    Axel Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, BHS, Canada: 31.86MB/s
    ----------------------------------------------
    Axel Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Los Angeles, California: 103.38MB/s
    ----------------------------------------------
    Axel Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Seattle, Washington: 64.46MB/s
    ----------------------------------------------
    Axel Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Dallas, Texas: 300.59MB/s
    ----------------------------------------------
    Axel Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Chicago, Illinois: 142.36MB/s
    ----------------------------------------------
    Axel Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Atlanta, Georgia: 131.72MB/s
    ----------------------------------------------
    Axel Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Miami, Florida: 91.56MB/s
    ----------------------------------------------
    Axel Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, New York / New Jersey: 77.20MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Axel Download Linode, Tokyo, JP: 25.89MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Singapore: 9.18MB/s
    ----------------------------------------------
    Axel Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Tokyo, Japan: 27.31MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Axel Download Linode, London, UK: 29.93MB/s
    ----------------------------------------------
    Axel Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, Paris, France: 24.54MB/s
    ----------------------------------------------
    Axel Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Axel Download SmartDC, Rotterdam, Netherlands: 9.31MB/s
    ----------------------------------------------
    Axel Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Amsterdam, Netherlands: 26.01MB/s
    ----------------------------------------------
    Axel Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, London, UK: 31.38MB/s
    ----------------------------------------------
    Axel Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Paris, France: 29.49MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Sydney, Australia: 15.91MB/s
    

    Code (Text):
    -------------------------------------------
    Running ping tests...
    -------------------------------------------
    
    ----------------------------------------------
    Pings (cachefly.cachefly.net):
    PING vip1.g5.cachefly.net (205.234.175.175) 56(84) bytes of data.
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=1 ttl=58 time=0.407 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=2 ttl=58 time=0.470 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=3 ttl=58 time=0.679 ms
    
    --- vip1.g5.cachefly.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 0.407/0.518/0.679/0.119 ms
    
    ----------------------------------------------
    Pings (syd-au-ping.vultr.com):
    PING syd-au-ping.vultr.com (108.61.212.117) 56(84) bytes of data.
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=1 ttl=51 time=197 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=2 ttl=51 time=197 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=3 ttl=51 time=197 ms
    
    --- syd-au-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 197.334/197.441/197.631/0.386 ms
    
    ----------------------------------------------
    Pings (hnd-jp-ping.vultr.com):
    PING hnd-jp-ping.vultr.com (108.61.201.151) 56(84) bytes of data.
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=1 ttl=49 time=145 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=2 ttl=49 time=145 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=3 ttl=49 time=145 ms
    
    --- hnd-jp-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 145.630/145.671/145.700/0.441 ms
    
    ----------------------------------------------
    Pings (lax-ca-us-ping.vultr.com):
    PING lax-ca-us-ping.vultr.com (108.61.219.200) 56(84) bytes of data.
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=1 ttl=54 time=29.5 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=2 ttl=54 time=29.7 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=3 ttl=54 time=29.7 ms
    
    --- lax-ca-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 29.526/29.690/29.786/0.116 ms
    
    ----------------------------------------------
    Pings (wa-us-ping.vultr.com):
    PING wa-us-ping.vultr.com (108.61.194.105) 56(84) bytes of data.
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=1 ttl=56 time=45.7 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=2 ttl=56 time=45.8 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=3 ttl=56 time=46.0 ms
    
    --- wa-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 45.793/45.879/46.032/0.108 ms
    
    ----------------------------------------------
    Pings (tx-us-ping.vultr.com):
    PING tx-us-ping.vultr.com (108.61.224.175) 56(84) bytes of data.
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=1 ttl=55 time=0.662 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=2 ttl=55 time=1.06 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=3 ttl=55 time=0.807 ms
    
    --- tx-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2000ms
    rtt min/avg/max/mdev = 0.662/0.843/1.062/0.168 ms
    
    ----------------------------------------------
    Pings (il-us-ping.vultr.com):
    PING il-us-ping.vultr.com (107.191.51.12) 56(84) bytes of data.
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=1 ttl=55 time=26.9 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=2 ttl=55 time=27.0 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=3 ttl=55 time=27.0 ms
    
    --- il-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 26.954/26.994/27.020/0.028 ms
    
    ----------------------------------------------
    Pings (ga-us-ping.vultr.com):
    PING ga-us-ping.vultr.com (108.61.193.166) 56(84) bytes of data.
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=1 ttl=54 time=18.6 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=2 ttl=54 time=18.7 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=3 ttl=54 time=18.6 ms
    
    --- ga-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 18.612/18.680/18.744/0.053 ms
    
    ----------------------------------------------
    Pings (fl-us-ping.vultr.com):
    PING fl-us-ping.vultr.com (104.156.244.232) 56(84) bytes of data.
    64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=1 ttl=54 time=33.5 ms
    64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=2 ttl=54 time=33.5 ms
    64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=3 ttl=54 time=33.7 ms
    
    --- fl-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 33.533/33.602/33.735/0.176 ms
    
    ----------------------------------------------
    Pings (nj-us-ping.vultr.com):
    PING nj-us-ping.vultr.com (108.61.149.182) 56(84) bytes of data.
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=1 ttl=54 time=46.3 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=2 ttl=54 time=46.4 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=3 ttl=54 time=46.5 ms
    
    --- nj-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 46.397/46.458/46.542/0.186 ms
    
    ----------------------------------------------
    Pings (fra-de-ping.vultr.com):
    PING fra-de-ping.vultr.com (108.61.210.117) 56(84) bytes of data.
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=1 ttl=52 time=130 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=2 ttl=52 time=130 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=3 ttl=52 time=130 ms
    
    --- fra-de-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 130.619/130.677/130.710/0.298 ms
    
    ----------------------------------------------
    Pings (ams-nl-ping.vultr.com):
    PING ams-nl-ping.vultr.com (108.61.198.102) 56(84) bytes of data.
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=1 ttl=51 time=123 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=2 ttl=51 time=123 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=3 ttl=51 time=123 ms
    
    --- ams-nl-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 123.408/123.482/123.520/0.052 ms
    
    ----------------------------------------------
    Pings (lon-gb-ping.vultr.com):
    PING lon-gb-ping.vultr.com (108.61.196.101) 56(84) bytes of data.
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=1 ttl=52 time=107 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=2 ttl=52 time=107 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=3 ttl=52 time=107 ms
    
    --- lon-gb-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 107.330/107.405/107.498/0.384 ms
    
    ----------------------------------------------
    Pings (par-fr-ping.vultr.com):
    PING par-fr-ping.vultr.com (108.61.209.127) 56(84) bytes of data.
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=1 ttl=52 time=109 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=2 ttl=52 time=109 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=3 ttl=52 time=109 ms
    
    --- par-fr-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 109.225/109.360/109.560/0.408 ms
    
    ----------------------------------------------
    Pings (VersaWeb Las Vegas):
    PING 104.143.15.254 (104.143.15.254) 56(84) bytes of data.
    From 192.228.109.50 icmp_seq=1 Time to live exceeded
    From 192.228.109.50 icmp_seq=2 Time to live exceeded
    From 192.228.109.50 icmp_seq=3 Time to live exceeded
    
    --- 104.143.15.254 ping statistics ---
    3 packets transmitted, 0 received, +3 errors, 100% packet loss, time 2002ms
    
    
    ----------------------------------------------
    Pings (VersaWeb Seattle):
    PING 76.164.234.1 (76.164.234.1) 56(84) bytes of data.
    64 bytes from 76.164.234.1: icmp_seq=1 ttl=54 time=54.9 ms
    64 bytes from 76.164.234.1: icmp_seq=2 ttl=54 time=55.0 ms
    64 bytes from 76.164.234.1: icmp_seq=3 ttl=54 time=54.9 ms
    
    --- 76.164.234.1 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 54.960/55.008/55.089/0.057 ms
    
    ----------------------------------------------
    Pings (OVH Canada):
    PING bhs.proof.ovh.net (192.99.19.165) 56(84) bytes of data.
    64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=1 ttl=54 time=36.0 ms
    64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=2 ttl=54 time=36.0 ms
    64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=3 ttl=54 time=36.0 ms
    
    --- bhs.proof.ovh.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 36.029/36.063/36.084/0.156 ms
    
    ----------------------------------------------
    Pings (10gbps.io Frankfurt):
    PING 195.181.174.20 (195.181.174.20) 56(84) bytes of data.
    64 bytes from 195.181.174.20: icmp_seq=1 ttl=57 time=122 ms
    64 bytes from 195.181.174.20: icmp_seq=2 ttl=57 time=122 ms
    64 bytes from 195.181.174.20: icmp_seq=3 ttl=57 time=122 ms
    
    --- 195.181.174.20 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 122.802/122.806/122.811/0.003 ms
    
    ----------------------------------------------
    Pings (10gbps.io London):
    PING 185.59.221.20 (185.59.221.20) 56(84) bytes of data.
    64 bytes from 185.59.221.20: icmp_seq=1 ttl=51 time=107 ms
    64 bytes from 185.59.221.20: icmp_seq=2 ttl=51 time=107 ms
    64 bytes from 185.59.221.20: icmp_seq=3 ttl=51 time=107 ms
    
    --- 185.59.221.20 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 107.713/107.718/107.722/0.003 ms
    
    ----------------------------------------------
    Pings (10gbps.io Paris):
    PING 185.93.2.193 (185.93.2.193) 56(84) bytes of data.
    64 bytes from 185.93.2.193: icmp_seq=1 ttl=51 time=130 ms
    64 bytes from 185.93.2.193: icmp_seq=2 ttl=51 time=130 ms
    64 bytes from 185.93.2.193: icmp_seq=3 ttl=51 time=130 ms
    
    --- 185.93.2.193 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 130.198/130.263/130.336/0.420 ms
    
    ----------------------------------------------
    Pings (10gbps.io Singapore):
    PING 203.174.85.38 (203.174.85.38) 56(84) bytes of data.
    64 bytes from 203.174.85.38: icmp_seq=1 ttl=54 time=206 ms
    64 bytes from 203.174.85.38: icmp_seq=2 ttl=54 time=206 ms
    64 bytes from 203.174.85.38: icmp_seq=3 ttl=54 time=206 ms
    
    --- 203.174.85.38 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 206.487/206.518/206.559/0.372 ms
    
    ----------------------------------------------
    Pings (10gbps.io Stockholm):
    PING 185.76.9.10 (185.76.9.10) 56(84) bytes of data.
    64 bytes from 185.76.9.10: icmp_seq=1 ttl=54 time=144 ms
    64 bytes from 185.76.9.10: icmp_seq=2 ttl=54 time=144 ms
    64 bytes from 185.76.9.10: icmp_seq=3 ttl=54 time=144 ms
    
    --- 185.76.9.10 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 144.432/144.535/144.609/0.445 ms
    
    ----------------------------------------------
    Pings (10gbps.io Moscow):
    PING 87.245.204.20 (87.245.204.20) 56(84) bytes of data.
    64 bytes from 87.245.204.20: icmp_seq=1 ttl=56 time=161 ms
    64 bytes from 87.245.204.20: icmp_seq=2 ttl=56 time=161 ms
    64 bytes from 87.245.204.20: icmp_seq=3 ttl=56 time=161 ms
    
    --- 87.245.204.20 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 161.127/161.154/161.183/0.464 ms
    
    ----------------------------------------------
    Pings (10gbps.io Miami):
    PING 195.181.162.195 (195.181.162.195) 56(84) bytes of data.
    64 bytes from 195.181.162.195: icmp_seq=1 ttl=56 time=30.9 ms
    64 bytes from 195.181.162.195: icmp_seq=2 ttl=56 time=30.9 ms
    64 bytes from 195.181.162.195: icmp_seq=3 ttl=56 time=30.8 ms
    
    --- 195.181.162.195 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 30.858/30.913/30.968/0.044 ms
    
    

    Code (Text):
    -------------------------------------------
    Running mtr tests...
    -------------------------------------------
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 cachefly.cachefly.net
    Start: Tue May 29 22:42:31 2018
    HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                    0.0%    10    1.1   1.0   0.8   1.2   0.0
      2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                     0.0%    10    0.8   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                     0.0%    10    0.5   0.6   0.5   1.5   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.8   1.2   0.5   4.2   0.9
      6.|-- et-0-0-49.cr10-dal3.ip4.gtt.net  0.0%    10    0.6   1.7   0.5   6.7   2.0
      7.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      8.|-- vip1.G-anycast1.cachefly.net     0.0%    10    0.4   0.5   0.4   0.7   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.atlanta.linode.com
    Start: Tue May 29 22:42:47 2018
    HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.8   0.9   0.8   1.1   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                   0.0%    10    0.6   0.6   0.6   0.7   0.0
      4.|-- 144.168.32.1                   0.0%    10    0.5   1.6   0.5  11.6   3.4
      5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.6   0.7   0.5   1.3   0.0
      6.|-- xe-5-0-2.cr1-atl1.ip4.gtt.net  0.0%    10   18.5  18.5  18.4  18.7   0.0
      7.|-- ip4.gtt.net                    0.0%    10   18.9  19.0  18.9  19.1   0.0
      8.|-- 74.207.239.19                  0.0%    10   19.2  18.9  18.8  19.2   0.0
      9.|-- speedtest.atlanta.linode.com   0.0%    10   23.3  20.8  18.7  25.3   2.5
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.dallas.linode.com
    Start: Tue May 29 22:43:04 2018
    HOST: hostname         Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                0.0%    10    0.8   0.9   0.7   1.2   0.0
      2.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                 0.0%    10    0.7   0.7   0.6   0.9   0.0
      4.|-- 144.168.32.1                 0.0%    10    0.6   0.6   0.5   0.6   0.0
      5.|-- eqix-ix-da.linode.com        0.0%    10    1.4   1.4   1.3   1.5   0.0
      6.|-- 45.79.12.3                   0.0%    10    1.4   1.6   1.4   1.9   0.0
      7.|-- speedtest.dallas.linode.com  0.0%    10    1.3   1.3   1.2   1.4   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 mirror.us.leaseweb.net
    Start: Tue May 29 22:43:22 2018
    HOST: hostname              Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                     0.0%    10    1.0   2.0   0.8  11.9   3.4
      2.|-- ???                              100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                      0.0%    10    0.7   0.8   0.6   1.7   0.0
      4.|-- 144.168.32.1                      0.0%    10    0.6   0.5   0.4   0.6   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net        0.0%    10    0.8   3.3   0.6  15.8   5.5
      6.|-- xe-3-1-3.cr0-was1.ip4.gtt.net     0.0%    10   36.6  36.7  36.2  37.5   0.0
      7.|-- ip4.gtt.net                       0.0%    10   34.1  34.4  34.1  34.6   0.0
      8.|-- po-1.ce01.wdc-01.us.leaseweb.net  0.0%    10   33.8  33.7  33.6  33.8   0.0
      9.|-- 207.244.94.80                     0.0%    10   33.8  33.7  33.6  33.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.sea01.softlayer.com
    Start: Tue May 29 22:43:39 2018
    HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    0.8   1.0   0.8   1.3   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                             0.0%    10    0.7   0.7   0.6   0.7   0.0
      4.|-- 144.168.32.1                             0.0%    10    0.6   0.6   0.5   0.7   0.0
      5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.6   0.7   0.6   1.2   0.0
      6.|-- ae5.cbs01.eq01.dal03.networklayer.com   80.0%    10    1.9   1.9   1.9   2.0   0.0
      7.|-- ae1.cbs01.cs01.den01.networklayer.com    0.0%    10   19.8  19.9  19.7  20.1   0.0
      8.|-- ae0.cbs01.wb01.sea02.networklayer.com    0.0%    10   45.4  45.7  45.3  47.3   0.5
      9.|-- 77.12.2da9.ip4.static.sl-reverse.com     0.0%    10   44.6  46.6  44.6  62.6   5.6
     10.|-- ae0.dar01.sr01.sea01.networklayer.com    0.0%    10   44.8  44.7  44.5  44.8   0.0
     11.|-- po1.fcr01.sr01.sea01.networklayer.com    0.0%    10   42.7  43.4  42.7  47.5   1.4
     12.|-- speedtest.sea01.softlayer.com            0.0%    10   44.6  44.7  44.6  44.9   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.sjc01.softlayer.com
    Start: Tue May 29 22:43:55 2018
    HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    0.9   0.9   0.7   1.1   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                             0.0%    10    0.7   0.8   0.6   1.7   0.0
      4.|-- 144.168.32.1                             0.0%    10    0.6   0.6   0.5   0.7   0.0
      5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.6   2.0   0.6  13.7   4.1
      6.|-- ae5.cbs01.eq01.dal03.networklayer.com   80.0%    10    1.5   1.5   1.5   1.6   0.0
      7.|-- ae8.cbs01.dr01.dal04.networklayer.com   90.0%    10    5.0   5.0   5.0   5.0   0.0
      8.|-- ae2.cbs01.cs01.lax01.networklayer.com   60.0%    10   30.7  30.6  30.3  30.9   0.0
      9.|-- ae7.cbs02.cs01.lax01.networklayer.com   60.0%    10   30.8  30.7  30.5  30.8   0.0
     10.|-- ae0.cbs02.eq01.sjc02.networklayer.com   60.0%    10   38.0  37.7  37.4  38.0   0.0
     11.|-- ae24.bbr01.eq01.sjc02.networklayer.com   0.0%    10   37.1  37.0  36.8  37.3   0.0
     12.|-- ae5.dar01.sjc01.networklayer.com         0.0%    10   39.2  39.1  38.8  40.2   0.3
     13.|-- po1.fcr01.sr01.sjc01.networklayer.com    0.0%    10   37.3  37.3  37.1  38.6   0.3
     14.|-- speedtest.sjc01.softlayer.com            0.0%    10   37.2  37.1  37.0  37.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.wdc01.softlayer.com
    Start: Tue May 29 22:44:11 2018
    HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    0.8   0.9   0.7   1.2   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                             0.0%    10    0.7   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                             0.0%    10    0.5   1.4   0.5   6.0   1.9
      5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.7   1.1   0.5   5.1   1.4
      6.|-- ae5.cbs02.eq01.dal03.networklayer.com   70.0%    10    1.5   1.5   1.5   1.5   0.0
      7.|-- ae0.cbs01.tl01.atl01.networklayer.com   40.0%    10   19.2  19.2  18.9  19.5   0.0
      8.|-- ae0.cbs01.eq01.wdc02.networklayer.com   30.0%    10   31.4  31.6  31.3  31.9   0.0
      9.|-- ae29.bbr02.eq01.wdc02.networklayer.com   0.0%    10   31.7  33.1  31.7  42.5   3.3
     10.|-- ae1.dar01.wdc01.networklayer.com         0.0%    10   31.2  31.4  31.0  32.4   0.3
     11.|-- po1.fcr01.sr01.wdc01.networklayer.com    0.0%    10   31.2  31.3  31.0  32.1   0.0
     12.|-- speedtest.wdc01.softlayer.com            0.0%    10   29.3  29.4  29.2  29.6   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.tokyo.linode.com
    Start: Tue May 29 22:44:27 2018
    HOST: hostname            Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                   0.0%    10    1.0   1.0   0.8   1.2   0.0
      2.|-- ???                            100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                    0.0%    10    0.6   0.7   0.6   0.9   0.0
      4.|-- 144.168.32.1                    0.0%    10    0.5   1.5   0.5  10.0   2.9
      5.|-- ae32.cr11-dal3.ip4.gtt.net      0.0%    10    0.6   1.0   0.5   1.7   0.0
      6.|-- et-0-0-67.cr4-lax2.ip4.gtt.net  0.0%    10   36.8  28.8  27.4  36.8   2.9
      7.|-- ip4.gtt.net                     0.0%    10   27.5  36.2  27.4  78.5  18.4
      8.|-- lacGCS001.int-gw.kddi.ne.jp     0.0%    10   27.6  28.5  27.5  37.4   3.0
      9.|-- 106.187.12.1                    0.0%    10  130.6 145.3 129.9 274.4  45.4
     10.|-- 27.85.134.162                   0.0%    10  139.9 140.0 139.7 141.1   0.0
     11.|-- cm-fcu204.kddnet.ad.jp          0.0%    10  134.1 134.3 130.2 140.5   4.1
     12.|-- 124.215.199.170                 0.0%    10  135.1 135.2 135.1 135.3   0.0
     13.|-- speedtest.tokyo.linode.com      0.0%    10  136.3 136.1 135.9 136.5   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.sng01.softlayer.com
    Start: Tue May 29 22:44:46 2018
    HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    0.8   1.1   0.8   2.1   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                             0.0%    10    0.6   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                             0.0%    10    0.5   0.7   0.4   2.6   0.6
      5.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.7   4.5   0.6  39.1  12.1
      6.|-- ae5.cbs01.eq01.dal03.networklayer.com   50.0%    10    1.7   2.2   1.5   3.0   0.5
      7.|-- ae8.cbs01.dr01.dal04.networklayer.com   70.0%    10    2.6   2.6   2.6   2.6   0.0
      8.|-- ae2.cbs01.cs01.lax01.networklayer.com   60.0%    10   30.3  30.3  30.2  30.4   0.0
      9.|-- ae7.cbs02.cs01.lax01.networklayer.com   90.0%    10   30.3  30.3  30.3  30.3   0.0
     10.|-- ae0.cbs02.eq01.sjc02.networklayer.com   50.0%    10   39.7  39.5  39.2  39.7   0.0
     11.|-- ae24.bbr02.eq01.sjc02.networklayer.com   0.0%    10   38.6  39.1  38.6  41.7   0.8
     12.|-- ae0.bbr01.eq01.tok01.networklayer.com    0.0%    10  137.6 138.2 137.6 140.4   0.7
     13.|-- ae5.cbs01.eq01.tok01.networklayer.com   60.0%    10  138.7 138.7 138.5 138.9   0.0
     14.|-- ae0.cbs01.eq01.sng02.networklayer.com   22.2%     9  207.4 207.5 207.3 207.7   0.0
     15.|-- ad.13.2da9.ip4.static.sl-reverse.com     0.0%     9  217.4 219.2 217.2 233.6   5.4
     16.|-- ae5.dar01.sng01.networklayer.com         0.0%     9  216.1 217.5 216.1 227.1   3.6
     17.|-- po1.fcr01.sr03.sng01.networklayer.com    0.0%     9  211.4 227.1 211.2 304.8  30.1
     18.|-- speedtest.sng01.softlayer.com            0.0%     9  215.6 215.7 215.6 215.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.london.linode.com
    Start: Tue May 29 22:45:03 2018
    HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                    0.0%    10    0.9   1.0   0.9   1.1   0.0
      2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                     0.0%    10    0.7   0.7   0.6   0.9   0.0
      4.|-- 144.168.32.1                    10.0%    10    0.5   1.4   0.5   8.0   2.4
      5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.5   0.9   0.5   3.0   0.7
      6.|-- et-0-0-55.cr11-lon2.ip4.gtt.net  0.0%    10  119.1 119.9 118.7 126.9   2.4
      7.|-- ip4.gtt.net                      0.0%    10  119.9 120.5 119.8 122.2   0.6
      8.|-- 109.74.207.27                    0.0%    10  119.7 119.9 119.7 120.2   0.0
      9.|-- speedtest.london.linode.com      0.0%    10  119.5 119.7 119.5 119.9   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 mirror.i3d.net
    Start: Tue May 29 22:45:19 2018
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    0.8   0.9   0.8   1.1   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                         0.0%    10    0.7   0.7   0.6   0.9   0.0
      4.|-- 144.168.32.1                         0.0%    10    0.5   2.2   0.5  16.8   5.1
      5.|-- eqix-da1.misi3d.com                  0.0%    10    0.6   1.0   0.6   2.6   0.5
      6.|-- 10ge.iadr0-dfwr0.csva01.iad.i3d.net  0.0%    10   40.8  40.0  35.6  46.4   4.0
      7.|-- 10ge.lr0-iadr0.th-n.lhr.i3d.net      0.0%    10  107.5 107.9 107.3 110.8   1.0
      8.|-- 30ge.cr0-lr0.smartdc.rtm.i3d.net     0.0%    10  113.7 114.0 113.5 116.2   0.7
      9.|-- 100ge.br3-cr0.smartdc.rtm.i3d.net    0.0%    10  113.5 113.3 113.2 113.5   0.0
     10.|-- hosted-by.i3d.net                    0.0%    10  113.6 113.5 113.4 113.6   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 syd-au-ping.vultr.com
    Start: Tue May 29 22:45:36 2018
    HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    1.0   1.1   0.7   2.3   0.3
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                             0.0%    10    0.6   0.8   0.6   1.7   0.0
      4.|-- 144.168.32.1                             0.0%    10    0.5   3.2   0.5  27.0   8.4
      5.|-- eqix-da1.vocus.com                       0.0%    10   38.0  37.7  37.3  38.7   0.3
      6.|-- bundle-153.cor02.lax01.ca.vocus.net      0.0%    10  201.8 201.8 201.7 202.1   0.0
      7.|-- 100g-0-0-0-0.cor02.sjc01.ca.vocus.net    0.0%    10  192.7 193.1 192.5 197.0   1.2
      8.|-- 100g-0-0-0-0.cor01.sjc01.ca.vocus.net    0.0%    10  197.6 197.7 197.6 197.9   0.0
      9.|-- BE-200.cor02.syd04.nsw.VOCUS.net.au      0.0%    10  201.9 201.9 201.8 202.0   0.0
     10.|-- bundle-101.bdr01.syd03.nsw.vocus.net.au  0.0%    10  202.1 202.3 202.0 203.6   0.3
     11.|-- static-73.7.255.49.in-addr.VOCUS.net.au  0.0%    10  197.8 197.7 197.6 197.9   0.0
     12.|-- xe-1-0-1.gw102.sy3.ap.equinix.com        0.0%    10  197.5 200.6 197.5 226.6   9.1
     13.|-- 180.189.25.6                            10.0%    10  201.9 202.5 201.7 206.7   1.4
     14.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
     15.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
     16.|-- 108.61.212.117.vultr.com                 0.0%    10  197.5 197.5 197.4 197.7   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 hnd-jp-ping.vultr.com
    Start: Tue May 29 22:45:55 2018
    HOST: hostname                        Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                               0.0%    10    0.9   1.0   0.9   1.4   0.0
      2.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                                0.0%    10    0.7   0.7   0.6   0.7   0.0
      4.|-- 144.168.32.1                                0.0%    10    0.6   0.6   0.5   0.7   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net                  0.0%    10    1.1   2.4   0.5  11.7   3.3
      6.|-- as2914.cr11-dal3.ip4.gtt.net                0.0%    10    0.9   1.0   0.8   1.3   0.0
      7.|-- ae-1.r23.dllstx09.us.bb.gin.ntt.net         0.0%    10    8.8   2.3   0.8   8.8   2.7
      8.|-- ae-8.r23.snjsca04.us.bb.gin.ntt.net         0.0%    10   39.2  39.2  38.9  40.7   0.5
      9.|-- ae-21.r30.tokyjp05.jp.bb.gin.ntt.net       20.0%    10  145.8 145.5 145.3 145.8   0.0
     10.|-- ae-2.r02.tokyjp05.jp.bb.gin.ntt.net         0.0%    10  144.0 144.1 144.0 144.5   0.0
     11.|-- ce-0-14-0-1.r02.tokyjp05.jp.ce.gin.ntt.net  0.0%    10  146.5 148.8 146.3 160.5   4.6
     12.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
     13.|-- vl516-ds1-b5-r2605.tyo1.choopa.net          0.0%    10  146.8 146.8 146.7 146.9   0.0
     14.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
     15.|-- 108.61.201.151.vultr.com                    0.0%    10  146.0 145.8 145.7 146.1   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 lax-ca-us-ping.vultr.com
    Start: Tue May 29 22:46:13 2018
    HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.8   1.3   0.8   2.1   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                   0.0%    10    0.7   0.6   0.6   0.7   0.0
      4.|-- 144.168.32.1                   0.0%    10    0.5   0.7   0.5   1.6   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.9   3.0   0.5  12.8   5.0
      6.|-- et-8-3-0.cr2-lax2.ip4.gtt.net  0.0%    10   27.5  27.6  27.4  27.9   0.0
      7.|-- as20473-gw.lax20.ip4.gtt.net   0.0%    10   29.6  33.4  29.6  39.8   3.9
      8.|-- 10.68.1.162                    0.0%    10   33.4  35.9  32.8  47.6   5.3
      9.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- 108.61.219.200.vultr.com       0.0%    10   29.8  29.8  29.7  29.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 wa-us-ping.vultr.com
    Start: Tue May 29 22:46:29 2018
    HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.8   1.0   0.8   1.2   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                   0.0%    10    0.8   0.8   0.6   1.5   0.0
      4.|-- 144.168.32.1                   0.0%    10    0.6   1.4   0.5   8.5   2.4
      5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.8   3.9   0.5  16.1   5.2
      6.|-- xe-1-0-2.cr3-sea2.ip4.gtt.net  0.0%    10   45.9  45.9  45.8  46.2   0.0
      7.|-- choopa-gw.ip4.gtt.net          0.0%    10   46.1  46.0  45.9  46.1   0.0
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 108.61.194.105.vultr.com       0.0%    10   46.0  46.0  45.8  46.1   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 tx-us-ping.vultr.com
    Start: Tue May 29 22:46:47 2018
    HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.8   0.9   0.8   1.3   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                   0.0%    10    0.7   0.7   0.6   1.0   0.0
      4.|-- 144.168.32.1                   0.0%    10    0.6   0.6   0.5   1.0   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.6   1.8   0.5  11.9   3.5
      6.|-- xe-3-0-0.cr0-dal2.ip4.gtt.net  0.0%    10    0.7   1.1   0.7   3.4   0.7
      7.|-- ip4.gtt.net                   70.0%    10    0.7   2.3   0.7   5.4   2.5
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- 108.61.224.175.vultr.com       0.0%    10    0.7   0.8   0.7   1.1   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 il-us-ping.vultr.com
    Start: Tue May 29 22:47:03 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                       0.0%    10    0.9   1.0   0.8   1.8   0.0
      2.|-- ???                                100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                        0.0%    10    0.6   0.8   0.5   2.3   0.5
      4.|-- 144.168.32.1                        0.0%    10    0.5   2.1   0.5  16.4   5.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net          0.0%    10    1.6   0.9   0.5   1.6   0.0
      6.|-- xe-4-3-7.cr1-chi1.ip4.gtt.net       0.0%    10   26.1  26.4  26.1  28.4   0.5
      7.|-- ip4.gtt.net                         0.0%    10   28.7  28.8  28.1  29.5   0.0
      8.|-- vl820-ds1-b5-gj178.chi2.choopa.net  0.0%    10   27.8  27.9  27.5  30.4   0.7
      9.|-- ???                                100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- 107.191.51.12.vultr.com             0.0%    10   27.1  27.1  27.0  27.3   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 ga-us-ping.vultr.com
    Start: Tue May 29 22:47:21 2018
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    0.8   1.0   0.8   1.9   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                         0.0%    10    0.7   0.7   0.6   0.7   0.0
      4.|-- 144.168.32.1                         0.0%    10    0.6   0.5   0.5   0.6   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10    0.8   1.3   0.5   5.9   1.6
      6.|-- et-0-0-67.cr10-dal3.ip4.gtt.net      0.0%    10    0.7   1.7   0.6   8.1   2.4
      7.|-- dls-b21-link.telia.net               0.0%    10    0.9   2.8   0.6   9.9   3.4
      8.|-- atl-b22-link.telia.net               0.0%    10   18.8  28.8  18.8 107.3  27.6
      9.|-- atl-b21-link.telia.net               0.0%    10   18.6  18.6  18.6  18.7   0.0
     10.|-- vultr-ic-319646-atl-b21.c.telia.net  0.0%    10   19.0  18.8  18.6  19.0   0.0
     11.|-- 10.77.0.78                           0.0%    10   21.9  23.7  21.7  34.6   4.3
     12.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
     13.|-- 108.61.193.166.vultr.com             0.0%    10   18.7  18.8  18.6  19.1   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 fl-us-ping.vultr.com
    Start: Tue May 29 22:47:38 2018
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                 0.0%    10    1.0   1.1   0.8   2.1   0.0
      2.|-- ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                  0.0%    10    0.7   0.6   0.5   0.8   0.0
      4.|-- 144.168.32.1                  0.0%    10    0.5   0.7   0.5   2.1   0.3
      5.|-- ae32.cr11-dal3.ip4.gtt.net    0.0%    10    1.4   1.6   0.5   8.2   2.3
      6.|-- cr2-mia1.ip4.gtt.net          0.0%    10   29.6  30.0  29.5  32.9   0.8
      7.|-- as20473-gw.mia12.ip4.gtt.net  0.0%    10   31.9  30.6  30.3  31.9   0.5
      8.|-- 10.73.1.26                    0.0%    10   30.4  31.0  30.2  37.9   2.4
      9.|-- ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- 104.156.244.232               0.0%    10   33.7  33.7  33.6  33.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 nj-us-ping.vultr.com
    Start: Tue May 29 22:47:55 2018
    HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                    0.0%    10    1.0   0.9   0.8   1.2   0.0
      2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                     0.0%    10    0.7   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                     0.0%    10   12.2   1.7   0.5  12.2   3.7
      5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    2.4   5.5   0.5  12.6   4.1
      6.|-- xe-8-2-3.cr2-nyc6.ip4.gtt.net    0.0%    10   45.8  47.2  45.7  59.5   4.3
      7.|-- as20473-gw.nyc62.ip4.gtt.net     0.0%    10   48.3  48.2  47.0  51.3   1.5
      8.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- vl139-c4-3-b5-2.pnj1.choopa.net  0.0%    10   47.1  47.1  46.9  47.2   0.0
     10.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
     11.|-- 108.61.149.182.vultr.com         0.0%    10   40.6  43.0  40.5  46.7   3.1
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 fra-de-ping.vultr.com
    Start: Tue May 29 22:48:11 2018
    HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.8   0.8   0.7   1.0   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                   0.0%    10    1.1   0.8   0.7   1.1   0.0
      4.|-- 144.168.32.1                   0.0%    10    0.6   1.4   0.5   8.6   2.5
      5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.8   0.9   0.6   1.5   0.0
      6.|-- xe-8-2-0.cr1-fra2.ip4.gtt.net  0.0%    10  124.5 125.2 124.5 127.5   1.0
      7.|-- ip4.gtt.net                   80.0%    10  130.7 130.8 130.7 130.9   0.0
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 108.61.210.117.vultr.com       0.0%    10  130.8 130.8 130.7 131.0   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 ams-nl-ping.vultr.com
    Start: Tue May 29 22:48:28 2018
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    1.1   1.2   0.8   2.0   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                         0.0%    10    1.0   0.9   0.6   1.8   0.0
      4.|-- 144.168.32.1                         0.0%    10    0.5   0.6   0.5   1.1   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10   13.6   2.7   0.6  13.6   4.1
      6.|-- as2914.cr11-dal3.ip4.gtt.net         0.0%    10    0.9   1.0   0.7   1.2   0.0
      7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net  0.0%    10    1.3   1.1   0.6   3.3   0.6
      8.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  0.0%    10   37.6  37.7  37.5  38.4   0.0
      9.|-- ae-0.r23.asbnva02.us.bb.gin.ntt.net  0.0%    10   42.0  38.4  37.5  42.0   1.4
     10.|-- ae-2.r25.amstnl02.nl.bb.gin.ntt.net  0.0%    10  125.6 123.9 122.6 131.2   2.7
     11.|-- ae-1.a02.amstnl02.nl.bb.gin.ntt.net  0.0%    10  123.5 123.5 122.6 126.8   1.2
     12.|-- 81.20.72.122                        20.0%    10  123.7 124.5 123.5 129.0   1.8
     13.|-- vl10-ds1-b5-51917.ams1.choopa.net   50.0%    10  127.4 177.7 127.4 293.9  68.8
     14.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
     15.|-- 108.61.198.102.vultr.com             0.0%    10  123.6 124.2 123.5 129.4   1.8
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 lon-gb-ping.vultr.com
    Start: Tue May 29 22:48:45 2018
    HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                         0.0%    10    0.8   1.1   0.8   2.5   0.3
      2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                          0.0%    10    0.7   0.7   0.5   0.7   0.0
      4.|-- 144.168.32.1                          0.0%    10    0.6   2.4   0.5  18.8   5.7
      5.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    2.4   1.1   0.6   2.4   0.3
      6.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    1.1   0.9   0.7   1.3   0.0
      7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.0   1.3   0.8   2.8   0.5
      8.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net   0.0%    10   37.6  38.5  37.6  40.4   0.5
      9.|-- ae-5.r25.nycmny01.us.bb.gin.ntt.net   0.0%    10   41.5  41.0  40.2  45.4   1.5
     10.|-- ae-1.r24.nycmny01.us.bb.gin.ntt.net   0.0%    10   43.7  44.7  43.0  50.3   2.6
     11.|-- ae-9.r24.londen12.uk.bb.gin.ntt.net   0.0%    10  116.0 116.2 116.0 116.7   0.0
     12.|-- ae-21.r00.londen10.uk.bb.gin.ntt.net  0.0%    10  107.7 107.6 107.5 107.8   0.0
     13.|-- 5.158.213.46                          0.0%    10  111.8 110.3 108.0 115.1   2.4
     14.|-- 10.69.1.90                            0.0%    10  110.6 109.3 108.3 114.1   1.7
     15.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
     16.|-- 108.61.196.101.vultr.com              0.0%    10  107.8 107.6 107.4 107.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 par-fr-ping.vultr.com
    Start: Tue May 29 22:49:02 2018
    HOST: hostname              Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                     0.0%    10    1.7   1.0   0.8   1.7   0.0
      2.|-- ???                              100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                      0.0%    10    0.7   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                      0.0%    10    0.5   0.5   0.5   0.6   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net        0.0%    10    1.1   1.1   0.5   3.1   0.7
      6.|-- xe-5-1-5.cr0-par7.ip4.gtt.net     0.0%    10  118.0 118.0 117.9 118.1   0.0
      7.|-- ip4.gtt.net                       0.0%    10  113.6 113.7 113.6 114.3   0.0
      8.|-- 93-134-167-89.packetexchange.net  0.0%    10  112.8 112.8 112.4 114.1   0.0
      9.|-- ???                              100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- 108.61.209.127.vultr.com          0.0%    10  109.5 109.5 109.4 109.6   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 VersaWeb Las Vegas
    Start: Tue May 29 22:49:19 2018
    HOST: hostname                    Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                           0.0%    10    0.9   0.9   0.8   1.1   0.0
      2.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                            0.0%    10    0.6   0.6   0.6   0.7   0.0
      4.|-- 144.168.32.1                            0.0%    10    0.6   0.6   0.5   1.0   0.0
      5.|-- 10gigabitethernet3-1.core1.dal1.he.net  0.0%    10    0.6   0.6   0.5   0.7   0.0
      6.|-- 100ge4-2.core1.phx2.he.net              0.0%    10   24.0  23.5  19.4  29.1   3.7
      7.|-- 100ge11-2.core1.lax2.he.net             0.0%    10   28.2  31.3  28.2  38.7   3.8
      8.|-- 10ge4-3.core1.las1.he.net               0.0%    10   44.1  38.2  35.3  45.1   3.8
      9.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- 192.228.109.50                          0.0%    10   35.0  36.8  35.0  43.0   2.7
     11.|-- 192.228.109.49                          0.0%    10   35.2  37.6  35.1  44.3   3.8
     12.|-- 192.228.109.50                          0.0%    10   42.6  39.5  35.1  46.5   4.7
     13.|-- 192.228.109.49                          0.0%    10   39.2  37.7  35.0  44.0   3.5
     14.|-- 192.228.109.50                          0.0%    10   35.5  38.1  35.1  46.2   3.9
     15.|-- 192.228.109.49                          0.0%    10   35.2  36.4  35.1  43.3   2.6
     16.|-- 192.228.109.50                          0.0%    10   35.2  39.3  35.1  46.5   4.4
     17.|-- 192.228.109.49                          0.0%    10   35.1  37.3  35.0  43.5   3.2
     18.|-- 192.228.109.50                          0.0%    10   44.1  40.5  35.1  46.8   5.0
     19.|-- 192.228.109.49                          0.0%    10   38.6  37.4  35.0  43.3   3.1
     20.|-- 192.228.109.50                          0.0%    10   35.2  38.8  35.2  45.8   4.3
     21.|-- 192.228.109.49                          0.0%    10   35.3  36.2  35.1  42.5   2.4
     22.|-- 192.228.109.50                          0.0%    10   35.5  39.7  35.1  46.3   4.7
     23.|-- 192.228.109.49                          0.0%    10   35.4  37.0  35.2  42.7   3.0
     24.|-- 192.228.109.50                          0.0%    10   41.7  39.8  35.1  46.0   4.5
     25.|-- 192.228.109.49                          0.0%    10   37.8  38.3  35.2  45.9   3.8
     26.|-- 192.228.109.50                          0.0%    10   35.3  38.4  35.2  46.8   4.7
     27.|-- 192.228.109.49                          0.0%    10   45.8  38.2  35.2  45.9   4.4
     28.|-- 192.228.109.50                          0.0%    10   35.4  39.5  35.2  48.5   4.8
     29.|-- 192.228.109.49                          0.0%    10   35.2  37.5  35.2  46.3   3.7
     30.|-- 192.228.109.50                          0.0%    10   40.8  39.4  35.2  45.2   4.2
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 VersaWeb Seattle
    Start: Tue May 29 22:49:39 2018
    HOST: hostname                   Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                          0.0%    10    1.1   1.0   0.8   1.2   0.0
      2.|-- ???                                   100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                           0.0%    10    0.6   0.6   0.6   0.8   0.0
      4.|-- 144.168.32.1                           0.0%    10    0.7   0.6   0.5   0.7   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net             0.0%    10    0.8   1.8   0.5  11.6   3.4
      6.|-- et-0-0-71.cr10-dal3.ip4.gtt.net        0.0%    10    0.5   2.2   0.5  10.7   3.3
      7.|-- be3045.ccr41.dfw03.atlas.cogentco.com  0.0%    10    1.3   1.0   0.7   1.3   0.0
      8.|-- be2764.ccr32.dfw01.atlas.cogentco.com  0.0%    10    1.3   1.2   1.0   1.3   0.0
      9.|-- be2433.ccr22.mci01.atlas.cogentco.com  0.0%    10   10.9  11.1  10.8  11.4   0.0
     10.|-- be3036.ccr22.den01.atlas.cogentco.com  0.0%    10   22.3  22.4  22.0  22.6   0.0
     11.|-- be3038.ccr21.slc01.atlas.cogentco.com  0.0%    10   32.4  32.4  32.3  32.6   0.0
     12.|-- be2085.ccr21.sea02.atlas.cogentco.com  0.0%    10   56.4  55.6  55.3  56.4   0.0
     13.|-- 38.142.48.250                          0.0%    10   55.5  55.1  54.9  55.5   0.0
     14.|-- 76.164.234.1                           0.0%    10   55.1  55.1  55.0  55.3   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 OVH Canada
    Start: Tue May 29 22:49:56 2018
    HOST: hostname         Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                0.0%    10    1.4   1.3   0.8   2.4   0.5
      2.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                 0.0%    10    0.8   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                 0.0%    10    0.5   1.3   0.5   6.5   1.7
      5.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      6.|-- be100-1241.chi-5-a9.il.us    0.0%    10   20.5  20.4  20.2  20.6   0.0
      7.|-- be100-1324.bhs-g2-nc5.qc.ca 10.0%    10   36.8  68.7  36.8 173.0  51.0
      8.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
     11.|-- bhs.proof.ovh.net            0.0%    10   36.1  36.2  36.1  36.3   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Frankfurt:
    Start: Tue May 29 22:50:12 2018
    HOST: hostname                             Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                                    0.0%    10    1.1   1.2   0.7   3.3   0.5
      2.|-- ???                                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                                     0.0%    10    0.7   0.7   0.6   0.9   0.0
      4.|-- 144.168.32.1                                     0.0%    10    0.5   3.9   0.5  30.8   9.5
      5.|-- ae32.cr11-dal3.ip4.gtt.net                       0.0%    10    1.1   7.4   0.5  26.6   8.5
      6.|-- et-0-0-71.cr10-dal3.ip4.gtt.net                  0.0%    10    0.6   3.8   0.5  23.1   7.1
      7.|-- be3045.ccr41.dfw03.atlas.cogentco.com            0.0%    10    1.0   1.0   0.8   1.3   0.0
      8.|-- be2763.ccr31.dfw01.atlas.cogentco.com            0.0%    10    0.9   1.2   0.9   1.5   0.0
      9.|-- be2432.ccr21.mci01.atlas.cogentco.com            0.0%    10   11.5  11.3  11.0  12.3   0.0
     10.|-- be2831.ccr41.ord01.atlas.cogentco.com            0.0%    10   23.2  23.4  23.1  23.7   0.0
     11.|-- be2717.ccr21.cle04.atlas.cogentco.com            0.0%    10   39.3  39.3  39.1  39.6   0.0
     12.|-- be2993.ccr31.yyz02.atlas.cogentco.com            0.0%    10   39.3  39.2  39.0  39.6   0.0
     13.|-- be3259.ccr21.ymq01.atlas.cogentco.com            0.0%    10   46.6  46.6  46.4  46.7   0.0
     14.|-- be3042.ccr21.lpl01.atlas.cogentco.com            0.0%    10  112.9 113.1 112.8 114.8   0.5
     15.|-- be2182.ccr41.ams03.atlas.cogentco.com            0.0%    10  118.4 118.5 118.3 119.2   0.0
     16.|-- be2813.ccr41.fra03.atlas.cogentco.com            0.0%    10  125.9 126.2 125.9 126.4   0.0
     17.|-- be2501.rcr21.b015749-1.fra03.atlas.cogentco.com  0.0%    10  129.7 129.6 129.5 129.7   0.0
     18.|-- 149.14.157.122                                   0.0%    10  123.0 123.0 122.9 123.1   0.0
     19.|-- frankfurt-20.cdn77.com                           0.0%    10  122.9 123.0 122.9 123.1   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io London:
    Start: Tue May 29 22:50:30 2018
    HOST: hostname           Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    4.5   1.5   0.7   4.5   1.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                   0.0%    10    0.6   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                   0.0%    10   16.6   2.2   0.5  16.6   5.1
      5.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    2.4   0.9   0.5   2.4   0.5
      6.|-- xe-2-3-7.cr1-lon1.ip4.gtt.net  0.0%    10  111.3 113.2 110.6 133.8   7.2
      7.|-- ip4.gtt.net                    0.0%    10  109.1 109.0 108.8 109.1   0.0
      8.|-- london-20.cdn77.com            0.0%    10  107.9 126.5 107.8 294.1  58.9
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Paris:
    Start: Tue May 29 22:50:47 2018
    HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                         0.0%    10    1.0   0.8   0.7   1.0   0.0
      2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                          0.0%    10    0.6   0.7   0.6   0.9   0.0
      4.|-- 144.168.32.1                          0.0%    10    0.5   0.5   0.5   0.6   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    0.6   1.6   0.5   6.8   2.0
      6.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    0.8   0.9   0.8   1.2   0.0
      7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.0   0.9   0.7   1.3   0.0
      8.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  20.0%    10   42.4  38.3  37.6  42.4   1.6
      9.|-- ae-0.r23.asbnva02.us.bb.gin.ntt.net   0.0%    10   38.2  38.3  37.6  40.2   0.5
     10.|-- ae-2.r25.amstnl02.nl.bb.gin.ntt.net   0.0%    10  123.2 123.4 123.1 124.7   0.3
     11.|-- ae-3.r24.amstnl02.nl.bb.gin.ntt.net   0.0%    10  124.4 124.6 123.7 127.9   1.2
     12.|-- ae-14.r02.parsfr02.fr.bb.gin.ntt.net  0.0%    10  139.1 138.8 138.6 139.1   0.0
     13.|-- 81.25.206.50                          0.0%    10  134.5 134.5 134.5 134.6   0.0
     14.|-- paris-kvm-1.datapacket.com            0.0%    10  130.6 130.5 130.3 130.6   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Singapore:
    Start: Tue May 29 22:51:04 2018
    HOST: hostname                         Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                                0.0%    10    0.9   1.2   0.8   3.2   0.7
      2.|-- ???                                         100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                                 0.0%    10    2.2   0.8   0.6   2.2   0.5
      4.|-- 144.168.32.1                                 0.0%    10    0.5   0.5   0.5   0.6   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net                   0.0%    10    0.9   0.9   0.5   2.4   0.5
      6.|-- et-0-0-71.cr3-lax2.ip4.gtt.net               0.0%    10   32.2  32.9  32.1  36.3   1.1
      7.|-- singapore-telecommunications-gw.ip4.gtt.net  0.0%    10   30.5  30.0  29.8  30.5   0.0
      8.|-- 203.208.151.181                              0.0%    10  202.8 203.9 202.7 214.0   3.5
      9.|-- 203.208.177.110                              0.0%    10  206.7 206.7 206.6 206.8   0.0
     10.|-- singapore-latency-38.cdn77.com               0.0%    10  206.5 206.5 206.5 206.6   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Stockholm:
    Start: Tue May 29 22:51:20 2018
    HOST: hostname                             Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                                    0.0%    10    0.8   0.9   0.8   1.4   0.0
      2.|-- ???                                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                                     0.0%    10    0.8   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                                     0.0%    10    0.6   0.7   0.5   1.6   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net                       0.0%    10    1.0   2.5   0.5  12.2   3.6
      6.|-- et-0-0-71.cr10-dal3.ip4.gtt.net                  0.0%    10    8.8   2.3   0.5   8.8   2.6
      7.|-- be3045.ccr41.dfw03.atlas.cogentco.com            0.0%    10    1.2   1.0   0.7   1.3   0.0
      8.|-- be2763.ccr31.dfw01.atlas.cogentco.com            0.0%    10    1.5   1.2   0.9   1.5   0.0
      9.|-- be2432.ccr21.mci01.atlas.cogentco.com            0.0%    10   11.0  11.1  10.9  11.3   0.0
     10.|-- be2831.ccr41.ord01.atlas.cogentco.com            0.0%    10   23.5  23.4  23.2  23.6   0.0
     11.|-- be2717.ccr21.cle04.atlas.cogentco.com            0.0%    10   39.4  39.3  39.1  39.5   0.0
     12.|-- be2993.ccr31.yyz02.atlas.cogentco.com            0.0%    10   39.3  39.3  39.0  39.5   0.0
     13.|-- be3259.ccr21.ymq01.atlas.cogentco.com            0.0%    10   46.5  46.5  46.3  46.8   0.0
     14.|-- be3042.ccr21.lpl01.atlas.cogentco.com            0.0%    10  114.3 113.2 112.8 114.3   0.5
     15.|-- be2182.ccr41.ams03.atlas.cogentco.com            0.0%    10  119.8 118.8 118.3 120.1   0.5
     16.|-- be2815.ccr41.ham01.atlas.cogentco.com            0.0%    10  126.2 125.8 125.5 126.3   0.0
     17.|-- be2281.ccr21.sto03.atlas.cogentco.com            0.0%    10  144.6 144.6 144.3 144.8   0.0
     18.|-- be2759.rcr21.b015775-1.sto03.atlas.cogentco.com  0.0%    10  144.8 144.8 144.7 145.0   0.0
     19.|-- datacamp.demarc.cogentco.com                     0.0%    10  144.6 144.5 144.4 144.6   0.0
     20.|-- stockholm-10.cdn77.com                           0.0%    10  144.5 144.6 144.5 144.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Moscow:
    Start: Tue May 29 22:51:39 2018
    HOST: hostname             Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                    0.0%    10    0.9   1.1   0.8   2.1   0.0
      2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                     0.0%    10    0.7   0.7   0.6   0.8   0.0
      4.|-- 144.168.32.1                     0.0%    10    0.6   0.7   0.5   1.5   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.7   1.0   0.6   1.4   0.0
      6.|-- et-0-0-49.cr11-fra2.ip4.gtt.net  0.0%    10  124.6 126.4 124.5 132.2   2.4
      7.|-- ip4.gtt.net                      0.0%    10  125.4 129.2 124.5 135.9   4.4
      8.|-- ae1-3.RT.MR.MSK.RU.retn.net      0.0%    10  160.9 160.9 160.7 161.0   0.0
      9.|-- moscow-20.cdn77.com              0.0%    10  161.0 161.0 160.8 161.3   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Miami:
    Start: Tue May 29 22:51:55 2018
    HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                         0.0%    10    0.8   0.9   0.8   1.1   0.0
      2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.41.1                          0.0%    10    0.8   0.7   0.6   0.9   0.0
      4.|-- 144.168.32.1                          0.0%    10    0.6   0.6   0.5   0.7   0.0
      5.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    0.8   2.9   0.6  21.8   6.6
      6.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    0.9   0.9   0.7   1.2   0.0
      7.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.1   1.5   0.8   4.2   0.8
      8.|-- ae-6.r21.miamfl02.us.bb.gin.ntt.net   0.0%    10   31.2  34.8  31.1  52.5   6.8
      9.|-- ae-11.r04.miamfl02.us.bb.gin.ntt.net  0.0%    10   31.5  31.3  31.1  31.6   0.0
     10.|-- 165.254.21.26                         0.0%    10   31.1  31.0  30.9  31.1   0.0
     11.|-- miami-kvm-1.datapacket.com            0.0%    10   31.1  31.0  30.9  31.2   0.0
    
    

    Code (Text):
    -------------------------------------------
    Check system entropy pool availability
    -------------------------------------------
    
    entropy_avail: 4067
    entropy_avail: 4067
    entropy_avail: 4067
    entropy_avail: 4067
    

    Code (Text):
    -------------------------------------------
    OpenSSL System Benchmark
    -------------------------------------------
    
    OpenSSL 1.0.2k-fips  26 Jan 2017
    -------------------------------------------
    openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    md5             213496.28k   564443.43k  1222713.26k  1713823.40k  1995218.94k
    sha1            242100.10k   726612.27k  1648164.01k  2430477.99k  2842607.62k
    rc4            2135021.25k  2250702.04k  1870626.56k  1786817.19k  1825710.08k
    aes-128 cbc     464521.95k   506218.54k   524225.11k  1146538.67k  1153253.38k
    aes-256 cbc     337201.43k   368087.06k   372200.02k   825446.40k   809585.32k
    sha256          229713.51k   527339.16k  1052762.54k  1285456.90k  1395223.21k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000183s 0.000005s   5463.2 188311.7
    rsa 4096 bits 0.001202s 0.000019s    832.1  53698.4
                                  sign    verify    sign/s verify/s
     256 bit ecdsa (nistp256)   0.0000s   0.0000s  95317.3  43956.0
    -------------------------------------------
    openssl speed -evp aes256 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            2881380.42k  3077439.87k  3190454.10k  3189763.41k  3100381.90k
    -------------------------------------------
    openssl speed -evp aes128 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            3710002.50k  4200615.40k  4264497.92k  4247090.52k  4369874.94k
    

    Code (Text):
    -------------------------------------------
    Running mysqlslap
    -------------------------------------------
    
    mysqlslap --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-secondary-indexes=5 --number-int-cols=5 --number-char-cols=5 --number-of-queries=25000 --auto-generate-sql-unique-query-number=40 --auto-generate-sql-unique-write-number=40 --auto-generate-sql-write-number=1000 --concurrency=64 --iterations=10 --engine=myisam
    Benchmark
            Running for engine myisam
            Average number of seconds to run all queries: 1.787 seconds
            Minimum number of seconds to run all queries: 1.686 seconds
            Maximum number of seconds to run all queries: 1.959 seconds
            Number of clients running queries: 64
            Average number of queries per client: 390
    
    Dropping the database is potentially a very bad thing to do.
    Any data stored in the database will be destroyed.
    
    Do you really want to drop the 'test' database [y/N] Database "test" dropped
    

    Code (Text):
    -------------------------------------------
    System PHP Info
    -------------------------------------------
    
    CPU: 4 x Intel Core Processor (Skylake, IBRS)
                  total        used        free      shared  buff/cache   available
    Mem:          15886        1532       13007          30        1346       13981
    Low:          15886        2878       13007
    High:             0           0           0
    Swap:          1023           0        1023
    ----------------------------------------------
    PHP 5.6.36 (cli) (built: May 29 2018 21:55:41)
    Copyright (c) 1997-2016 The PHP Group
    Zend Engine v2.6.0, Copyright (c) 1998-2016 Zend Technologies
        with Zend OPcache v7.0.6-dev, Copyright (c) 1999-2016, by Zend Technologies
    ----------------------------------------------
    Configuration File (php.ini) Path: /usr/local/lib
    Loaded Configuration File:         /usr/local/lib/php.ini
    Scan for additional .ini files in: /etc/centminmod/php.d
    Additional .ini files parsed:      /etc/centminmod/php.d/a_customphp.ini,
    /etc/centminmod/php.d/curlcainfo.ini,
    /etc/centminmod/php.d/geoip.ini,
    /etc/centminmod/php.d/igbinary.ini,
    /etc/centminmod/php.d/imagick.ini,
    /etc/centminmod/php.d/mailparse.ini,
    /etc/centminmod/php.d/memcache.ini,
    /etc/centminmod/php.d/memcached.ini,
    /etc/centminmod/php.d/redis.ini,
    /etc/centminmod/php.d/zendopcache.ini
    
    ----------------------------------------------
    [PHP Modules]
    bcmath
    bz2
    calendar
    Core
    ctype
    curl
    date
    dom
    enchant
    ereg
    exif
    filter
    ftp
    gd
    geoip
    gettext
    gmp
    hash
    iconv
    igbinary
    imagick
    imap
    intl
    json
    ldap
    libxml
    mailparse
    mbstring
    mcrypt
    memcache
    memcached
    mhash
    mysql
    mysqli
    mysqlnd
    openssl
    pcntl
    pcre
    PDO
    pdo_mysql
    pdo_sqlite
    Phar
    posix
    pspell
    readline
    redis
    Reflection
    session
    shmop
    SimpleXML
    snmp
    soap
    sockets
    SPL
    sqlite3
    standard
    sysvmsg
    sysvsem
    sysvshm
    tidy
    tokenizer
    xml
    xmlreader
    xmlrpc
    xmlwriter
    xsl
    Zend OPcache
    zip
    zlib
    
    [Zend Modules]
    Zend OPcache
    

    Code (Text):
    -------------------------------------------
    Run PHP test Zend/bench.php
    -------------------------------------------
    
    simple             0.058
    simplecall         0.089
    simpleucall        0.087
    simpleudcall       0.090
    mandel             0.152
    mandel2            0.215
    ackermann(7)       0.079
    ary(50000)         0.023
    ary2(50000)        0.021
    ary3(2000)         0.134
    fibo(30)           0.290
    hash1(50000)       0.030
    hash2(500)         0.026
    heapsort(20000)    0.062
    matrix(20)         0.065
    nestedloop(12)     0.115
    sieve(30)          0.079
    strcat(200000)     0.010
    ------------------------
    Total              1.628
    real: 1.69s user: 1.63s sys: 0.04s cpu: 98% maxmem: 31372 KB cswaits: 5
    
    simple             0.069
    simplecall         0.096
    simpleucall        0.091
    simpleudcall       0.092
    mandel             0.153
    mandel2            0.204
    ackermann(7)       0.080
    ary(50000)         0.021
    ary2(50000)        0.020
    ary3(2000)         0.130
    fibo(30)           0.299
    hash1(50000)       0.030
    hash2(500)         0.026
    heapsort(20000)    0.062
    matrix(20)         0.067
    nestedloop(12)     0.105
    sieve(30)          0.078
    strcat(200000)     0.010
    ------------------------
    Total              1.632
    real: 1.70s user: 1.64s sys: 0.04s cpu: 98% maxmem: 31368 KB cswaits: 5
    
    simple             0.060
    simplecall         0.101
    simpleucall        0.091
    simpleudcall       0.095
    mandel             0.158
    mandel2            0.225
    ackermann(7)       0.078
    ary(50000)         0.020
    ary2(50000)        0.021
    ary3(2000)         0.130
    fibo(30)           0.291
    hash1(50000)       0.030
    hash2(500)         0.025
    heapsort(20000)    0.060
    matrix(20)         0.063
    nestedloop(12)     0.109
    sieve(30)          0.081
    strcat(200000)     0.011
    ------------------------
    Total              1.651
    real: 1.71s user: 1.66s sys: 0.03s cpu: 99% maxmem: 31372 KB cswaits: 5
    
    bench.php results from 3 runs
    1.628
    1.632
    1.651
    
    bench.php avg: 1.6370
    Avg: real: 1.70s user: 1.64s sys: 0.04s cpu: 98.33% maxmem: 31370.67KB cswaits: 5.00
    created results log at /home/phpbench_logs/bench_290518-223702.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_290518-223702.log
    

    Code (Text):
    -------------------------------------------
    Run PHP test Zend/micro_bench.php
    -------------------------------------------
    
    empty_loop         0.091
    func()             0.281    0.190
    undef_func()       0.283    0.192
    int_func()         0.268    0.176
    $x = self::$x      0.195    0.103
    self::$x = 0       0.199    0.108
    isset(self::$x)    0.195    0.103
    empty(self::$x)    0.195    0.103
    $x = Foo::$x       0.189    0.098
    Foo::$x = 0        0.179    0.088
    isset(Foo::$x)     0.164    0.073
    empty(Foo::$x)     0.178    0.087
    self::f()          0.309    0.218
    Foo::f()           0.278    0.187
    $x = $this->x      0.177    0.086
    $this->x = 0       0.240    0.148
    $this->x += 2      0.207    0.116
    ++$this->x         0.174    0.082
    --$this->x         0.171    0.080
    $this->x++         0.196    0.105
    $this->x--         0.189    0.098
    isset($this->x)    0.170    0.078
    empty($this->x)    0.187    0.096
    $this->f()         0.327    0.235
    $x = Foo::TEST     0.186    0.095
    new Foo()          0.555    0.463
    $x = TEST          0.139    0.048
    $x = $_GET         0.179    0.088
    $x = $GLOBALS['v'] 0.246    0.155
    $x = $hash['v']    0.196    0.105
    $x = $str[0]       0.263    0.172
    $x = $a ?: null    0.172    0.081
    $x = $f ?: tmp     0.249    0.157
    $x = $f ? $f : $a  0.193    0.102
    $x = $f ? $f : tmp 0.242    0.151
    ------------------------
    Total              7.665
    real: 7.76s user: 7.67s sys: 0.03s cpu: 99% maxmem: 19412 KB cswaits: 6
    
    empty_loop         0.103
    func()             0.310    0.207
    undef_func()       0.328    0.225
    int_func()         0.290    0.188
    $x = self::$x      0.207    0.104
    self::$x = 0       0.225    0.123
    isset(self::$x)    0.204    0.102
    empty(self::$x)    0.198    0.096
    $x = Foo::$x       0.179    0.077
    Foo::$x = 0        0.185    0.082
    isset(Foo::$x)     0.177    0.075
    empty(Foo::$x)     0.212    0.109
    self::f()          0.347    0.245
    Foo::f()           0.302    0.199
    $x = $this->x      0.189    0.087
    $this->x = 0       0.241    0.139
    $this->x += 2      0.205    0.102
    ++$this->x         0.174    0.072
    --$this->x         0.174    0.071
    $this->x++         0.193    0.091
    $this->x--         0.200    0.097
    isset($this->x)    0.183    0.080
    empty($this->x)    0.207    0.105
    $this->f()         0.331    0.229
    $x = Foo::TEST     0.190    0.088
    new Foo()          0.580    0.478
    $x = TEST          0.147    0.044
    $x = $_GET         0.191    0.089
    $x = $GLOBALS['v'] 0.254    0.151
    $x = $hash['v']    0.216    0.114
    $x = $str[0]       0.276    0.173
    $x = $a ?: null    0.171    0.068
    $x = $f ?: tmp     0.241    0.138
    $x = $f ? $f : $a  0.189    0.087
    $x = $f ? $f : tmp 0.242    0.139
    ------------------------
    Total              8.062
    real: 8.13s user: 8.10s sys: 0.01s cpu: 99% maxmem: 19412 KB cswaits: 4
    
    empty_loop         0.095
    func()             0.302    0.207
    undef_func()       0.322    0.227
    int_func()         0.279    0.184
    $x = self::$x      0.218    0.123
    self::$x = 0       0.206    0.111
    isset(self::$x)    0.213    0.118
    empty(self::$x)    0.224    0.129
    $x = Foo::$x       0.189    0.094
    Foo::$x = 0        0.192    0.097
    isset(Foo::$x)     0.165    0.070
    empty(Foo::$x)     0.175    0.080
    self::f()          0.330    0.234
    Foo::f()           0.302    0.207
    $x = $this->x      0.179    0.084
    $this->x = 0       0.218    0.123
    $this->x += 2      0.227    0.132
    ++$this->x         0.161    0.066
    --$this->x         0.160    0.065
    $this->x++         0.182    0.087
    $this->x--         0.186    0.090
    isset($this->x)    0.167    0.072
    empty($this->x)    0.185    0.090
    $this->f()         0.303    0.207
    $x = Foo::TEST     0.186    0.091
    new Foo()          0.550    0.455
    $x = TEST          0.141    0.046
    $x = $_GET         0.174    0.079
    $x = $GLOBALS['v'] 0.238    0.143
    $x = $hash['v']    0.185    0.090
    $x = $str[0]       0.245    0.150
    $x = $a ?: null    0.157    0.062
    $x = $f ?: tmp     0.225    0.130
    $x = $f ? $f : $a  0.177    0.082
    $x = $f ? $f : tmp 0.221    0.126
    ------------------------
    Total              7.681
    real: 7.75s user: 7.70s sys: 0.02s cpu: 99% maxmem: 19412 KB cswaits: 4
    
    micro_bench.php results from 3 runs
    7.665
    8.062
    7.681
    
    micro_bench.php avg: 7.8027
    Avg: real: 7.88s user: 7.82s sys: 0.02s cpu: 99.00% maxmem: 19412.00KB cswaits: 4.67
    created results log at /home/phpbench_logs/bench_micro_290518-223702.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_290518-223702.log
    
    

    Code (Text):
    -------------------------------------------
    Running UnixBench
    -------------------------------------------
    
    ========================================================================
       BYTE UNIX Benchmarks (Version 5.1.3)
    
       System: hostname: GNU/Linux
       OS: GNU/Linux -- 3.10.0-693.17.1.el7.x86_64 -- #1 SMP Thu Jan 25 20:13:58 UTC 2018
       Machine: x86_64 (x86_64)
       Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
       CPU 0: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
       CPU 1: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
       CPU 2: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
       CPU 3: Intel Core Processor (Skylake, IBRS) (4200.0 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
       22:57:06 up  1:30,  2 users,  load average: 2.06, 1.79, 0.92; runlevel 3
    ------------------------------------------------------------------------
    

    Code (Text):
    Benchmark Run: Tue May 29 2018 22:57:06 - 23:21:07
    4 CPUs in system; running 1 parallel copy of tests
    
    Dhrystone 2 using register variables       35758127.3 lps   (10.0 s, 7 samples)
    Double-Precision Whetstone                     4304.1 MWIPS (9.8 s, 7 samples)
    Execl Throughput                               2058.2 lps   (29.9 s, 2 samples)
    Pipe Throughput                              530656.8 lps   (10.0 s, 7 samples)
    Pipe-based Context Switching                  97339.9 lps   (10.0 s, 7 samples)
    Process Creation                               6253.8 lps   (30.0 s, 2 samples)
    Shell Scripts (1 concurrent)                   5337.1 lpm   (60.0 s, 2 samples)
    Shell Scripts (16 concurrent)                   986.0 lpm   (60.1 s, 2 samples)
    Shell Scripts (8 concurrent)                   1820.9 lpm   (60.0 s, 2 samples)
    System Call Overhead                         423882.9 lps   (10.0 s, 7 samples)
    
    System Benchmarks Partial Index              BASELINE       RESULT    INDEX
    Dhrystone 2 using register variables         116700.0   35758127.3   3064.1
    Double-Precision Whetstone                       55.0       4304.1    782.6
    Execl Throughput                                 43.0       2058.2    478.6
    Pipe Throughput                               12440.0     530656.8    426.6
    Pipe-based Context Switching                   4000.0      97339.9    243.3
    Process Creation                                126.0       6253.8    496.3
    Shell Scripts (1 concurrent)                     42.4       5337.1   1258.7
    Shell Scripts (16 concurrent)                     ---        986.0      ---
    Shell Scripts (8 concurrent)                      6.0       1820.9   3034.8
    System Call Overhead                          15000.0     423882.9    282.6
                                                                       ========
    System Benchmarks Index Score (Partial Only)                          736.6
    
    ------------------------------------------------------------------------
    

    Code (Text):
    Benchmark Run: Tue May 29 2018 23:21:07 - 23:45:09
    4 CPUs in system; running 4 parallel copies of tests
    
    Dhrystone 2 using register variables      141336372.4 lps   (10.0 s, 7 samples)
    Double-Precision Whetstone                    16985.5 MWIPS (9.7 s, 7 samples)
    Execl Throughput                               9127.0 lps   (29.9 s, 2 samples)
    Pipe Throughput                             2019568.4 lps   (10.0 s, 7 samples)
    Pipe-based Context Switching                 384351.9 lps   (10.0 s, 7 samples)
    Process Creation                              24267.2 lps   (30.0 s, 2 samples)
    Shell Scripts (1 concurrent)                  14733.1 lpm   (60.0 s, 2 samples)
    Shell Scripts (16 concurrent)                   940.6 lpm   (60.1 s, 2 samples)
    Shell Scripts (8 concurrent)                   1964.7 lpm   (60.1 s, 2 samples)
    System Call Overhead                        1528515.5 lps   (10.0 s, 7 samples)
    
    System Benchmarks Partial Index              BASELINE       RESULT    INDEX
    Dhrystone 2 using register variables         116700.0  141336372.4  12111.1
    Double-Precision Whetstone                       55.0      16985.5   3088.3
    Execl Throughput                                 43.0       9127.0   2122.6
    Pipe Throughput                               12440.0    2019568.4   1623.4
    Pipe-based Context Switching                   4000.0     384351.9    960.9
    Process Creation                                126.0      24267.2   1926.0
    Shell Scripts (1 concurrent)                     42.4      14733.1   3474.8
    Shell Scripts (16 concurrent)                     ---        940.6      ---
    Shell Scripts (8 concurrent)                      6.0       1964.7   3274.5
    System Call Overhead                          15000.0    1528515.5   1019.0
                                                                       ========
    System Benchmarks Index Score (Partial Only)                         2412.2
    
    

    Code (Text):
    -------------------------------------------
    centminmodbench.sh completed
    -------------------------------------------
    
    centminmodbench.sh Total Run Time: 4069.046255312 seconds
    
     
    • Informative Informative x 1
  7. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    The ssdnodes' Intel Xeon Gold Skylake cpu cryptographic performance is excellent.
    • Hardware assisted AES-NI benchmarks (-evp aes256/aes128) for OpenSSL 1.0.2k system was core for core 14.6-15.9% faster than my Core i7 4790K Haswell dedicated server when doing 4 cpu core OpenSSL benchmarks.
    • Non hardware assisted RSA2048 and ECDSA 256bit numbers were decent given the cpu clock speed differences.
    • Though aes-128/256 cbc (55-56% faster) & RSA4096 (12% faster) numbers also had Intel Xeon Gold Skylake cpu ahead.

    OpenSSL 1.0.2k



    ssdnodes 4 cpu KVM VPS with Intel Xeon Gold @2.0Ghz testing 4 cpu cores

    Code (Text):
    openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    md5             213496.28k   564443.43k  1222713.26k  1713823.40k  1995218.94k
    sha1            242100.10k   726612.27k  1648164.01k  2430477.99k  2842607.62k
    rc4            2135021.25k  2250702.04k  1870626.56k  1786817.19k  1825710.08k
    aes-128 cbc     464521.95k   506218.54k   524225.11k  1146538.67k  1153253.38k
    aes-256 cbc     337201.43k   368087.06k   372200.02k   825446.40k   809585.32k
    sha256          229713.51k   527339.16k  1052762.54k  1285456.90k  1395223.21k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000183s 0.000005s   5463.2 188311.7
    rsa 4096 bits 0.001202s 0.000019s    832.1  53698.4
                                  sign    verify    sign/s verify/s
     256 bit ecdsa (nistp256)   0.0000s   0.0000s  95317.3  43956.0
    

    Code (Text):
    openssl speed -evp aes256 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            2881380.42k  3077439.87k  3190454.10k  3189763.41k  3100381.90k
    

    Code (Text):
    openssl speed -evp aes128 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            3710002.50k  4200615.40k  4264497.92k  4247090.52k  4369874.94k
    


    OVH MC-32 Core i7 4790K @4.0Ghz testing 4 cpu cores

    Code (Text):
    openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    md5             309081.96k   909020.01k  2007314.43k  2892954.97k  3318060.37k
    sha1            370151.29k  1079533.23k  2556416.85k  3802567.34k  4573760.17k
    rc4            1845346.84k  2870001.94k  3317960.02k  3647107.75k  3445921.11k
    aes-128 cbc     554475.18k   718358.34k   733911.98k   735152.81k   740898.13k
    aes-256 cbc     483109.95k   513416.62k   516881.58k   522907.31k   518318.76k
    sha256          317988.24k   631856.34k  1173121.28k  1495389.53k  1691871.91k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000156s 0.000006s   6408.1 163333.3
    rsa 4096 bits 0.001346s 0.000020s    742.9  48931.0
                                  sign    verify    sign/s verify/s
     256 bit ecdsa (nistp256)   0.0000s   0.0000s 125000.0  49382.7
    

    Code (Text):
    openssl speed -evp aes256 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            2410075.73k  2644676.54k  2690798.85k  2702209.02k  2704706.22k
    

    Code (Text):
    openssl speed -evp aes128 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            3388483.24k  3666193.11k  3721211.05k  3765229.91k  3770414.42k
    


    OpenSSL 1.1.0h



    Update: lets compare that to Nginx's OpenSSL 1.1.0h version

    ssdnodes 4 cpu KVM VPS with Intel Xeon Gold @2.0Ghz testing 4 cpu cores
    Code (Text):
    openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
    OpenSSL 1.1.0h  27 Mar 2018
    built on: reproducible build, date unspecified
    options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
    compiler: gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
    md5             396445.87k   875119.47k  1574116.01k  2007837.94k  2009653.25k  2121318.40k
    sha1            419296.15k   994685.01k  1993751.55k  2615454.38k  2952407.72k  2808550.74k
    rc4            2065836.56k  2152900.52k  1764360.53k  1711937.54k  1637782.87k  1682363.73k
    aes-128 cbc     416092.43k   469209.32k   486252.12k  1113088.34k  1096198.83k  1108437.67k
    aes-256 cbc     311762.70k   344587.58k   341664.26k   810475.52k   828497.92k   818528.26k
    sha256          250588.72k   572098.54k  1014667.01k  1279746.39k  1371223.38k  1373739.94k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000196s 0.000006s   5114.0 174387.4
    rsa 4096 bits 0.001304s 0.000020s    766.8  49864.6
                                  sign    verify    sign/s verify/s
     256 bit ecdsa (nistp256)   0.0000s   0.0000s  80092.4  40119.0
    

    Code (Text):
    openssl speed -evp aes256 -multi 4
    OpenSSL 1.1.0h  27 Mar 2018
    built on: reproducible build, date unspecified
    options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
    compiler: gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
    evp            2173022.90k  2858526.29k  2932427.26k  3002174.12k  2999560.87k  2943554.90k
    

    Code (Text):
    openssl speed -evp aes128 -multi 4
    OpenSSL 1.1.0h  27 Mar 2018
    built on: reproducible build, date unspecified
    options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
    compiler: gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
    evp            2467888.79k  3840917.70k  4038786.56k  3989851.82k  4024898.90k  4017466.03k
    


    OVH MC-32 Core i7 4790K @4.0Ghz testing 4 cpu cores
    Code (Text):
    openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
    OpenSSL 1.1.0h  27 Mar 2018
    built on: reproducible build, date unspecified
    options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
    compiler: ccache gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
    md5             630215.01k  1398410.41k  2259497.30k  3106526.21k  3307732.99k  3354329.09k
    sha1            659653.66k  1558602.43k  3103942.23k  4174210.73k  4393052.84k  3509938.86k
    rc4            2101010.91k  3434050.94k  3815523.24k  3996416.00k  4170437.97k  4168979.80k
    aes-128 cbc     617708.81k   691342.93k   732358.40k   737779.03k   731130.54k   740786.18k
    aes-256 cbc     455975.31k   410253.35k   521641.22k   524214.61k   494804.99k   525287.42k
    sha256          284005.43k   634975.19k  1334041.86k  1991359.49k  2106032.13k  2163190.44k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000125s 0.000005s   7968.3 181818.2
    rsa 4096 bits 0.001340s 0.000020s    746.1  49232.2
                                  sign    verify    sign/s verify/s
     256 bit ecdsa (nistp256)   0.0000s   0.0000s 113538.7  48210.3
    

    Code (Text):
    openssl speed -evp aes256 -multi 4
    OpenSSL 1.1.0h  27 Mar 2018
    built on: reproducible build, date unspecified
    options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
    compiler: ccache gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
    evp            2083167.42k  2601779.48k  2693292.63k  2702125.74k  2704482.30k  2704583.34k
    

    Code (Text):
    openssl speed -evp aes128 -multi 4
    OpenSSL 1.1.0h  27 Mar 2018
    built on: reproducible build, date unspecified
    options:bn(64,64) rc4(16x,int) des(int) aes(partial) idea(int) blowfish(ptr) 
    compiler: ccache gcc -DDSO_DLFCN -DHAVE_DLFCN_H -DNDEBUG -DOPENSSL_THREADS -DOPENSSL_NO_STATIC_ENGINE -DOPENSSL_PIC -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DRC4_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DPADLOCK_ASM -DPOLY1305_ASM -DOPENSSLDIR="\"/opt/openssl\"" -DENGINESDIR="\"/opt/openssl/lib/engines-1.1\""  -Wa,--noexecstack
    evp            2933207.49k  3677225.64k  3748412.59k  3766041.26k  3770477.23k  3767719.25k
    
     
  8. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Let's try to figure out which specific Intel Xeon Gold Skylake cpu is being used as /proc/cpuinfo is lacking specific model number.
    Code (Text):
    processor       : 3
    vendor_id       : GenuineIntel
    cpu family      : 6
    model           : 94
    model name      : Intel Core Processor (Skylake, IBRS)
    stepping        : 3
    microcode       : 0x1
    cpu MHz         : 2099.998
    cache size      : 4096 KB
    physical id     : 0
    siblings        : 4
    core id         : 3
    cpu cores       : 4
    apicid          : 3
    initial apicid  : 3
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 13
    wp              : yes
    flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    bogomips        : 4199.99
    clflush size    : 64
    cache_alignment : 64
    address sizes   : 46 bits physical, 48 bits virtual
    power management:
    

    Code (Text):
    journalctl -b --no-pager | grep -C1 microcode
    May 29 21:28:25 centos7 kernel: NET: Registered protocol family 17
    May 29 21:28:25 centos7 kernel: microcode: CPU0 sig=0x506e3, pf=0x1, revision=0x1
    May 29 21:28:25 centos7 kernel: microcode: CPU1 sig=0x506e3, pf=0x1, revision=0x1
    May 29 21:28:25 centos7 kernel: microcode: CPU2 sig=0x506e3, pf=0x1, revision=0x1
    May 29 21:28:25 centos7 kernel: microcode: CPU3 sig=0x506e3, pf=0x1, revision=0x1
    


    According to https://en.wikichip.org/wiki/intel/xeon_gold/ only the following Intel Xeon Gold Skylake based cpus have base clocks of ~2.1Ghz
    So depending on overall cpu core/thread utilisation at VPS host node level, the 4 cpu core/thread KVM VPS clock speed can possibly turbo boost with 2 cpu cores up to 3.70Ghz for normal loads, 3.60Ghz for AVX2 loads and 3.50Ghz for AVX512 work loads. Intel Xeon Gold 6130 variants can all turbo boost normal work loads at all 16 core work loads to 2.80Ghz while Intel Xeon Gold 6152 can turbo boost normal workloads with 16 cores to 3.10Ghz or all 22 cores to 2.80Ghz.

    Intel Xeon Gold 6130 cpu clock and turbo boost profiles

    upload_2018-5-30_18-12-27.png

    Intel Gold 6130F cpu clock and turbo boost profiles

    upload_2018-5-30_18-13-31.png

    Intel Gold 6130T cpu clock and turbo boost profiles

    upload_2018-5-30_18-14-7.png

    Intel Gold 6152 cpu clock and turbo boost profiles

    upload_2018-5-30_18-14-46.png
     
  9. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
  10. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    ssdnodes folks blog has covered using Docker on their KVM VPSes, so thought I'd give it a try with Percona Monitoring and Management PMM Tool Percona Monitoring and Management for Databases. Very useful if you need to dig deep into MySQL/MariaDB/Percona usage and monitoring :)

    Code (Text):
    pmm-admin list    
    pmm-admin 1.11.0
    
    PMM Server      | 127.0.0.1:8448 (password-protected)
    Client Name     | domain.com
    Client Address  | 172.17.0.1
    Service Manager | linux-systemd
    
    -------------- -------------------- ----------- -------- ----------------------------------------- --------------------------------------------------------------------------------------
    SERVICE TYPE   NAME                 LOCAL PORT  RUNNING  DATA SOURCE                               OPTIONS                                                                              
    -------------- -------------------- ----------- -------- ----------------------------------------- --------------------------------------------------------------------------------------
    mysql:queries  domain.com  -           YES      root:***@unix(/var/lib/mysql/mysql.sock)  query_source=slowlog, query_examples=true, slow_log_rotation=true, retain_slow_logs=1
    linux:metrics  domain.com  42000       YES      -                                                                                                                              
    mysql:metrics  domain.com  42002       YES      root:***@unix(/var/lib/mysql/mysql.sock) 


    percona-pmm-01.png percona-pmm-02.png percona-pmm-03.png percona-pmm-04.png percona-pmm-05.png
    percona-pmm-06.png percona-pmm-07.png percona-pmm-08.png percona-pmm-09.png percona-pmm-10.png
     
    • Winner Winner x 1
  11. pamamolf

    pamamolf Well-Known Member

    3,119
    295
    83
    May 31, 2014
    Ratings:
    +531
    Local Time:
    1:50 PM
    Nginx-1.13.x
    MariaDB 10.1.x
    Does that graphs required any edits or they are out of the box for Centminmod?
     
  12. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Percona PMM doesn't touch Centmin Mod Nginx etc it's purely from Docker container running on same server. But yes all graphs are out of box provided.
     
    • Like Like x 1
  13. wmtech

    wmtech Member

    74
    19
    8
    Jul 22, 2017
    Ratings:
    +45
    Local Time:
    12:50 PM
    We use PMM for a long time now and it is indeed very useful!!
     
    • Like Like x 1
    • Agree Agree x 1
  14. Revenge

    Revenge Active Member

    429
    87
    28
    Feb 21, 2016
    Portugal
    Ratings:
    +319
    Local Time:
    11:50 AM
    1.9.x
    10.1.x
    I have some difficult to understand how can they offer 16Gb of Ram for only 8$ and still make profit. Something tell's me they will oversell it, and it will not be only a bit.
     
  15. wmtech

    wmtech Member

    74
    19
    8
    Jul 22, 2017
    Ratings:
    +45
    Local Time:
    12:50 PM
    It's a tight calculation, thats for sure. But you need to pay 3 years in advance. Many things can happen in 3 years. Some of those servers won't last that long.

    They are in business for 7 years now. They should know what they can do and what they can't do price wise...
     
  16. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    +1 PMM has come along way since I first used it :)

    I posted my theories on other web host forums - the gist is Dallas location they use Incero and they're known for doing very heavy discount deals on server hardware when you prepay in advance like 1-3yrs. If you search webhostingtalk.com forum for Incero past dedicated server deals they can offer high end dual Xeon servers which usually hosts charge US$499-699/month for at sometimes discounted US$199-299/month if you prepay up to 3yrs in advance. That's probably why ssdnodes does the same to get the cash flow to pay upstream with Incero.

    Incero heavy discounts for long term contracts are enticing but personally I wouldn't use Incero myself/directly due to how Gordon has treated the LET customers in the past where getting on his wrong side would result in termination of all your account/servers. Never happened me to but lots of reports if you search of other folks experiences. But Incero seems to treat their high end hosting/colocation clients well i.e. ssdnodes, vpsdime, backupsy etc. But for me I rather not take the risk going Incero direct. Lots of my consulting clients that I do server optimisations and web host search/evaluations for have also skipped Incero during their research for similar reasons. Update: November 28, 2018 - interestingly Incero where ssdnodes colocates their servers was acquired by very good web host Hivelocity recently Hivelocity Acquires Incero ! - one of the best news this year in my books - combines Hivelocity's great service and network with Incero's great network and server hardware and Incero ex-owner Gordon is no longer part of the picture !

    I only prepaid for 1yr not 3yrs just to see and well this ssdnodes VPS will be used for more Centmin Mod LEMP development testing - so Ways To Support Centmin Mod ;)
     
  17. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Centmin Mod 123.09beta01 compiles Nginx server using GCC 7.3.1 compiler by default these days. Let's check which native architecture GCC 7.3.1 picks up for Nginx builds. From GCC 7.3.1 native output looks like march/mtune = skylake is used. Definitely ssdnodes is the cheapest way to get access to Intel Xeon Gold Skylake based processors if you want to compile and built your binaries with i.e. Nginx :D
    Code (Text):
    cat /root/centminlogs/gcc_native.log
      -m128bit-long-double                  [enabled]
      -m64                                  [enabled]
      -m80387                               [enabled]
      -mabm                                 [enabled]
      -madx                                 [enabled]
      -maes                                 [enabled]
      -malign-stringops                     [enabled]
      -march=                               skylake
      -mavx                                 [enabled]
      -mavx2                                [enabled]
      -mavx512bw                            [enabled]
      -mavx512cd                            [enabled]
      -mavx512dq                            [enabled]
      -mavx512f                             [enabled]
      -mavx512vl                            [enabled]
      -mbmi                                 [enabled]
      -mbmi2                                [enabled]
      -mclflushopt                          [enabled]
      -mclwb                                [enabled]
      -mcx16                                [enabled]
      -mf16c                                [enabled]
      -mfancy-math-387                      [enabled]
      -mfma                                 [enabled]
      -mfp-ret-in-387                       [enabled]
      -mfsgsbase                            [enabled]
      -mfxsr                                [enabled]
      -mglibc                               [enabled]
      -mhard-float                          [enabled]
      -mhle                                 [enabled]
      -mieee-fp                             [enabled]
      -mlong-double-80                      [enabled]
      -mlzcnt                               [enabled]
      -mmmx                                 [enabled]
      -mmovbe                               [enabled]
      -mpclmul                              [enabled]
      -mpopcnt                              [enabled]
      -mprfchw                              [enabled]
      -mpush-args                           [enabled]
      -mrdrnd                               [enabled]
      -mrdseed                              [enabled]
      -mred-zone                            [enabled]
      -mrtm                                 [enabled]
      -msahf                                [enabled]
      -msse                                 [enabled]
      -msse2                                [enabled]
      -msse3                                [enabled]
      -msse4                                [enabled]
      -msse4.1                              [enabled]
      -msse4.2                              [enabled]
      -mssse3                               [enabled]
      -mstv                                 [enabled]
      -mtls-direct-seg-refs                 [enabled]
      -mtune-ctrl=             
      -mtune=                               skylake
      -mvzeroupper                          [enabled]
      -mxsave                               [enabled]
      -mxsavec                              [enabled]
      -mxsaveopt                            [enabled]
    

    Code (Text):
    lscpu
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 94
    Model name:            Intel Core Processor (Skylake, IBRS)
    Stepping:              3
    CPU MHz:               2099.998
    BogoMIPS:              4199.99
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single spec_ctrl ibpb_support fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
    
     
  18. Daniel J. Lewis

    Daniel J. Lewis Award-winning podcaster and consultant

    101
    14
    18
    Oct 20, 2014
    Ratings:
    +24
    Local Time:
    6:50 AM
    1.8.0
    5.6
  19. eva2000

    eva2000 Administrator Staff Member

    37,217
    8,128
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,514
    Local Time:
    9:50 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    very close i'd say for cpu as probably turbo boost on upcloud E5-2687w v4 is higher on 4 cpu threads but upcloud faster clock speed memory i suppose

    ssdnodes
    sysbench cpu
    1 thread = 417 events/s
    4 thread = 1556 events/s

    ssdnodes
    sysbench mem
    1 thread = 3028.81 MiB/sec
    4 thread = 9395.38 MiB/sec

    upcloud
    sysbench cpu
    1 thread = 414 events/s
    4 thread = 1647 events/s

    upcloud
    sysbench mem
    1 thread = 4733.67 MiB/sec
    4 thread = 14952.90 MiB/sec
     
  20. Daniel J. Lewis

    Daniel J. Lewis Award-winning podcaster and consultant

    101
    14
    18
    Oct 20, 2014
    Ratings:
    +24
    Local Time:
    6:50 AM
    1.8.0
    5.6
    I spun up a new server, ran the beta installer, then sysbench on both ssdnodes and UpCloud.

    Here's what I got from ssdnodes.

    1 thread: events/s: 381.40
    4 threads: events/s: 1512.51
     
    • Informative Informative x 1
..