Learn about Centmin Mod LEMP Stack today
Become a Member

Benchmarks SSDNodes ssdnodes.com upto 91% discount on KVM VPS until May 31, 2018

Discussion in 'Virtual Private Server (VPS) hosting' started by eva2000, May 30, 2018.

  1. robert syputa

    robert syputa Member

    77
    18
    8
    Jan 18, 2018
    Seattle
    Ratings:
    +46
    Local Time:
    10:49 AM
    latest
    10
    The trends in VPS make your Centminmod optimized stack have more of an impact: CMS such as WordPress have become more capable of enterprise-class use. WP eCommerce and blogging/news apps have made it a non-compromising choice for mainstream use when combined with the tight security and streamlined maintenance of Centminmod. The improved cost/performance and reliability available from VPS providers top that up. The combination helps level the playing field for individuals, startups, and anyone else who wants to have an optimized starting point that can scale.

     
  2. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  3. robert syputa

    robert syputa Member

    77
    18
    8
    Jan 18, 2018
    Seattle
    Ratings:
    +46
    Local Time:
    10:49 AM
    latest
    10
    Isn't media/video transcoding a special case? My view of the low-cost VPS providers is that they are useful for web servers up to the point that the server reaches a high level of use of the rated cores and memory. At that point, use of more networked/distributed servers is required or shifting to a dedicated server. Some VPS are not suitable for specific applications, such as eMail servers, depending on their usage policies. Media/video servers can be demanding apps, depending on the applications you want to serve to clients or the public. At the extreme, this can require distributed servers located close to end users in order to provide media conversion, up or downscaling, etc. Mobile networks are placing more media and storage servers close to users as the networks are migrated to smallcell topologies. If a company or service wants to offer competitive content delivery, that often means having excess capacity in a distributed cloud server platform. That can be done using VPS but the QoS, quality of service, probably cannot be achieved using cheap VPS.

    The VPS providers do business by over-allocation of the virtualized server. The converged ICT, Internet Communications Technology, the wired-wireless network is virtualized in hardware and software. The mobile operators and those who provide specific services and integration services are set up to provide service contracts that have specific levels of availability and measured performance. Cheap VPS are not competing in the same arena... so it is an apple and orangutan set of comparisons.

    The specialized media transcoding services such as Amazon Elastic Transcoder and Zen Coder are set up to provide basic transcoding servers at an incremental price. That affords such providers to scale their capacity based on the market. However, these are general services.

    Say you want to build a public-facing video content service. That could be aimed at a specific audience or at the public. If you wanted to compete with current content providers such as NetFlix or YouTube or for hosting of conventions, social media exchanges, and most other similar apps, you can't even think about using cheap VPS except as a starter package.
     
  4. Tsikura

    Tsikura New Member

    9
    8
    3
    May 18, 2016
    New York
    Ratings:
    +10
    Local Time:
    10:49 AM
    1.15.6
    MariaDB 10.1.137
    Purchased a year of ssdnodes service today and picked the following package and the install time.

    CentOS 7
    CentOS Linux release 7.5.1804 (Core)

    KVM - X-Large
    16GB ECC RAM
    / 80GB RAID10 SSD / 4x Intel E5 Gold vCPU / 8TB Transfer

    Code:
    yum -y update; curl -O https://centminmod.com/betainstaller72.sh && chmod 0700 betainstaller72.sh && bash betainstaller72.sh
    
    Code:
    ---------------------------------------------------------------------------
    Total Curl Installer YUM or DNF Time: 88.3990 seconds
    Total YUM Time: 7.964127025 seconds
    Total YUM or DNF + Source Download Time: 29.4653
    Total Nginx First Time Install Time: 140.7616
    Total PHP First Time Install Time: 180.6792
    Download From Github Time: 1.4169
    Total Time Other eg. source compiles: 270.9415
    Total Centmin Mod Install Time: 621.8476
    ---------------------------------------------------------------------------
    Total Install Time (curl yum + cm install + zip download): 711.6635 seconds
    ---------------------------------------------------------------------------
    4 Intel Xeon Processor (Skylake, IBRS)
    4 2294.596
    ---------------------------------------------------------------------------
    
    Code:
    *************************************************
    * Post-Install Check List....
    *************************************************
    
    --------------------------------------------------------
    Check ccache Version:
    --------------------------------------------------------
    ccache version 3.5
    
    Copyright (C) 2002-2007 Andrew Tridgell
    Copyright (C) 2009-2018 Joel Rosdahl
    
    This program is free software; you can redistribute it and/or modify it under
    the terms of the GNU General Public License as published by the Free Software
    Foundation; either version 3 of the License, or (at your option) any later
    version.
    
    --------------------------------------------------------
    Check Nginx Version:
    --------------------------------------------------------
    nginx version: nginx/1.15.6 (251118-031625)
    built by gcc 7.3.1 20180303 (Red Hat 7.3.1-5) (GCC)
    built with OpenSSL 1.1.1a  20 Nov 2018
    TLS SNI support enabled
    configure arguments: --with-ld-opt='-Wl,-E -L/usr/local/zlib-cf/lib -L/usr/local/lib -ljemalloc -Wl,-z,relro -Wl,-rpa                       th,/usr/local/zlib-cf/lib:/usr/local/lib' --with-cc-opt='-I/usr/local/zlib-cf/include -I/usr/local/include -m64 -marc                       h=native -DTCP_FASTOPEN=23 -g -O3 -fstack-protector-strong -flto -fuse-ld=gold --param=ssp-buffer-size=4 -Wformat -We                       rror=format-security -Wimplicit-fallthrough=0 -fcode-hoisting -Wp,-D_FORTIFY_SOURCE=2 -gsplit-dwarf' --sbin-path=/usr                       /local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --build=251118-031625 --with-compat --with-http_stub_s                       tatus_module --with-http_secure_link_module --with-libatomic --with-http_gzip_static_module --with-http_sub_module --                       with-http_addition_module --with-http_image_filter_module=dynamic --with-http_geoip_module --with-stream_geoip_module                        --with-stream_realip_module --with-stream_ssl_preread_module --with-threads --with-stream --with-stream_ssl_module -                       -with-http_realip_module --add-dynamic-module=../ngx-fancyindex-0.4.2 --add-module=../ngx_cache_purge-2.5 --add-dynam                       ic-module=../ngx_devel_kit-0.3.0 --add-dynamic-module=../set-misc-nginx-module-0.32 --add-dynamic-module=../echo-ngin                       x-module-0.61 --add-module=../redis2-nginx-module-0.15 --add-module=../ngx_http_redis-0.3.7 --add-module=../memc-ngin                       x-module-0.18 --add-module=../srcache-nginx-module-0.31 --add-dynamic-module=../headers-more-nginx-module-0.33 --with                       -pcre-jit --with-zlib=../zlib-cloudflare-1.3.0 --with-http_ssl_module --with-http_v2_module --with-openssl=../openssl                       -1.1.1a
    
    --------------------------------------------------------
    Check PHP-FPM Version:
    --------------------------------------------------------
    PHP 7.2.12 (cli) (built: Nov 25 2018 03:21:46) ( NTS )
    Copyright (c) 1997-2018 The PHP Group
    Zend Engine v3.2.0, Copyright (c) 1998-2018 Zend Technologies
        with Zend OPcache v7.2.12, Copyright (c) 1999-2018, by Zend Technologies
    
    --------------------------------------------------------
    Check MariaDB installed RPM Versions:
    --------------------------------------------------------
    MariaDB-server-10.1.37-1.el7.centos.x86_64
    MariaDB-common-10.1.37-1.el7.centos.x86_64
    MariaDB-devel-10.1.37-1.el7.centos.x86_64
    MariaDB-shared-10.1.37-1.el7.centos.x86_64
    MariaDB-client-10.1.37-1.el7.centos.x86_64
    MariaDB-compat-10.1.37-1.el7.centos.x86_64
    
    --------------------------------------------------------
    Check Memcached Server Version:
    --------------------------------------------------------
    memcached 1.5.10
    
    --------------------------------------------------------
    Check CSF Firewall Version:
    --------------------------------------------------------
    csf: v12.08 (generic)
    
    --------------------------------------------------------
    Check Siege Benchmark Version:
    --------------------------------------------------------
    SIEGE 4.0.4
    
    Copyright (C) 2017 by Jeffrey Fulmer, et al.
    This is free software; see the source for copying conditions.
    There is NO warranty; not even for MERCHANTABILITY or FITNESS
    FOR A PARTICULAR PURPOSE.
    
    
    --------------------------------------------------------
    Check mysqlreport version:
    --------------------------------------------------------
    mysqlreport v3.5-maria11 Jul 4 2013
    
    --------------------------------------------------------
    Check pure-ftpd Version:
    --------------------------------------------------------
    pure-ftpd v1.0.42
    
    --------------------------------------------------------
    Check YUM Repo List
    --------------------------------------------------------
    Loaded plugins: fastestmirror, priorities, versionlock
    Loading mirror speeds from cached hostfile
     * base: mirror.dal10.us.leaseweb.net
     * epel: mirror.compevo.com
     * extras: mirror.dal10.us.leaseweb.net
     * rpmforge: mirror.teklinks.com
     * updates: mirror.dal10.us.leaseweb.net
    282 packages excluded due to repository priority protections
    repo id                 repo name                                    status
    base/7/x86_64           CentOS-7 - Base                              7,658+2,253
    centos-sclo-rh/x86_64   CentOS-7 - SCLo rh                             7,999+100
    centos-sclo-sclo/x86_64 CentOS-7 - SCLo sclo                                 775
    epel/x86_64             Extra Packages for Enterprise Linux 7 - x86_  11,746+972
    extras/7/x86_64         CentOS-7 - Extras                                    434
    mariadb                 MariaDB                                             73+3
    rpmforge                RHEL 7 - RPMforge.net - dag                      135+110
    updates/7/x86_64        CentOS-7 - Updates                             1,311+303
    repolist: 30,131
    
    --------------------------------------------------------
    mytimes check:
    /usr/bin/mytimes
    --------------------------------------------------------
    Sun Nov 25 03:25:14 UTC 2018    [UTC]
    Sun Nov 25 13:25:14 AEST 2018   [Australia/Brisbane]
    Sat Nov 24 19:25:14 PST 2018    [America/Los_Angeles]
    Sat Nov 24 21:25:14 CST 2018    [America/Chicago]
    Sat Nov 24 22:25:14 EST 2018    [America/New_York]
    Sat Nov 24 22:25:14 EST 2018    [America/Montreal]
    Sun Nov 25 03:25:14 GMT 2018    [Europe/London]
    Sun Nov 25 04:25:14 CET 2018    [Europe/Berlin]
    Sun Nov 25 10:25:14 +07 2018    [Asia/Bangkok]
    Sun Nov 25 10:25:14 +07 2018    [Asia/Ho_Chi_Minh]
    Sun Nov 25 10:25:14 WIB 2018    [Asia/Jakarta]
    Sun Nov 25 11:25:14 +08 2018    [Asia/Kuala_Lumpur]
    Sun Nov 25 11:25:14 +08 2018    [Asia/Singapore]
    --------------------------------------------------------
    *************************************************
    * Centmin Mod install completed....
    *************************************************
    
     
  5. Tsikura

    Tsikura New Member

    9
    8
    3
    May 18, 2016
    New York
    Ratings:
    +10
    Local Time:
    10:49 AM
    1.15.6
    MariaDB 10.1.137
    Code:
    -------------------------------------------
    centminmodbench.sh 0.9.7
    http://bench.centminmod.com
    written by: George Liu (eva2000)
    http://centminmod.com
    -------------------------------------------
    
    -------------------------------------------
    System Information
    -------------------------------------------
    
    3.10.0-862.14.4.el7.x86_64
    
    CentOS Linux release 7.5.1804 (Core) 
    
    Centmin Mod 
    ----------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 85
    Model name:            Intel Xeon Processor (Skylake, IBRS)
    Stepping:              4
    CPU MHz:               2294.596
    BogoMIPS:              4589.19
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 pku ospke spec_ctrl intel_stibp
    
    CPU Flags
     fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 pku ospke spec_ctrl intel_stibp
    
    ----------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
    0   0    0      0    0:0:0      yes
    1   0    0      1    1:1:1      yes
    2   0    0      2    2:2:2      yes
    3   0    0      3    3:3:3      yes
    
    ----------------------------------------------
                  total        used        free      shared  buff/cache   available
    Mem:          15885         842       14574          11         469       14744
    Low:          15885        1311       14574
    High:             0           0           0
    Swap:          1023           0        1023
    
    ----------------------------------------------
    Filesystem               Size  Used Avail Use% Mounted on
    /dev/mapper/centos-root   80G  6.7G   73G   9% /
    devtmpfs                 7.8G     0  7.8G   0% /dev
    tmpfs                    7.8G     0  7.8G   0% /dev/shm
    tmpfs                    7.8G  8.5M  7.8G   1% /run
    tmpfs                    7.8G     0  7.8G   0% /sys/fs/cgroup
    /dev/vda1                485M  177M  309M  37% /boot
    tmpfs                    1.6G     0  1.6G   0% /run/user/0
    tmpfs                    7.8G  332K  7.8G   1% /tmp
    
    
    Code:
    -------------------------------------------
    disk ioping tests
    -------------------------------------------
    
    
    Running IOPing I/O benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=1 time=115 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=2 time=256 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=3 time=282 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=4 time=283 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=5 time=297 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=6 time=229 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=7 time=252 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=8 time=309 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=9 time=254 us
    4.0 KiB from . (xfs /dev/mapper/centos-root): request=10 time=290 us
    
    --- . (xfs /dev/mapper/centos-root) ioping statistics ---
    10 requests completed in 9.0 s, 3.9 k iops, 15.2 MiB/s
    min/avg/max/mdev = 115 us / 256 us / 309 us / 52 us
    
    IOPing seek rate: ./ioping -RD .
    
    --- . (xfs /dev/mapper/centos-root) ioping statistics ---
    50.9 k requests completed in 3.0 s, 17.1 k iops, 66.8 MiB/s
    min/avg/max/mdev = 48 us / 58 us / 2.8 ms / 26 us
    
    IOPing sequential: ./ioping -RL .
    
    --- . (xfs /dev/mapper/centos-root) ioping statistics ---
    12.5 k requests completed in 3.0 s, 4.6 k iops, 1.1 GiB/s
    min/avg/max/mdev = 147 us / 218 us / 1.9 ms / 28 us
    
    IOPing cached: ./ioping -RC .
    
    --- . (xfs /dev/mapper/centos-root) ioping statistics ---
    3.3 M requests completed in 3.0 s, 1.2 M iops, 4.6 GiB/s
    min/avg/max/mdev = 0 us / 0 us / 41 us / 0 us
    
    
    Code:
    -------------------------------------------
    disk DD tests
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 0.776992 s, 1.4 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 0.588743 s, 1.8 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 1.33759 s, 803 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 5.7759 s, 186 MB/s
    
    Code:
    -------------------------------------------
    disk FIO tests
    -------------------------------------------
    
    
    Running FIO benchmark...
    
    FIO_VERSION = fio-2.0.9
    
    FIO random reads: 
    randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    randomreads: Laying out IO file(s) (1 file(s) / 1024MB)
    
    randomreads: (groupid=0, jobs=1): err= 0: pid=31902: Sun Nov 25 03:53:43 2018
      read : io=1024.3MB, bw=646626KB/s, iops=161656 , runt=  1622msec
      cpu          : usr=6.97%, sys=70.94%, ctx=12728, majf=0, minf=85
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
       READ: io=1024.3MB, aggrb=646626KB/s, minb=646626KB/s, maxb=646626KB/s, mint=1622msec, maxt=1622msec
    
    Disk stats (read/write):
        dm-0: ios=256811/0, merge=0/0, ticks=82205/0, in_queue=82206, util=94.07%, aggrios=262207/0, aggrmerge=0/0, aggrticks=84026/0, aggrin_queue=83971, aggrutil=93.05%
      vda: ios=262207/0, merge=0/0, ticks=84026/0, in_queue=83971, util=93.05%
    
    FIO random writes: 
    randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    
    randomwrites: (groupid=0, jobs=1): err= 0: pid=31907: Sun Nov 25 03:53:49 2018
      write: io=1024.3MB, bw=180397KB/s, iops=45099 , runt=  5814msec
      cpu          : usr=3.44%, sys=24.08%, ctx=51916, majf=0, minf=20
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
      WRITE: io=1024.3MB, aggrb=180396KB/s, minb=180396KB/s, maxb=180396KB/s, mint=5814msec, maxt=5814msec
    
    Disk stats (read/write):
        dm-0: ios=9/256095, merge=0/0, ticks=16/356145, in_queue=356164, util=98.31%, aggrios=9/262294, aggrmerge=0/68, aggrticks=16/365308, aggrin_queue=365328, aggrutil=98.06%
      vda: ios=9/262294, merge=0/68, ticks=16/365308, in_queue=365328, util=98.06%
    
    
    Code:
    -------------------------------------------
    ramdisk DD tests - memory bandwidth
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.0577286 s, 2.3 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.0635906 s, 2.1 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.0566042 s, 2.4 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.0621852 s, 2.2 GB/s
    
    Code:
    -------------------------------------------
    ramdisk ioping tests - memory bandwidth
    -------------------------------------------
    
    
    Running IOPing I/O ramdisk benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4.0 KiB from . (tmpfs tmpfs): request=1 time=1 us
    4.0 KiB from . (tmpfs tmpfs): request=2 time=7 us
    4.0 KiB from . (tmpfs tmpfs): request=3 time=5 us
    4.0 KiB from . (tmpfs tmpfs): request=4 time=4 us
    4.0 KiB from . (tmpfs tmpfs): request=5 time=5 us
    4.0 KiB from . (tmpfs tmpfs): request=6 time=5 us
    4.0 KiB from . (tmpfs tmpfs): request=7 time=5 us
    4.0 KiB from . (tmpfs tmpfs): request=8 time=5 us
    4.0 KiB from . (tmpfs tmpfs): request=9 time=5 us
    4.0 KiB from . (tmpfs tmpfs): request=10 time=7 us
    
    --- . (tmpfs tmpfs) ioping statistics ---
    10 requests completed in 9.0 s, 204.1 k iops, 797.2 MiB/s
    min/avg/max/mdev = 1 us / 4 us / 7 us / 1 us
    
    IOPing seek rate: ./ioping -R .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    1.9 M requests completed in 3.0 s, 1.3 M iops, 4.9 GiB/s
    min/avg/max/mdev = 0 us / 0 us / 172 us / 0 us
    
    IOPing sequential: ./ioping -RL .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    51.1 k requests completed in 3.0 s, 25.4 k iops, 6.2 GiB/s
    min/avg/max/mdev = 25 us / 39 us / 133 us / 3 us
    
    IOPing cached: ./ioping -RC .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    3.4 M requests completed in 3.0 s, 1.2 M iops, 4.7 GiB/s
    min/avg/max/mdev = 0 us / 0 us / 294 us / 0 us
    
    
    Code:
    
    -------------------------------------------
    Running bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Download Cachefly: 137MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Download Linode, Atlanta, GA, USA: 2.92MB/s
    ----------------------------------------------
    Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Download Linode, Dallas, TX, USA: 168MB/s
    ----------------------------------------------
    Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Download Leaseweb, Manassas, VA, USA: 83.9MB/s
    ----------------------------------------------
    Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Seattle, WA, USA: 48.9MB/s
    ----------------------------------------------
    Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, San Jose, CA, USA: 47.4MB/s
    ----------------------------------------------
    Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Washington, DC, USA: 53.7MB/s
    ----------------------------------------------
    Download from VersaWeb, Las Vegas, Nevada (http://lg.las1.as53340.net/100MB.test)
    Download VersaWeb, Las Vegas, Nevada: 11.7MB/s
    ----------------------------------------------
    Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Download OVH, BHS, Canada: 24.9MB/s
    ----------------------------------------------
    Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Los Angeles, California: 79.4MB/s
    ----------------------------------------------
    Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Seattle, Washington: 43.5MB/s
    ----------------------------------------------
    Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Dallas, Texas: 608MB/s
    ----------------------------------------------
    Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Chicago, Illinois: 87.5MB/s
    ----------------------------------------------
    Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Atlanta, Georgia: 114MB/s
    ----------------------------------------------
    Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Miami, Florida: 79.4MB/s
    ----------------------------------------------
    Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, New York / New Jersey: 54.7MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Download Linode, Tokyo, JP: 11.2MB/s
    ----------------------------------------------
    Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Singapore: 11.4MB/s
    ----------------------------------------------
    Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Tokyo, Japan: 15.8MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Download Linode, London, UK: 20.3MB/s
    ----------------------------------------------
    Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Download OVH, Paris, France: 22.2MB/s
    ----------------------------------------------
    Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Download SmartDC, Rotterdam, Netherlands: 8.87MB/s
    ----------------------------------------------
    Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Amsterdam, Netherlands: 20.0MB/s
    ----------------------------------------------
    Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, London, UK: 21.0MB/s
    ----------------------------------------------
    Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Paris, France: 19.8MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Sydney, Australia: 11.6MB/s
    
    Code:
    
    -------------------------------------------
    Running Axel multi-threaded bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Axel Download Cachefly: 251.57MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Axel Download Linode, Atlanta, GA, USA: 30.60MB/s
    ----------------------------------------------
    Axel Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Axel Download Linode, Dallas, TX, USA: 210.78MB/s
    ----------------------------------------------
    Axel Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Axel Download Leaseweb, Manassas, VA, USA: 62.16MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Seattle, WA, USA: 36.26MB/s
    ----------------------------------------------
    Axel Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, San Jose, CA, USA: 46.47MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Washington, DC, USA: 49.40MB/s
    ----------------------------------------------
    Axel Download from VersaWeb, Las Vegas, Nevada (http://lg.las1.as53340.net/100MB.test)
    Axel Download VersaWeb, Las Vegas, Nevada: 37.59MB/s
    ----------------------------------------------
    Axel Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, BHS, Canada: 30.38MB/s
    ----------------------------------------------
    Axel Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Los Angeles, California: 55.32MB/s
    ----------------------------------------------
    Axel Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Seattle, Washington: 36.10MB/s
    ----------------------------------------------
    Axel Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Dallas, Texas: 92.29MB/s
    ----------------------------------------------
    Axel Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Chicago, Illinois: 47.39MB/s
    ----------------------------------------------
    Axel Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Atlanta, Georgia: 37.49MB/s
    ----------------------------------------------
    Axel Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Miami, Florida: 59.22MB/s
    ----------------------------------------------
    Axel Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, New York / New Jersey: 46.95MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Axel Download Linode, Tokyo, JP: 23.02MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Singapore: 8.55MB/s
    ----------------------------------------------
    Axel Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Tokyo, Japan: 17.05MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Axel Download Linode, London, UK: 32.32MB/s
    ----------------------------------------------
    Axel Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, Paris, France: 19.85MB/s
    ----------------------------------------------
    Axel Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Axel Download SmartDC, Rotterdam, Netherlands: 10.22MB/s
    ----------------------------------------------
    Axel Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Amsterdam, Netherlands: 18.15MB/s
    ----------------------------------------------
    Axel Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, London, UK: 17.41MB/s
    ----------------------------------------------
    Axel Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Paris, France: 26.65MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Sydney, Australia: 12.60MB/s
    
    Code:
    
    -------------------------------------------
    Running ping tests...
    -------------------------------------------
    
    ----------------------------------------------
    Pings (cachefly.cachefly.net):
    PING vip1.g5.cachefly.net (205.234.175.175) 56(84) bytes of data.
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=1 ttl=59 time=0.442 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=2 ttl=59 time=0.484 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=3 ttl=59 time=0.501 ms
    
    --- vip1.g5.cachefly.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 0.442/0.475/0.501/0.035 ms
    
    ----------------------------------------------
    Pings (syd-au-ping.vultr.com):
    PING syd-au-ping.vultr.com (108.61.212.117) 56(84) bytes of data.
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=1 ttl=50 time=201 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=2 ttl=50 time=201 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=3 ttl=50 time=201 ms
    
    --- syd-au-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 201.686/201.732/201.782/0.039 ms
    
    ----------------------------------------------
    Pings (hnd-jp-ping.vultr.com):
    PING hnd-jp-ping.vultr.com (108.61.201.151) 56(84) bytes of data.
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=1 ttl=51 time=146 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=2 ttl=51 time=146 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=3 ttl=51 time=147 ms
    
    --- hnd-jp-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 146.856/146.950/147.018/0.068 ms
    
    ----------------------------------------------
    Pings (lax-ca-us-ping.vultr.com):
    PING lax-ca-us-ping.vultr.com (108.61.219.200) 56(84) bytes of data.
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=1 ttl=55 time=29.9 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=2 ttl=55 time=29.9 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=3 ttl=55 time=29.7 ms
    
    --- lax-ca-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 29.746/29.875/29.975/0.095 ms
    
    ----------------------------------------------
    Pings (wa-us-ping.vultr.com):
    PING wa-us-ping.vultr.com (108.61.194.105) 56(84) bytes of data.
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=1 ttl=56 time=52.9 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=2 ttl=56 time=52.9 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=3 ttl=56 time=53.0 ms
    
    --- wa-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 52.900/52.973/53.058/0.065 ms
    
    ----------------------------------------------
    Pings (tx-us-ping.vultr.com):
    PING tx-us-ping.vultr.com (108.61.224.175) 56(84) bytes of data.
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=1 ttl=56 time=0.693 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=2 ttl=56 time=0.787 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=3 ttl=56 time=0.739 ms
    
    --- tx-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 0.693/0.739/0.787/0.049 ms
    
    ----------------------------------------------
    Pings (il-us-ping.vultr.com):
    PING il-us-ping.vultr.com (107.191.51.12) 56(84) bytes of data.
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=1 ttl=56 time=27.0 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=2 ttl=56 time=27.1 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=3 ttl=56 time=27.0 ms
    
    --- il-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 27.056/27.082/27.125/0.030 ms
    
    ----------------------------------------------
    Pings (ga-us-ping.vultr.com):
    PING ga-us-ping.vultr.com (108.61.193.166) 56(84) bytes of data.
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=1 ttl=54 time=20.7 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=2 ttl=54 time=20.7 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=3 ttl=54 time=20.6 ms
    
    --- ga-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 20.664/20.697/20.717/0.023 ms
    
    ----------------------------------------------
    Pings (fl-us-ping.vultr.com):
    PING fl-us-ping.vultr.com (104.156.244.232) 56(84) bytes of data.
    64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=1 ttl=56 time=29.6 ms
    64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=2 ttl=56 time=29.7 ms
    64 bytes from 104.156.244.232 (104.156.244.232): icmp_seq=3 ttl=56 time=29.6 ms
    
    --- fl-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 29.608/29.647/29.726/0.206 ms
    
    ----------------------------------------------
    Pings (nj-us-ping.vultr.com):
    PING nj-us-ping.vultr.com (108.61.149.182) 56(84) bytes of data.
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=1 ttl=49 time=41.7 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=2 ttl=49 time=41.8 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=3 ttl=49 time=41.7 ms
    
    --- nj-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 41.729/41.791/41.855/0.174 ms
    
    ----------------------------------------------
    Pings (fra-de-ping.vultr.com):
    PING fra-de-ping.vultr.com (108.61.210.117) 56(84) bytes of data.
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=1 ttl=56 time=128 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=2 ttl=56 time=128 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=3 ttl=56 time=128 ms
    
    --- fra-de-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 128.484/128.543/128.576/0.416 ms
    
    ----------------------------------------------
    Pings (ams-nl-ping.vultr.com):
    PING ams-nl-ping.vultr.com (108.61.198.102) 56(84) bytes of data.
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=1 ttl=53 time=114 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=2 ttl=53 time=114 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=3 ttl=53 time=114 ms
    
    --- ams-nl-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 114.126/114.236/114.388/0.111 ms
    
    ----------------------------------------------
    Pings (lon-gb-ping.vultr.com):
    PING lon-gb-ping.vultr.com (108.61.196.101) 56(84) bytes of data.
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=1 ttl=52 time=108 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=2 ttl=52 time=109 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=3 ttl=52 time=109 ms
    
    --- lon-gb-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 108.975/109.301/109.831/0.537 ms
    
    ----------------------------------------------
    Pings (par-fr-ping.vultr.com):
    PING par-fr-ping.vultr.com (108.61.209.127) 56(84) bytes of data.
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=1 ttl=56 time=116 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=2 ttl=56 time=116 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=3 ttl=56 time=116 ms
    
    --- par-fr-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2225ms
    rtt min/avg/max/mdev = 116.040/116.082/116.111/0.279 ms
    
    ----------------------------------------------
    Pings (VersaWeb Las Vegas):
    PING 104.143.15.254 (104.143.15.254) 56(84) bytes of data.
    From 192.228.109.45 icmp_seq=1 Time to live exceeded
    From 192.228.109.45 icmp_seq=2 Time to live exceeded
    From 192.228.109.45 icmp_seq=3 Time to live exceeded
    
    --- 104.143.15.254 ping statistics ---
    3 packets transmitted, 0 received, +3 errors, 100% packet loss, time 2002ms
    
    
    ----------------------------------------------
    Pings (VersaWeb Seattle):
    PING 76.164.234.1 (76.164.234.1) 56(84) bytes of data.
    64 bytes from 76.164.234.1: icmp_seq=1 ttl=57 time=52.9 ms
    64 bytes from 76.164.234.1: icmp_seq=2 ttl=57 time=52.9 ms
    64 bytes from 76.164.234.1: icmp_seq=3 ttl=57 time=53.0 ms
    
    --- 76.164.234.1 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 52.962/52.985/53.009/0.266 ms
    
    ----------------------------------------------
    Pings (OVH Canada):
    PING bhs.proof.ovh.net (192.99.19.165) 56(84) bytes of data.
    64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=1 ttl=54 time=36.1 ms
    64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=2 ttl=54 time=36.1 ms
    64 bytes from bhs.proof.ovh.net (192.99.19.165): icmp_seq=3 ttl=54 time=36.0 ms
    
    --- bhs.proof.ovh.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 36.078/36.105/36.123/0.156 ms
    
    ----------------------------------------------
    Pings (10gbps.io Frankfurt):
    PING 195.181.174.20 (195.181.174.20) 56(84) bytes of data.
    64 bytes from 195.181.174.20: icmp_seq=1 ttl=57 time=121 ms
    64 bytes from 195.181.174.20: icmp_seq=2 ttl=57 time=121 ms
    64 bytes from 195.181.174.20: icmp_seq=3 ttl=57 time=121 ms
    
    --- 195.181.174.20 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 121.862/121.869/121.877/0.285 ms
    
    ----------------------------------------------
    Pings (10gbps.io London):
    PING 185.59.221.20 (185.59.221.20) 56(84) bytes of data.
    64 bytes from 185.59.221.20: icmp_seq=1 ttl=55 time=110 ms
    64 bytes from 185.59.221.20: icmp_seq=2 ttl=55 time=110 ms
    64 bytes from 185.59.221.20: icmp_seq=3 ttl=55 time=110 ms
    
    --- 185.59.221.20 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 110.539/110.580/110.608/0.273 ms
    
    ----------------------------------------------
    Pings (10gbps.io Paris):
    PING 185.93.2.193 (185.93.2.193) 56(84) bytes of data.
    64 bytes from 185.93.2.193: icmp_seq=1 ttl=55 time=130 ms
    64 bytes from 185.93.2.193: icmp_seq=2 ttl=55 time=129 ms
    64 bytes from 185.93.2.193: icmp_seq=3 ttl=55 time=130 ms
    
    --- 185.93.2.193 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 129.969/130.021/130.079/0.045 ms
    
    ----------------------------------------------
    Pings (10gbps.io Singapore):
    PING 203.174.85.38 (203.174.85.38) 56(84) bytes of data.
    64 bytes from 203.174.85.38: icmp_seq=1 ttl=55 time=213 ms
    64 bytes from 203.174.85.38: icmp_seq=2 ttl=55 time=213 ms
    64 bytes from 203.174.85.38: icmp_seq=3 ttl=55 time=213 ms
    
    --- 203.174.85.38 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2000ms
    rtt min/avg/max/mdev = 213.846/213.861/213.891/0.378 ms
    
    ----------------------------------------------
    Pings (10gbps.io Stockholm):
    PING 185.76.9.10 (185.76.9.10) 56(84) bytes of data.
    64 bytes from 185.76.9.10: icmp_seq=1 ttl=55 time=140 ms
    64 bytes from 185.76.9.10: icmp_seq=2 ttl=55 time=140 ms
    64 bytes from 185.76.9.10: icmp_seq=3 ttl=55 time=140 ms
    
    --- 185.76.9.10 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 140.046/140.080/140.104/0.306 ms
    
    ----------------------------------------------
    Pings (10gbps.io Moscow):
    PING 87.245.204.20 (87.245.204.20) 56(84) bytes of data.
    64 bytes from 87.245.204.20: icmp_seq=1 ttl=57 time=159 ms
    64 bytes from 87.245.204.20: icmp_seq=2 ttl=57 time=159 ms
    64 bytes from 87.245.204.20: icmp_seq=3 ttl=57 time=159 ms
    
    --- 87.245.204.20 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 159.641/159.688/159.719/0.033 ms
    
    ----------------------------------------------
    Pings (10gbps.io Miami):
    PING 195.181.162.195 (195.181.162.195) 56(84) bytes of data.
    64 bytes from 195.181.162.195: icmp_seq=1 ttl=56 time=35.1 ms
    64 bytes from 195.181.162.195: icmp_seq=2 ttl=56 time=34.8 ms
    64 bytes from 195.181.162.195: icmp_seq=3 ttl=56 time=34.8 ms
    
    --- 195.181.162.195 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2003ms
    rtt min/avg/max/mdev = 34.811/34.955/35.194/0.228 ms
    
    
    Code:
    
    -------------------------------------------
    Running mtr tests...
    -------------------------------------------
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 cachefly.cachefly.net
    Start: Sun Nov 25 03:59:00 2018
    HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                    0.0%    10    0.7   0.9   0.7   1.1   0.0
      2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                     0.0%    10    0.5   0.5   0.5   0.6   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    1.8   5.2   0.5  11.5   4.3
      5.|-- et-0-0-67.cr10-dal3.ip4.gtt.net  0.0%    10    0.6   1.0   0.5   5.0   1.2
      6.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      7.|-- vip1.G-anycast1.cachefly.net     0.0%    10    0.5   0.5   0.5   0.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.atlanta.linode.com
    Start: Sun Nov 25 03:59:15 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    1.8   1.0   0.7   1.8   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                   0.0%    10    0.5   2.5   0.4  19.9   6.1
      4.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.5   1.2   0.4   6.2   1.7
      5.|-- xe-0-3-0.cr1-atl1.ip4.gtt.net  0.0%    10   18.4  19.5  18.3  23.5   1.7
      6.|-- ip4.gtt.net                    0.0%    10   20.3  19.1  18.8  20.3   0.5
      7.|-- 74.207.239.7                   0.0%    10   19.8  19.2  18.7  21.3   0.7
      8.|-- speedtest.atlanta.linode.com   0.0%    10   18.9  18.7  18.5  18.9   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.dallas.linode.com
    Start: Sun Nov 25 03:59:31 2018
    HOST: hostname              Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                0.0%    10    1.0   1.1   0.8   2.4   0.3
      2.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                 0.0%    10    0.5   3.3   0.5  27.8   8.6
      4.|-- eqix-ix-da.linode.com        0.0%    10    1.4   1.4   1.3   1.5   0.0
      5.|-- 45.79.12.3                   0.0%    10    1.5   1.6   1.4   1.8   0.0
      6.|-- speedtest.dallas.linode.com  0.0%    10    1.2   1.2   1.2   1.3   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 mirror.us.leaseweb.net
    Start: Sun Nov 25 03:59:49 2018
    HOST: hostname                   Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                     0.0%    10    0.8   1.0   0.7   2.5   0.3
      2.|-- ???                              100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                      0.0%    10    0.7   0.6   0.5   0.7   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net        0.0%    10    0.8   1.7   0.5   6.2   2.0
      5.|-- xe-1-2-0.cr0-was1.ip4.gtt.net     0.0%    10   36.4  36.4  36.3  37.1   0.0
      6.|-- ip4.gtt.net                       0.0%    10   33.7  33.8  33.6  34.2   0.0
      7.|-- po-6.ce01.wdc-01.us.leaseweb.net  0.0%    10   33.8  33.7  33.6  34.0   0.0
      8.|-- 207.244.94.80                     0.0%    10   33.8  33.7  33.6  33.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.sea01.softlayer.com
    Start: Sun Nov 25 04:00:05 2018
    HOST: hostname                          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    0.9   1.3   0.7   3.4   0.7
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                             0.0%    10    0.5   0.5   0.5   0.6   0.0
      4.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.6   2.9   0.6  23.3   7.1
      5.|-- ae5.cbs01.eq01.dal03.networklayer.com   10.0%    10    1.4   1.7   1.4   3.5   0.5
      6.|-- ae1.cbs01.cs01.den01.networklayer.com    0.0%    10   17.5  18.1  17.4  23.0   1.7
      7.|-- ae0.cbs01.wb01.sea02.networklayer.com    0.0%    10   45.3  45.4  45.1  46.4   0.0
      8.|-- 77.12.2da9.ip4.static.sl-reverse.com     0.0%    10   44.8  44.7  44.6  44.8   0.0
      9.|-- ae0.dar01.sr01.sea01.networklayer.com    0.0%    10   42.3  42.3  42.3  42.4   0.0
     10.|-- po1.fcr01.sr01.sea01.networklayer.com    0.0%    10   42.8  42.8  42.5  43.3   0.0
     11.|-- speedtest.sea01.softlayer.com            0.0%    10   42.3  42.3  42.3  42.3   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.sjc01.softlayer.com
    Start: Sun Nov 25 04:00:21 2018
    HOST: hostname                          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    1.0   1.0   0.8   1.4   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                             0.0%    10    0.6   2.2   0.5  17.2   5.2
      4.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.6   0.7   0.6   1.2   0.0
      5.|-- ae5.cbs01.eq01.dal03.networklayer.com   30.0%    10    1.6   1.7   1.5   1.9   0.0
      6.|-- ae8.cbs01.dr01.dal04.networklayer.com   10.0%    10    2.0   2.0   1.9   2.3   0.0
      7.|-- ae2.cbs01.cs01.lax01.networklayer.com    0.0%    10   30.9  31.2  30.6  33.9   0.9
      8.|-- ae7.cbs02.cs01.lax01.networklayer.com    0.0%    10   38.4  32.8  32.0  38.4   2.0
      9.|-- ae0.cbs02.eq01.sjc02.networklayer.com    0.0%    10   42.9  43.4  42.9  45.0   0.5
     10.|-- ae24.bbr02.eq01.sjc02.networklayer.com   0.0%    10   40.7  40.6  40.5  40.8   0.0
     11.|-- ae6.dar01.sjc01.networklayer.com         0.0%    10   40.6  40.6  40.6  40.7   0.0
     12.|-- po1.fcr01.sr01.sjc01.networklayer.com    0.0%    10   75.9  57.3  41.3 150.9  34.8
     13.|-- speedtest.sjc01.softlayer.com            0.0%    10   40.6  40.6  40.6  40.7   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.wdc01.softlayer.com
    Start: Sun Nov 25 04:00:37 2018
    HOST: hostname                          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    0.7   0.9   0.7   1.8   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                             0.0%    10    1.0   0.9   0.4   3.6   0.9
      4.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.5   0.6   0.5   0.6   0.0
      5.|-- ae5.cbs02.eq01.dal03.networklayer.com   80.0%    10    2.8   2.1   1.5   2.8   0.0
      6.|-- ae0.cbs01.tl01.atl01.networklayer.com    0.0%    10   20.6  20.6  20.5  21.0   0.0
      7.|-- ae0.cbs01.eq01.wdc02.networklayer.com   10.0%    10   32.8  33.0  32.7  33.4   0.0
      8.|-- ae29.bbr02.eq01.wdc02.networklayer.com   0.0%    10   29.8  31.6  29.5  49.2   6.2
      9.|-- ae1.dar01.wdc01.networklayer.com         0.0%    10   30.9  31.1  30.9  33.1   0.7
     10.|-- po1.fcr01.sr01.wdc01.networklayer.com    0.0%    10   31.4  31.4  31.3  31.6   0.0
     11.|-- speedtest.wdc01.softlayer.com            0.0%    10  142.3 173.8 126.4 214.0  24.6
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.tokyo.linode.com
    Start: Sun Nov 25 04:00:53 2018
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                   0.0%    10    0.9   1.1   0.8   1.9   0.0
      2.|-- ???                            100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                    0.0%    10   21.2   2.6   0.5  21.2   6.5
      4.|-- ae32.cr11-dal3.ip4.gtt.net      0.0%    10    2.7   3.6   0.6   9.2   2.8
      5.|-- et-0-0-67.cr4-lax2.ip4.gtt.net  0.0%    10   43.3  34.0  32.1  43.3   3.7
      6.|-- ip4.gtt.net                     0.0%    10   32.1  32.3  32.0  34.0   0.5
      7.|-- lacGCS002.int-gw.kddi.ne.jp     0.0%    10   31.2  28.5  27.4  32.7   1.9
      8.|-- 106.187.12.33                   0.0%    10  142.3 143.0 142.0 143.9   0.3
      9.|-- 27.85.134.142                   0.0%    10  133.9 133.9 133.8 133.9   0.0
     10.|-- cm-fcu204.kddnet.ad.jp          0.0%    10  136.1 139.1 134.8 147.3   4.8
     11.|-- 124.215.199.170                 0.0%    10  135.0 135.0 134.9 135.0   0.0
     12.|-- speedtest.tokyo.linode.com      0.0%    10  145.9 145.5 145.3 145.9   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.sng01.softlayer.com
    Start: Sun Nov 25 04:01:11 2018
    HOST: hostname                          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    1.3   1.0   0.7   1.3   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                             0.0%    10    0.5   0.6   0.5   0.6   0.0
      4.|-- te1-5.bbr01.eq01.dal01.networklayer.com  0.0%    10    0.6   0.7   0.6   1.1   0.0
      5.|-- ae5.cbs01.eq01.dal03.networklayer.com   80.0%    10    1.7   1.6   1.6   1.7   0.0
      6.|-- ae8.cbs01.dr01.dal04.networklayer.com   50.0%    10    2.0   2.7   1.8   5.0   1.1
      7.|-- ae2.cbs01.cs01.lax01.networklayer.com   70.0%    10   30.7  30.8  30.7  30.8   0.0
      8.|-- ae7.cbs02.cs01.lax01.networklayer.com   10.0%    10   32.2  32.4  31.9  34.0   0.4
      9.|-- ae0.cbs02.eq01.sjc02.networklayer.com   50.0%    10   41.0  41.2  41.0  41.4   0.0
     10.|-- b.12.2da9.ip4.static.sl-reverse.com      0.0%    10  142.8 143.6 142.7 150.7   2.4
     11.|-- ae7.cbs01.eq01.tok01.networklayer.com    0.0%    10  140.0 140.0 139.8 140.6   0.0
     12.|-- ae0.cbs01.eq01.sng02.networklayer.com    0.0%    10  203.3 202.6 202.0 204.5   0.6
     13.|-- af.13.2da9.ip4.static.sl-reverse.com     0.0%    10  198.4 200.6 198.4 217.3   5.8
     14.|-- ae6.dar02.sr03.sng01.networklayer.com    0.0%    10  201.8 202.6 201.7 210.7   2.7
     15.|-- po2.fcr01.sr03.sng01.networklayer.com    0.0%    10  201.3 201.3 201.2 201.7   0.0
     16.|-- speedtest.sng01.softlayer.com            0.0%    10  201.3 201.3 201.3 201.4   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 speedtest.london.linode.com
    Start: Sun Nov 25 04:01:27 2018
    HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                    0.0%    10    0.9   1.0   0.8   1.5   0.0
      2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                     0.0%    10    0.5   2.1   0.5  15.7   4.7
      4.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.5   3.7   0.5  21.2   6.5
      5.|-- et-0-0-55.cr11-lon2.ip4.gtt.net  0.0%    10  108.4 108.3 107.9 108.7   0.0
      6.|-- ip4.gtt.net                      0.0%    10  108.8 110.5 108.7 126.1   5.4
      7.|-- 109.74.207.17                    0.0%    10  109.0 109.0 109.0 109.1   0.0
      8.|-- speedtest.london.linode.com      0.0%    10  108.8 108.8 108.7 109.0   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 mirror.i3d.net
    Start: Sun Nov 25 04:01:43 2018
    HOST: hostname                      Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    0.9   0.9   0.7   1.1   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                         0.0%    10    0.6   5.3   0.5  48.6  15.2
      4.|-- eqix-da1.misi3d.com                  0.0%    10    0.7   0.7   0.6   0.9   0.0
      5.|-- 10ge.iadr0-dfwr0.csva01.iad.i3d.net  0.0%    10   45.9  36.6  35.5  45.9   3.3
      6.|-- 10ge.lr0-iadr0.th-n.lhr.i3d.net      0.0%    10  123.7 119.8 107.3 141.2  11.8
      7.|-- 30ge.cr1-lr0.smartdc.rtm.i3d.net     0.0%    10  114.3 117.3 114.0 146.8  10.4
      8.|-- 100ge.br3-cr1.smartdc.rtm.i3d.net    0.0%    10  113.9 115.3 113.9 126.9   4.1
      9.|-- hosted-by.i3d.net                    0.0%    10  113.6 113.5 113.5 113.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 syd-au-ping.vultr.com
    Start: Sun Nov 25 04:02:01 2018
    HOST: hostname                          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                            0.0%    10    0.8   0.9   0.8   1.1   0.0
      2.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                             0.0%    10    0.5   3.2   0.4  27.5   8.5
      4.|-- eqix-da1.vocus.com                       0.0%    10   32.5  32.7  32.5  33.8   0.0
      5.|-- bundle-153.cor02.lax01.ca.vocus.net      0.0%    10  192.6 192.7 192.6 193.2   0.0
      6.|-- 100g-0-0-0-0.cor02.sjc01.ca.vocus.net    0.0%    10  188.6 188.6 188.5 188.9   0.0
      7.|-- 100g-0-0-0-0.cor01.sjc01.ca.vocus.net    0.0%    10  197.0 197.1 197.0 197.2   0.0
      8.|-- BE-200.cor02.syd04.nsw.VOCUS.net.au      0.0%    10  192.7 192.7 192.7 192.8   0.0
      9.|-- bundle-110.bdr01.syd04.nsw.vocus.net.au  0.0%    10  193.0 193.1 192.9 194.0   0.0
     10.|-- static-75.7.255.49.in-addr.VOCUS.net.au  0.0%    10  192.9 192.7 192.6 192.9   0.0
     11.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
     12.|-- 180.189.25.6                            90.0%    10  192.8 192.8 192.8 192.8   0.0
     13.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
     14.|-- ???                                     100.0    10    0.0   0.0   0.0   0.0   0.0
     15.|-- 108.61.212.117.vultr.com                 0.0%    10  197.2 197.1 197.0 197.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 hnd-jp-ping.vultr.com
    Start: Sun Nov 25 04:02:18 2018
    HOST: hostname                             Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                               0.0%    10    1.2   0.9   0.7   1.2   0.0
      2.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                                0.0%    10    0.5   0.5   0.5   0.5   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net                  0.0%    10    0.4   1.0   0.4   5.3   1.4
      5.|-- as2914.cr11-dal3.ip4.gtt.net                0.0%    10    1.0   0.8   0.7   1.1   0.0
      6.|-- ae-1.r23.dllstx09.us.bb.gin.ntt.net         0.0%    10    0.9   1.4   0.8   3.6   0.9
      7.|-- ae-8.r23.snjsca04.us.bb.gin.ntt.net         0.0%    10   52.4  39.1  37.3  52.4   4.7
      8.|-- ae-21.r30.tokyjp05.jp.bb.gin.ntt.net        0.0%    10  143.6 152.1 143.6 216.7  22.8
      9.|-- ae-2.r02.tokyjp05.jp.bb.gin.ntt.net         0.0%    10  144.1 143.9 143.8 144.1   0.0
     10.|-- ce-0-14-0-1.r02.tokyjp05.jp.ce.gin.ntt.net  0.0%    10  156.3 150.5 144.7 163.8   6.7
     11.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
     12.|-- vl516-ds1-b5-r2605.tyo1.choopa.net          0.0%    10  137.0 137.1 137.0 137.3   0.0
     13.|-- ???                                        100.0    10    0.0   0.0   0.0   0.0   0.0
     14.|-- 108.61.201.151.vultr.com                    0.0%    10  146.9 146.9 146.8 147.0   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 lax-ca-us-ping.vultr.com
    Start: Sun Nov 25 04:02:34 2018
    HOST: hostname                         Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                           0.0%    10    0.9   0.9   0.7   1.1   0.0
      2.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                            0.0%    10    0.5   0.5   0.5   0.6   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net              0.0%    10    0.8   1.6   0.5   9.0   2.6
      5.|-- et-0-0-71.cr10-dal3.ip4.gtt.net         0.0%    10    0.7   2.3   0.6   8.0   2.5
      6.|-- as3356.ip4.gtt.net                      0.0%    10    1.1   1.0   0.9   1.1   0.0
      7.|-- ae-1-51.ear1.LosAngeles6.Level3.net    80.0%    10   34.8  34.8  34.8  34.8   0.0
      8.|-- CHOOPA-LLC.ear1.LosAngeles6.Level3.net 10.0%    10   30.4  30.6  30.4  31.0   0.0
      9.|-- 10.68.0.34                              0.0%    10   46.7  36.3  32.9  46.7   5.5
     10.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
     11.|-- 108.61.219.200.vultr.com                0.0%    10   30.0  30.0  29.9  30.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 wa-us-ping.vultr.com
    Start: Sun Nov 25 04:02:50 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.9   0.9   0.7   1.1   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                   0.0%    10    0.5   4.2   0.5  37.1  11.5
      4.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    1.1   0.7   0.5   1.3   0.0
      5.|-- et-2-3-0.cr3-sea2.ip4.gtt.net  0.0%    10   53.0  53.1  52.9  54.0   0.0
      6.|-- choopa-gw.ip4.gtt.net         30.0%    10   53.0  53.1  53.0  53.3   0.0
      7.|-- 10.69.0.50                     0.0%    10   56.2  56.7  56.1  61.1   1.5
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 108.61.194.105.vultr.com       0.0%    10   53.1  53.1  53.1  53.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 tx-us-ping.vultr.com
    Start: Sun Nov 25 04:03:06 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.9   0.9   0.7   1.1   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                   0.0%    10    0.5   4.5   0.5  39.7  12.3
      4.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.5   1.8   0.5   7.8   2.2
      5.|-- xe-7-2-0.cr0-dal2.ip4.gtt.net  0.0%    10    0.6   8.4   0.6  56.2  17.8
      6.|-- ip4.gtt.net                   10.0%    10   26.6   7.6   1.2  26.6   9.8
      7.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 108.61.224.175.vultr.com       0.0%    10    0.8   0.8   0.7   1.0   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 il-us-ping.vultr.com
    Start: Sun Nov 25 04:03:22 2018
    HOST: hostname                     Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                       0.0%    10    0.7   1.0   0.7   2.9   0.6
      2.|-- ???                                100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                        0.0%    10    0.5   1.1   0.5   6.3   1.7
      4.|-- ae32.cr11-dal3.ip4.gtt.net          0.0%    10    0.5   2.0   0.5  10.7   3.2
      5.|-- xe-4-1-2.cr1-chi1.ip4.gtt.net       0.0%    10   26.1  26.1  26.1  26.2   0.0
      6.|-- ip4.gtt.net                        10.0%    10   28.7  28.9  28.1  29.5   0.0
      7.|-- vl820-ds1-b5-gj178.chi2.choopa.net  0.0%    10   27.3  27.9  27.3  31.8   1.2
      8.|-- ???                                100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 107.191.51.12.vultr.com             0.0%    10   27.1  27.1  27.1  27.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 ga-us-ping.vultr.com
    Start: Sun Nov 25 04:03:39 2018
    HOST: hostname                       Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                         0.0%    10    0.7   0.9   0.7   1.1   0.0
      2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                          0.0%    10    0.5   0.5   0.5   0.5   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    4.9   2.0   0.4   9.7   2.9
      5.|-- et-0-0-49.cr10-dal3.ip4.gtt.net       0.0%    10    0.7   2.9   0.5  15.6   5.0
      6.|-- as3356.ip4.gtt.net                    0.0%    10    1.2   1.7   0.9   8.5   2.3
      7.|-- ae-2-3513.edge1.Atlanta4.Level3.net   0.0%    10   20.2  19.5  19.3  20.2   0.0
      8.|-- CHOOPA-LLC.edge1.Atlanta4.Level3.net  0.0%    10   20.6  22.7  20.6  29.9   2.9
      9.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
     11.|-- 108.61.193.166.vultr.com              0.0%    10   20.7  20.7  20.6  21.1   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 fl-us-ping.vultr.com
    Start: Sun Nov 25 04:03:55 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.8   0.9   0.7   1.3   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                   0.0%    10    0.5   0.6   0.5   0.6   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    5.9   1.1   0.5   5.9   1.6
      5.|-- xe-7-0-7.cr2-mia1.ip4.gtt.net  0.0%    10   48.4  31.4  29.5  48.4   6.0
      6.|-- as20473-gw.mia12.ip4.gtt.net  20.0%    10   31.0  31.9  30.1  42.5   4.3
      7.|-- 10.73.1.26                     0.0%    10   30.2  30.3  30.1  31.1   0.0
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 104.156.244.232                0.0%    10   29.6  29.6  29.6  29.7   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 nj-us-ping.vultr.com
    Start: Sun Nov 25 04:04:11 2018
    HOST: hostname                         Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                           0.0%    10    0.9   0.9   0.7   1.1   0.0
      2.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                            0.0%    10    0.5   1.9   0.4  14.4   4.4
      4.|-- ae32.cr11-dal3.ip4.gtt.net              0.0%    10    0.4   2.3   0.4  11.6   3.7
      5.|-- as2914.cr11-dal3.ip4.gtt.net            0.0%    10    0.7   0.8   0.7   1.1   0.0
      6.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net     0.0%    10    0.9   0.9   0.8   0.9   0.0
      7.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net     0.0%    10   37.6  38.0  37.6  38.5   0.0
      8.|-- ae-5.r25.nycmny01.us.bb.gin.ntt.net     0.0%    10   40.9  40.8  40.8  41.0   0.0
      9.|-- ae-2.r08.nycmny01.us.bb.gin.ntt.net     0.0%    10   40.7  40.8  40.7  41.2   0.0
     10.|-- ae-1.a02.nycmny01.us.bb.gin.ntt.net     0.0%    10   42.2  42.3  40.5  50.1   2.8
     11.|-- ae-1.choopa.nycmny01.us.bb.gin.ntt.net  0.0%    10   42.6  42.6  42.3  43.8   0.0
     12.|-- vl42-br2.pnj1.choopa.net                0.0%    10   42.2  46.6  42.0  52.4   3.5
     13.|-- vl140-c4-3-b5-2.pnj1.choopa.net         0.0%    10   42.9  49.3  42.8  98.8  17.4
     14.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
     15.|-- 108.61.149.182.vultr.com                0.0%    10   41.9  41.8  41.8  41.9   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 fra-de-ping.vultr.com
    Start: Sun Nov 25 04:04:28 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    0.8   1.1   0.7   1.9   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                   0.0%    10    0.5   0.7   0.5   2.5   0.3
      4.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.9   1.1   0.5   2.9   0.7
      5.|-- xe-2-1-2.cr1-fra2.ip4.gtt.net  0.0%    10  125.8 126.0 125.8 126.6   0.0
      6.|-- ip4.gtt.net                    0.0%    10  125.8 128.1 125.8 134.6   3.2
      7.|-- 10.75.0.50                     0.0%    10  129.0 130.8 128.9 138.0   3.4
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 108.61.210.117.vultr.com       0.0%    10  125.9 126.0 125.9 126.4   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 ams-nl-ping.vultr.com
    Start: Sun Nov 25 04:04:44 2018
    HOST: hostname                      Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    0.8   0.9   0.7   1.2   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                         0.0%    10    7.6   1.2   0.4   7.6   2.2
      4.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10    0.7   0.6   0.4   0.8   0.0
      5.|-- as2914.cr11-dal3.ip4.gtt.net         0.0%    10    0.7   0.8   0.7   1.1   0.0
      6.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net  0.0%    10    0.7   0.8   0.6   1.9   0.0
      7.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  0.0%    10   37.6  39.0  37.5  51.4   4.3
      8.|-- ae-0.r23.asbnva02.us.bb.gin.ntt.net  0.0%    10   37.6  38.6  37.5  47.9   3.2
      9.|-- ae-2.r25.amstnl02.nl.bb.gin.ntt.net  0.0%    10  113.7 115.5 113.6 129.9   5.0
     10.|-- ae-1.a02.amstnl02.nl.bb.gin.ntt.net  0.0%    10  115.3 115.9 113.5 125.4   4.3
     11.|-- 81.20.72.122                         0.0%    10  121.9 122.1 117.3 131.0   4.8
     12.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
     13.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
     14.|-- 108.61.198.102.vultr.com             0.0%    10  114.1 114.1 114.1 114.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 lon-gb-ping.vultr.com
    Start: Sun Nov 25 04:05:00 2018
    HOST: hostname                      Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    0.9   0.9   0.7   1.9   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                         0.0%    10    0.5   4.6   0.5  38.6  12.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10    0.7   0.6   0.5   0.9   0.0
      5.|-- as2914.cr11-dal3.ip4.gtt.net         0.0%    10    1.1   0.8   0.6   1.1   0.0
      6.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net  0.0%    10    0.9   1.1   0.9   2.3   0.3
      7.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  0.0%    10   37.5  37.5  37.4  37.7   0.0
      8.|-- ae-5.r25.nycmny01.us.bb.gin.ntt.net  0.0%    10   40.8  41.2  40.8  41.9   0.0
      9.|-- ae-1.r24.nycmny01.us.bb.gin.ntt.net  0.0%    10   42.1  41.5  40.9  42.7   0.5
     10.|-- ae-9.r24.londen12.uk.bb.gin.ntt.net  0.0%    10  109.1 109.2 109.1 109.3   0.0
     11.|-- ae-3.r05.londen12.uk.bb.gin.ntt.net  0.0%    10  109.1 109.1 109.0 109.5   0.0
     12.|-- ae-1.a00.londen12.uk.bb.gin.ntt.net  0.0%    10  109.0 109.3 108.8 111.4   0.7
     13.|-- 5.158.213.46                         0.0%    10  110.7 110.0 109.6 111.5   0.5
     14.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
     15.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
     16.|-- 108.61.196.101.vultr.com             0.0%    10  109.1 109.1 109.1 109.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 par-fr-ping.vultr.com
    Start: Sun Nov 25 04:05:17 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    1.1   1.0   0.8   1.7   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                   0.0%    10    0.5   0.5   0.5   0.6   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    0.7   1.9   0.5   8.0   2.3
      5.|-- xe-2-1-3.cr0-par7.ip4.gtt.net  0.0%    10  116.3 116.8 115.9 124.2   2.5
      6.|-- ip4.gtt.net                    0.0%    10  116.0 117.6 116.0 121.0   2.0
      7.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      8.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- 108.61.209.127.vultr.com       0.0%    10  116.1 116.1 116.0 116.2   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 VersaWeb Las Vegas
    Start: Sun Nov 25 04:05:33 2018
    HOST: hostname                         Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                           0.0%    10    0.6   0.8   0.6   1.0   0.0
      2.|-- ???                                    100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                            0.0%    10    0.5   3.6   0.5  30.8   9.6
      4.|-- 10gigabitethernet3-1.core1.dal1.he.net  0.0%    10    0.5   5.0   0.5  14.7   6.0
      5.|-- 100ge4-2.core1.phx2.he.net             10.0%    10   19.5  19.5  19.4  19.6   0.0
      6.|-- 100ge11-2.core1.lax2.he.net             0.0%    10   35.2  33.3  28.1  39.2   4.6
      7.|-- ve990.core2.las1.he.net                 0.0%    10   35.7  35.7  35.6  35.8   0.0
      8.|-- fiberhub.10ge3-2.core1.las1.he.net      0.0%    10   74.0  41.4  30.7  74.2  18.2
      9.|-- 192.228.109.46                          0.0%    10   30.8  32.0  30.8  42.2   3.6
     10.|-- 192.228.109.49                          0.0%    10   41.0  33.1  30.8  41.0   4.0
     11.|-- 192.228.109.50                          0.0%    10   34.3  36.6  31.0  40.6   2.9
     12.|-- 192.228.109.45                          0.0%    10   56.2  59.1  53.2  64.6   3.7
     13.|-- 192.228.109.46                          0.0%    10   34.5  36.6  30.9  41.8   3.6
     14.|-- 192.228.109.49                          0.0%    10   32.1  34.9  30.9  40.0   3.1
     15.|-- 192.228.109.50                          0.0%    10   30.9  32.5  30.8  38.7   2.5
     16.|-- 192.228.109.45                          0.0%    10   38.4  37.7  30.9  64.5  10.2
     17.|-- 192.228.109.46                          0.0%    10   30.8  32.1  30.8  36.9   1.8
     18.|-- 192.228.109.49                          0.0%    10   30.9  31.5  30.9  34.3   1.0
     19.|-- 192.228.109.50                          0.0%    10   40.3  34.6  30.9  42.9   5.1
     20.|-- 192.228.109.45                          0.0%    10   31.0  36.9  30.9  64.0   9.9
     21.|-- 192.228.109.46                          0.0%    10   41.6  33.2  30.9  43.2   4.8
     22.|-- 192.228.109.49                          0.0%    10   40.1  34.1  30.9  41.9   4.3
     23.|-- 192.228.109.50                          0.0%    10   31.7  36.1  31.7  42.3   3.7
     24.|-- 192.228.109.45                          0.0%    10   53.8  57.8  51.5  62.9   3.6
     25.|-- 192.228.109.46                          0.0%    10   32.9  35.5  31.0  40.4   3.3
     26.|-- 192.228.109.49                          0.0%    10   31.3  35.1  31.1  41.6   3.4
     27.|-- 192.228.109.50                          0.0%    10   31.0  32.0  30.9  34.8   1.3
     28.|-- 192.228.109.45                          0.0%    10   37.3  37.9  31.0  61.0   9.0
     29.|-- 192.228.109.46                          0.0%    10   31.1  31.7  31.0  35.3   1.2
     30.|-- 192.228.109.49                          0.0%    10   31.0  31.4  31.0  33.4   0.6
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 VersaWeb Seattle
    Start: Sun Nov 25 04:05:53 2018
    HOST: hostname                        Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                          0.0%    10    1.0   1.0   0.7   1.9   0.0
      2.|-- ???                                   100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                           0.0%    10    0.5   0.5   0.5   0.8   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net             0.0%    10    0.7   1.9   0.5   7.9   2.5
      5.|-- et-0-0-67.cr10-dal3.ip4.gtt.net        0.0%    10    0.5   0.6   0.5   0.9   0.0
      6.|-- be3045.ccr41.dfw03.atlas.cogentco.com  0.0%    10    1.2   1.1   0.9   1.2   0.0
      7.|-- be2763.ccr31.dfw01.atlas.cogentco.com  0.0%    10    1.3   1.2   1.0   1.3   0.0
      8.|-- be2432.ccr21.mci01.atlas.cogentco.com  0.0%    10   10.9  11.0  10.8  11.3   0.0
      9.|-- be3035.ccr21.den01.atlas.cogentco.com  0.0%    10   22.5  22.5  22.4  22.8   0.0
     10.|-- be3037.ccr21.slc01.atlas.cogentco.com  0.0%    10   42.1  42.2  42.0  42.5   0.0
     11.|-- be2085.ccr21.sea02.atlas.cogentco.com  0.0%    10   53.2  53.3  53.0  53.6   0.0
     12.|-- 38.142.48.250                          0.0%    10   52.9  53.0  52.8  54.0   0.0
     13.|-- 76.164.234.1                           0.0%    10   53.0  53.0  53.0  53.1   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 OVH Canada
    Start: Sun Nov 25 04:06:10 2018
    HOST: hostname              Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                0.0%    10    0.9   1.0   0.7   1.3   0.0
      2.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                 0.0%    10    0.5   0.8   0.5   1.6   0.0
      4.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      5.|-- be100-1241.chi-5-a9.il.us    0.0%    10   20.6  20.4  20.2  20.7   0.0
      6.|-- be100-1324.bhs-g2-nc5.qc.ca  0.0%    10   58.7  48.3  36.9  70.6  13.1
      7.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      8.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
      9.|-- ???                         100.0    10    0.0   0.0   0.0   0.0   0.0
     10.|-- bhs.proof.ovh.net            0.0%    10   36.2  36.2  36.1  36.3   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Frankfurt:
    Start: Sun Nov 25 04:06:26 2018
    HOST: hostname                       Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                         0.0%    10    1.1   1.0   0.8   1.4   0.0
      2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                          0.0%    10    0.6   1.5   0.5  10.3   3.1
      4.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    1.3   1.6   0.5   7.4   2.0
      5.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    0.8   0.9   0.8   1.2   0.0
      6.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.9   1.7   0.9   3.5   0.7
      7.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net   0.0%    10   37.8  37.8  37.6  38.3   0.0
      8.|-- ae-6.r25.frnkge08.de.bb.gin.ntt.net   0.0%    10  122.8 122.7 122.2 123.3   0.0
      9.|-- ae-28.r04.frnkge08.de.bb.gin.ntt.net  0.0%    10  122.0 122.3 122.0 122.6   0.0
     10.|-- 213.198.94.170                        0.0%    10  121.8 121.9 121.8 121.9   0.0
     11.|-- frankfurt-20.cdn77.com                0.0%    10  121.9 140.3 121.9 305.4  58.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io London:
    Start: Sun Nov 25 04:06:42 2018
    HOST: hostname                      Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    0.8   1.1   0.7   1.9   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                         0.0%    10    0.5   3.9   0.5  34.6  10.8
      4.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10    1.0   1.0   0.4   3.6   0.8
      5.|-- as2914.cr11-dal3.ip4.gtt.net         0.0%    10    0.7   0.9   0.7   1.2   0.0
      6.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net  0.0%    10    0.9   0.9   0.9   1.0   0.0
      7.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  0.0%    10   51.8  39.8  37.4  51.8   4.4
      8.|-- ae-5.r25.nycmny01.us.bb.gin.ntt.net  0.0%    10   41.0  40.3  40.2  41.0   0.0
      9.|-- ae-1.r24.nycmny01.us.bb.gin.ntt.net  0.0%    10   44.1  40.9  40.3  44.1   1.1
     10.|-- ae-9.r24.londen12.uk.bb.gin.ntt.net  0.0%    10  109.3 110.4 108.5 121.5   3.9
     11.|-- ae-8.r02.londen03.uk.bb.gin.ntt.net  0.0%    10  108.5 108.6 108.5 108.9   0.0
     12.|-- 82.112.115.34                        0.0%    10  110.7 110.6 110.6 110.7   0.0
     13.|-- london-20.cdn77.com                  0.0%    10  110.6 110.6 110.5 110.6   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Paris:
    Start: Sun Nov 25 04:06:59 2018
    HOST: hostname                      Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                        0.0%    10    0.7   0.9   0.7   1.4   0.0
      2.|-- ???                                 100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                         0.0%    10    0.6   2.1   0.5  15.6   4.7
      4.|-- ae32.cr11-dal3.ip4.gtt.net           0.0%    10    1.0   3.0   0.5  18.8   5.6
      5.|-- as2914.cr11-dal3.ip4.gtt.net         0.0%    10    1.1   0.9   0.7   1.1   0.0
      6.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net  0.0%    10    2.6   1.1   0.9   2.6   0.5
      7.|-- ae-1.r22.asbnva02.us.bb.gin.ntt.net  0.0%    10   39.4  38.3  37.7  39.7   0.6
      8.|-- ae-0.r23.asbnva02.us.bb.gin.ntt.net  0.0%    10   37.6  40.8  37.6  47.0   3.2
      9.|-- ae-2.r25.amstnl02.nl.bb.gin.ntt.net  0.0%    10  122.2 122.5 122.2 123.8   0.3
     10.|-- ae-3.r24.amstnl02.nl.bb.gin.ntt.net  0.0%    10  122.6 122.9 122.3 123.7   0.0
     11.|-- ae-1.r04.parsfr01.fr.bb.gin.ntt.net  0.0%    10  130.4 130.4 130.3 130.7   0.0
     12.|-- ae-3.r03.parsfr02.fr.bb.gin.ntt.net  0.0%    10  130.4 130.5 130.4 130.9   0.0
     13.|-- ae-8.r02.parsfr02.fr.bb.gin.ntt.net  0.0%    10  130.4 130.4 130.4 130.5   0.0
     14.|-- 81.25.206.50                         0.0%    10  130.0 130.0 129.9 130.1   0.0
     15.|-- paris-kvm-1.datapacket.com           0.0%    10  129.8 129.9 129.8 130.0   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Singapore:
    Start: Sun Nov 25 04:07:16 2018
    HOST: hostname                              Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                                0.0%    10    0.7   0.8   0.6   1.2   0.0
      2.|-- ???                                         100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                                 0.0%    10    0.6   2.6   0.5  21.1   6.5
      4.|-- ae32.cr11-dal3.ip4.gtt.net                   0.0%    10    0.4   0.6   0.4   1.0   0.0
      5.|-- et-0-0-47.cr3-lax2.ip4.gtt.net               0.0%    10   32.1  33.6  32.0  43.8   3.7
      6.|-- singapore-telecommunications-gw.ip4.gtt.net  0.0%    10   27.4  27.4  27.3  27.5   0.0
      7.|-- 203.208.158.29                               0.0%    10  201.4 201.4 201.4 201.7   0.0
      8.|-- 203.208.177.110                              0.0%    10  218.3 218.3 218.3 218.6   0.0
      9.|-- singapore-latency-38.cdn77.com               0.0%    10  213.9 222.7 213.8 301.1  27.6
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Stockholm:
    Start: Sun Nov 25 04:07:33 2018
    HOST: hostname                Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                  0.0%    10    1.1   0.9   0.7   1.3   0.0
      2.|-- ???                           100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                   0.0%    10    0.5   0.5   0.5   0.6   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net     0.0%    10    1.4   0.8   0.5   1.4   0.0
      5.|-- et-5-1-0.cr0-stk1.ip4.gtt.net  0.0%    10  141.6 142.3 141.5 148.8   2.2
      6.|-- cdn77.gtt.net                  0.0%    10  137.5 137.5 137.5 137.6   0.0
      7.|-- stockholm-10.cdn77.com         0.0%    10  137.5 137.5 137.4 137.6   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Moscow:
    Start: Sun Nov 25 04:07:49 2018
    HOST: hostname                  Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                    0.0%    10    0.7   0.9   0.7   1.1   0.0
      2.|-- ???                             100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                     0.0%    10    1.0   0.6   0.5   1.2   0.0
      4.|-- ae32.cr11-dal3.ip4.gtt.net       0.0%    10    0.8   0.8   0.4   1.3   0.0
      5.|-- et-0-0-49.cr11-fra2.ip4.gtt.net  0.0%    10  124.7 125.1 124.4 129.2   1.3
      6.|-- ip4.gtt.net                      0.0%    10  124.4 124.4 124.3 124.5   0.0
      7.|-- ae1-3.RT.MR.MSK.RU.retn.net      0.0%    10  159.6 160.9 159.6 171.7   3.8
      8.|-- moscow-20.cdn77.com              0.0%    10  159.7 159.8 159.7 159.8   0.0
    
    ----------------------------------------------
    mtr --report -w 200 --report-cycles=10 10gbps.io Miami:
    Start: Sun Nov 25 04:08:05 2018
    HOST: hostname                       Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- 23.227.170.41                         0.0%    10    0.7   1.0   0.7   1.8   0.0
      2.|-- ???                                  100.0    10    0.0   0.0   0.0   0.0   0.0
      3.|-- 144.168.32.1                          0.0%    10    3.6   1.4   0.5   3.6   1.1
      4.|-- ae32.cr11-dal3.ip4.gtt.net            0.0%    10    0.5   0.7   0.4   1.2   0.0
      5.|-- as2914.cr11-dal3.ip4.gtt.net          0.0%    10    0.8   0.9   0.7   1.0   0.0
      6.|-- ae-0.r22.dllstx09.us.bb.gin.ntt.net   0.0%    10    1.3   0.9   0.8   1.3   0.0
      7.|-- ae-6.r21.miamfl02.us.bb.gin.ntt.net   0.0%    10   31.1  33.1  31.1  43.4   4.2
      8.|-- ae-11.r04.miamfl02.us.bb.gin.ntt.net  0.0%    10   31.0  31.1  31.0  31.4   0.0
      9.|-- 165.254.21.26                         0.0%    10   33.1  33.0  33.0  33.1   0.0
     10.|-- miami-kvm-1.datapacket.com            0.0%    10   34.9  34.9  34.8  35.2   0.0
    
    
    Code:
    -------------------------------------------
    Check system entropy pool availability
    -------------------------------------------
    
    entropy_avail: 4067
    entropy_avail: 4067
    entropy_avail: 4067
    entropy_avail: 4067
    
    Code:
    -------------------------------------------
    OpenSSL System Benchmark
    -------------------------------------------
    
    OpenSSL 1.0.2k-fips  26 Jan 2017
    -------------------------------------------
    openssl speed -multi 4 rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) 
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    md5             212716.21k   624250.28k  1308252.07k  1848628.91k  2108749.14k
    sha1            251073.33k   714752.53k  1690060.80k  2536195.41k  2950067.54k
    rc4            2301296.13k  2405350.29k  1988966.23k  1888314.37k  1861563.73k
    aes-128 cbc     473220.20k   526918.40k   539861.67k  1209455.62k  1202965.16k
    aes-256 cbc     351439.59k   377412.44k   384200.87k   886912.00k   876202.67k
    sha256          253347.54k   559884.03k  1028071.77k  1285193.39k  1477470.89k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000175s 0.000005s   5704.1 197619.0
    rsa 4096 bits 0.001168s 0.000018s    855.9  54073.8
                                  sign    verify    sign/s verify/s
     256 bit ecdsa (nistp256)   0.0000s   0.0000s  99650.3  46378.0
    -------------------------------------------
    openssl speed -evp aes256 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) 
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            2976809.88k  3172025.41k  3244324.52k  3255025.66k  3222779.22k
    -------------------------------------------
    openssl speed -evp aes128 -multi 4
    OpenSSL 1.0.2k-fips  26 Jan 2017
    built on: reproducible build, date unspecified
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) 
    compiler: gcc -I. -I.. -I../include  -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches   -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DRC4_ASM -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM -DECP_NISTZ256_ASM
    evp            3884087.66k  4304792.83k  4457552.90k  4491228.50k  4497563.65k
    
    Code:
    -------------------------------------------
    Running mysqlslap
    -------------------------------------------
    
    mysqlslap --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-secondary-indexes=5 --number-int-cols=5 --number-char-cols=5 --number-of-queries=25000 --auto-generate-sql-unique-query-number=40 --auto-generate-sql-unique-write-number=40 --auto-generate-sql-write-number=1000 --concurrency=64 --iterations=10 --engine=myisam 
    Benchmark
        Running for engine myisam
        Average number of seconds to run all queries: 1.245 seconds
        Minimum number of seconds to run all queries: 1.137 seconds
        Maximum number of seconds to run all queries: 1.343 seconds
        Number of clients running queries: 64
        Average number of queries per client: 390
    
    Dropping the database is potentially a very bad thing to do.
    Any data stored in the database will be destroyed.
    
    Do you really want to drop the 'test' database [y/N] Database "test" dropped
    
    Code:
    -------------------------------------------
    System PHP Info
    -------------------------------------------
    
    CPU: 4 x Intel Xeon Processor (Skylake, IBRS)
                  total        used        free      shared  buff/cache   available
    Mem:          15885         898       14491          11         495       14687
    Low:          15885        1394       14491
    High:             0           0           0
    Swap:          1023           0        1023
    ----------------------------------------------
    PHP 7.2.12 (cli) (built: Nov 25 2018 03:21:46) ( NTS )
    Copyright (c) 1997-2018 The PHP Group
    Zend Engine v3.2.0, Copyright (c) 1998-2018 Zend Technologies
        with Zend OPcache v7.2.12, Copyright (c) 1999-2018, by Zend Technologies
    ----------------------------------------------
    Configuration File (php.ini) Path: /usr/local/lib
    Loaded Configuration File:         /usr/local/lib/php.ini
    Scan for additional .ini files in: /etc/centminmod/php.d
    Additional .ini files parsed:      /etc/centminmod/php.d/a_customphp.ini,
    /etc/centminmod/php.d/curlcainfo.ini,
    /etc/centminmod/php.d/geoip.ini,
    /etc/centminmod/php.d/igbinary.ini,
    /etc/centminmod/php.d/imagick.ini,
    /etc/centminmod/php.d/mailparse.ini,
    /etc/centminmod/php.d/mcrypt.ini,
    /etc/centminmod/php.d/memcache.ini,
    /etc/centminmod/php.d/memcached.ini,
    /etc/centminmod/php.d/redis.ini,
    /etc/centminmod/php.d/zendopcache.ini
    
    ----------------------------------------------
    [PHP Modules]
    bcmath
    bz2
    calendar
    Core
    ctype
    curl
    date
    dom
    enchant
    exif
    filter
    ftp
    gd
    geoip
    gettext
    gmp
    hash
    iconv
    igbinary
    imagick
    imap
    intl
    json
    ldap
    libxml
    mailparse
    mbstring
    mcrypt
    memcache
    memcached
    mysqli
    mysqlnd
    openssl
    pcntl
    pcre
    PDO
    pdo_mysql
    pdo_sqlite
    Phar
    posix
    pspell
    readline
    redis
    Reflection
    session
    shmop
    SimpleXML
    snmp
    soap
    sockets
    SPL
    sqlite3
    standard
    sysvmsg
    sysvsem
    sysvshm
    tidy
    tokenizer
    xml
    xmlreader
    xmlrpc
    xmlwriter
    xsl
    Zend OPcache
    zip
    zlib
    
    [Zend Modules]
    Zend OPcache
    
    ----------------------------------------------
    shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
    chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
    -------------------------------------------
    Run PHP test Zend/bench.php
    -------------------------------------------
    
    simple             0.024
    simplecall         0.007
    simpleucall        0.021
    simpleudcall       0.022
    mandel             0.111
    mandel2            0.096
    ackermann(7)       0.020
    ary(50000)         0.004
    ary2(50000)        0.003
    ary3(2000)         0.049
    fibo(30)           0.072
    hash1(50000)       0.011
    hash2(500)         0.009
    heapsort(20000)    0.023
    matrix(20)         0.024
    nestedloop(12)     0.042
    sieve(30)          0.015
    strcat(200000)     0.004
    ------------------------
    Total              0.556
    real: 0.60s user: 0.58s sys: 0.01s cpu: 98% maxmem: 26136 KB cswaits: 9
    
    simple             0.024
    simplecall         0.007
    simpleucall        0.021
    simpleudcall       0.022
    mandel             0.111
    mandel2            0.095
    ackermann(7)       0.022
    ary(50000)         0.004
    ary2(50000)        0.003
    ary3(2000)         0.048
    fibo(30)           0.071
    hash1(50000)       0.011
    hash2(500)         0.009
    heapsort(20000)    0.023
    matrix(20)         0.024
    nestedloop(12)     0.042
    sieve(30)          0.016
    strcat(200000)     0.005
    ------------------------
    Total              0.556
    real: 0.60s user: 0.58s sys: 0.01s cpu: 98% maxmem: 26136 KB cswaits: 3
    
    simple             0.024
    simplecall         0.007
    simpleucall        0.021
    simpleudcall       0.022
    mandel             0.111
    mandel2            0.095
    ackermann(7)       0.020
    ary(50000)         0.004
    ary2(50000)        0.003
    ary3(2000)         0.048
    fibo(30)           0.071
    hash1(50000)       0.010
    hash2(500)         0.009
    heapsort(20000)    0.023
    matrix(20)         0.024
    nestedloop(12)     0.042
    sieve(30)          0.015
    strcat(200000)     0.005
    ------------------------
    Total              0.553
    real: 0.59s user: 0.57s sys: 0.01s cpu: 98% maxmem: 26136 KB cswaits: 3
    
    bench.php results from 3 runs
    0.556
    0.556
    0.553
    
    bench.php avg: 0.5550
    Avg: real: 0.60s user: 0.58s sys: 0.01s cpu: 98.00% maxmem: 26136.00KB cswaits: 5.00
    created results log at /home/phpbench_logs/bench_251118-035254.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_251118-035254.log
    
    -------------------------------------------
    Run PHP test Zend/micro_bench.php
    -------------------------------------------
    
    empty_loop         0.029
    func()             0.095    0.066
    undef_func()       0.103    0.074
    int_func()         0.049    0.021
    $x = self::$x      0.083    0.054
    self::$x = 0       0.082    0.053
    isset(self::$x)    0.081    0.052
    empty(self::$x)    0.086    0.057
    $x = Foo::$x       0.063    0.034
    Foo::$x = 0        0.064    0.035
    isset(Foo::$x)     0.061    0.032
    empty(Foo::$x)     0.065    0.036
    self::f()          0.121    0.093
    Foo::f()           0.093    0.065
    $x = $this->x      0.061    0.032
    $this->x = 0       0.049    0.020
    $this->x += 2      0.091    0.063
    ++$this->x         0.066    0.037
    --$this->x         0.064    0.035
    $this->x++         0.070    0.042
    $this->x--         0.071    0.042
    isset($this->x)    0.081    0.053
    empty($this->x)    0.084    0.055
    $this->f()         0.101    0.072
    $x = Foo::TEST     0.083    0.055
    new Foo()          0.210    0.181
    $x = TEST          0.058    0.029
    $x = $_GET         0.088    0.059
    $x = $GLOBALS['v'] 0.125    0.097
    $x = $hash['v']    0.091    0.063
    $x = $str[0]       0.078    0.050
    $x = $a ?: null    0.066    0.038
    $x = $f ?: tmp     0.080    0.051
    $x = $f ? $f : $a  0.062    0.034
    $x = $f ? $f : tmp 0.066    0.038
    ------------------------
    Total              2.821
    real: 2.87s user: 2.85s sys: 0.00s cpu: 99% maxmem: 20004 KB cswaits: 4
    
    empty_loop         0.029
    func()             0.098    0.070
    undef_func()       0.103    0.074
    int_func()         0.052    0.023
    $x = self::$x      0.085    0.056
    self::$x = 0       0.082    0.054
    isset(self::$x)    0.083    0.054
    empty(self::$x)    0.086    0.057
    $x = Foo::$x       0.063    0.034
    Foo::$x = 0        0.064    0.035
    isset(Foo::$x)     0.061    0.032
    empty(Foo::$x)     0.065    0.037
    self::f()          0.119    0.091
    Foo::f()           0.095    0.066
    $x = $this->x      0.063    0.034
    $this->x = 0       0.050    0.021
    $this->x += 2      0.093    0.065
    ++$this->x         0.073    0.044
    --$this->x         0.070    0.041
    $this->x++         0.080    0.052
    $this->x--         0.080    0.052
    isset($this->x)    0.169    0.140
    empty($this->x)    0.092    0.063
    $this->f()         0.103    0.075
    $x = Foo::TEST     0.085    0.057
    new Foo()          0.210    0.181
    $x = TEST          0.058    0.029
    $x = $_GET         0.092    0.063
    $x = $GLOBALS['v'] 0.128    0.099
    $x = $hash['v']    0.093    0.065
    $x = $str[0]       0.078    0.049
    $x = $a ?: null    0.066    0.038
    $x = $f ?: tmp     0.095    0.066
    $x = $f ? $f : $a  0.062    0.033
    $x = $f ? $f : tmp 0.068    0.039
    ------------------------
    Total              2.992
    real: 3.04s user: 3.00s sys: 0.01s cpu: 99% maxmem: 20008 KB cswaits: 3
    
    empty_loop         0.029
    func()             0.095    0.066
    undef_func()       0.103    0.074
    int_func()         0.050    0.021
    $x = self::$x      0.084    0.055
    self::$x = 0       0.082    0.054
    isset(self::$x)    0.081    0.052
    empty(self::$x)    0.086    0.058
    $x = Foo::$x       0.073    0.044
    Foo::$x = 0        0.064    0.036
    isset(Foo::$x)     0.061    0.032
    empty(Foo::$x)     0.065    0.036
    self::f()          0.119    0.090
    Foo::f()           0.095    0.066
    $x = $this->x      0.061    0.033
    $this->x = 0       0.049    0.020
    $this->x += 2      0.092    0.063
    ++$this->x         0.066    0.037
    --$this->x         0.064    0.036
    $this->x++         0.070    0.042
    $this->x--         0.071    0.042
    isset($this->x)    0.082    0.053
    empty($this->x)    0.084    0.055
    $this->f()         0.101    0.072
    $x = Foo::TEST     0.084    0.056
    new Foo()          0.216    0.187
    $x = TEST          0.057    0.029
    $x = $_GET         0.092    0.063
    $x = $GLOBALS['v'] 0.125    0.096
    $x = $hash['v']    0.091    0.063
    $x = $str[0]       0.079    0.050
    $x = $a ?: null    0.067    0.038
    $x = $f ?: tmp     0.080    0.051
    $x = $f ? $f : $a  0.062    0.033
    $x = $f ? $f : tmp 0.067    0.038
    ------------------------
    Total              2.848
    real: 2.89s user: 2.87s sys: 0.01s cpu: 99% maxmem: 20004 KB cswaits: 2
    
    micro_bench.php results from 3 runs
    2.821
    2.992
    2.848
    
    micro_bench.php avg: 2.8870
    Avg: real: 2.93s user: 2.91s sys: 0.01s cpu: 99.00% maxmem: 20005.33KB cswaits: 3.00
    created results log at /home/phpbench_logs/bench_micro_251118-035254.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_251118-035254.log
    
    
    -------------------------------------------
    centminmodbench.sh completed
    -------------------------------------------

    centminmodbench.sh Total Run Time: 1177.976597218 seconds
     
  6. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Nice looks like they're using higher clocked Skylake processors yours at 2294Mhz base so ~2.30Ghz while mine back then posted at Benchmarks - SSDNodes - ssdnodes.com upto 91% discount on KVM VPS until May 31, 2018 was 2099Mhz base so ~2.10Ghz clocked.
     
  7. Tsikura

    Tsikura New Member

    9
    8
    3
    May 18, 2016
    New York
    Ratings:
    +10
    Local Time:
    10:49 AM
    1.15.6
    MariaDB 10.1.137
    I'm really loving the move to ssdnodes. Just moved over all my stuff from my previous host and so far this thing is flying. Going from $70/mo to essentially $14/mo is going to be worth it if this is typical service with them.
     
  8. robert syputa

    robert syputa Member

    77
    18
    8
    Jan 18, 2018
    Seattle
    Ratings:
    +46
    Local Time:
    10:49 AM
    latest
    10
    I've used SSD Nodes for about two years. The first server was a small, 2x core. The recent one is similar to eva2000's description. Both have proven to be very reliable. The benchmarks can vary depending on the day and time of day. I have found that to be the case on every VPS. The VPS suppliers design their loading of the physical hardware and I/O based on normal usage. 'Bad' VPS suppliers oversubscribe while 'Good' suppliers subscribe to have some capacity left in reserve for peak usage periods. Even though there are a certain number of cores and I/O, some of that and ability to read/write to memory and disk space can become bottlenecked during peak usage periods by other users. That is similar to bandwidth speeds on the Internet: watching video from over-loaded servers can get baulky. Your Internet service may be much higher bandwidth than needed but the overload still occurs.
    My experience with SSD Nodes has been good but I have yet to demand full use over a broad range of time periods. So I can't tell how good performance will be if the service is pushed such as when WP sites see heavy loading during peak usage hours.

    One factor to be aware: Some VPS suppliers have been known to adjust their allocation of resources based on the VPS's past usage. Many VPS are used for websites, low volume email servers, or other uses that have low demand. The VPS suppliers use the statistics to reduce the resources for users they think 'won't miss it' while using that physical capacity to over-allocate to additional VPS subscribers.

    For example: if you use a VPS over a period of time for staging or other low-demand uses and then decide to put the site into more demanding use such as a high-volume eCommerce site, you should run the benchmarks, particularly during peak usage periods such as late afternoon and evening hours.
     
  9. Tsikura

    Tsikura New Member

    9
    8
    3
    May 18, 2016
    New York
    Ratings:
    +10
    Local Time:
    10:49 AM
    1.15.6
    MariaDB 10.1.137
    I went from hosting stuff like teamspeak, mumble, 10 websites, etc over the years to down to just 2 websites (1 static, 1 wordpress and phpbb) so I definitely don't need the dedicated I had before. I'm sure since they automated so much of their backend they got some setup to dynamically make adjustments and reports for balancing. For my needs now, this VPS service is a godsend and I won't be doing anything really CPU intensive. I probably didn't even need the NVMe service and saved more with ssd.

    I'll rerun the benchmark throughout the week just out of curiosity.
     
  10. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    darn it as ssdnodes doesn't allow end users to switch distros i.e. centos to ubuntu or ubuntu to centos without web host manual intervention, I asked sshdnodes support to change my distro from ubuntu i was testing back to centos and seems they also switched the server host node so no longer on Xeon Scalable Skylake but older Xeon E5-2699v4 Broadwell now

    For 123.09beta01 install with PHP 7.3 default
    Code (Text):
    yum -y update; curl -O https://centminmod.com/betainstaller73.sh && chmod 0700 betainstaller73.sh && bash betainstaller73.sh

    Code (Text):
    ---------------------------------------------------------------------------
    Total Curl Installer YUM or DNF Time: 155.7115 seconds
    Total YUM Time: 11.924550430 seconds
    Total YUM or DNF + Source Download Time: 48.3667
    Total Nginx First Time Install Time: 230.6713
    Total PHP First Time Install Time: 427.1789
    Download From Github Time: 1.5470
    Total Time Other eg. source compiles: 391.7088
    Total Centmin Mod Install Time: 1097.9257
    ---------------------------------------------------------------------------
    Total Install Time (curl yum + cm install + zip download): 1255.1842 seconds
    ---------------------------------------------------------------------------
    4 Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
    4 2199.998
    ---------------------------------------------------------------------------
    

    Code (Text):
    lscpu
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    1
    Socket(s):             4
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 79
    Model name:            Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
    Stepping:              1
    CPU MHz:               2199.998
    BogoMIPS:              4399.99
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat
    

    post install checklist
    Code (Text):
    *************************************************
    * Post-Install Check List....
    *************************************************
    
    --------------------------------------------------------
    Check ccache Version:
    --------------------------------------------------------
    ccache version 3.5
    
    Copyright (C) 2002-2007 Andrew Tridgell
    Copyright (C) 2009-2018 Joel Rosdahl
    
    This program is free software; you can redistribute it and/or modify it under
    the terms of the GNU General Public License as published by the Free Software
    Foundation; either version 3 of the License, or (at your option) any later
    version.
    
    --------------------------------------------------------
    Check Nginx Version:
    --------------------------------------------------------
    nginx version: nginx/1.15.10 (300319-151135-centos7-kvm)
    built by gcc 8.2.1 20180905 (Red Hat 8.2.1-3) (GCC) 
    built with OpenSSL 1.1.1b  26 Feb 2019
    TLS SNI support enabled
    configure arguments: --with-ld-opt='-Wl,-E -L/usr/local/zlib-cf/lib -L/usr/local/lib -ljemalloc -Wl,-z,relro -Wl,-rpath,/usr/local/zlib-cf/lib:/usr/local/lib' --with-cc-opt='-I/usr/local/zlib-cf/include -I/usr/local/include -m64 -march=native -DTCP_FASTOPEN=23 -g -O3 -fstack-protector-strong -flto -fuse-ld=gold --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wimplicit-fallthrough=0 -fcode-hoisting -Wno-cast-function-type -Wno-format-extra-args -Wp,-D_FORTIFY_SOURCE=2' --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --build=300319-151135-centos7-kvm --with-compat --with-http_stub_status_module --with-http_secure_link_module --with-libatomic --with-http_gzip_static_module --with-http_sub_module --with-http_addition_module --with-http_image_filter_module=dynamic --with-http_geoip_module --with-stream_geoip_module --with-stream_realip_module --with-stream_ssl_preread_module --with-threads --with-stream --with-stream_ssl_module --with-http_realip_module --add-dynamic-module=../ngx-fancyindex-0.4.2 --add-module=../ngx_cache_purge-2.5 --add-dynamic-module=../ngx_devel_kit-0.3.0 --add-dynamic-module=../set-misc-nginx-module-0.32 --add-dynamic-module=../echo-nginx-module-0.61 --add-module=../redis2-nginx-module-0.15 --add-module=../ngx_http_redis-0.3.7 --add-module=../memc-nginx-module-0.18 --add-module=../srcache-nginx-module-0.31 --add-dynamic-module=../headers-more-nginx-module-0.33 --with-pcre-jit --with-zlib=../zlib-cloudflare-1.3.0 --with-http_ssl_module --with-http_v2_module --with-openssl=../openssl-1.1.1b
    
    --------------------------------------------------------
    Check PHP-FPM Version:
    --------------------------------------------------------
    PHP 7.3.3 (cli) (built: Mar 30 2019 15:21:50) ( NTS )
    Copyright (c) 1997-2018 The PHP Group
    Zend Engine v3.3.3, Copyright (c) 1998-2018 Zend Technologies
        with Zend OPcache v7.3.3, Copyright (c) 1999-2018, by Zend Technologies
    
    --------------------------------------------------------
    Check MariaDB installed RPM Versions:
    --------------------------------------------------------
    MariaDB-compat-10.3.13-1.el7.centos.x86_64
    MariaDB-devel-10.3.13-1.el7.centos.x86_64
    MariaDB-client-10.3.13-1.el7.centos.x86_64
    MariaDB-shared-10.3.13-1.el7.centos.x86_64
    MariaDB-common-10.3.13-1.el7.centos.x86_64
    MariaDB-server-10.3.13-1.el7.centos.x86_64
    
    --------------------------------------------------------
    Check Memcached Server Version:
    --------------------------------------------------------
    memcached 1.5.12
    
    --------------------------------------------------------
    Check CSF Firewall Version:
    --------------------------------------------------------
    csf: v12.10 (generic)
    
    --------------------------------------------------------
    Check Siege Benchmark Version:
    --------------------------------------------------------
    SIEGE 4.0.4
    
    Copyright (C) 2017 by Jeffrey Fulmer, et al.
    This is free software; see the source for copying conditions.
    There is NO warranty; not even for MERCHANTABILITY or FITNESS
    FOR A PARTICULAR PURPOSE.
    
    
    --------------------------------------------------------
    Check mysqlreport version:
    --------------------------------------------------------
    mysqlreport v3.5-maria11 Jul 4 2013
    
    --------------------------------------------------------
    Check pure-ftpd Version:
    --------------------------------------------------------
    pure-ftpd v1.0.47
    
    --------------------------------------------------------
    Check YUM Repo List
    --------------------------------------------------------
    Loaded plugins: fastestmirror, priorities, versionlock
    Loading mirror speeds from cached hostfile
     * base: mirror.dal10.us.leaseweb.net
     * epel: mirror.compevo.com
     * extras: mirror.dal10.us.leaseweb.net
     * rpmforge: mirror.teklinks.com
     * updates: mirror.dal10.us.leaseweb.net
    267 packages excluded due to repository priority protections
    repo id                 repo name                                    status
    base/7/x86_64           CentOS-7 - Base                              7,731+2,288
    centos-sclo-rh/x86_64   CentOS-7 - SCLo rh                              8,023+90
    centos-sclo-sclo/x86_64 CentOS-7 - SCLo sclo                                 736
    epel/x86_64             Extra Packages for Enterprise Linux 7 - x86_  12,057+964
    extras/7/x86_64         CentOS-7 - Extras                                    382
    mariadb                 MariaDB                                             48+3
    rpmforge                RHEL 7 - RPMforge.net - dag                      135+110
    updates/7/x86_64        CentOS-7 - Updates                             1,193+284
    repolist: 30,305
    
    --------------------------------------------------------
    mytimes check:
    /usr/bin/mytimes
    --------------------------------------------------------
    Sat Mar 30 15:27:15 UTC 2019    [UTC]
    Sun Mar 31 01:27:15 AEST 2019   [Australia/Brisbane]
    Sat Mar 30 08:27:15 PDT 2019    [America/Los_Angeles]
    Sat Mar 30 10:27:15 CDT 2019    [America/Chicago]
    Sat Mar 30 11:27:15 EDT 2019    [America/New_York]
    Sat Mar 30 11:27:15 EDT 2019    [America/Montreal]
    Sat Mar 30 15:27:15 GMT 2019    [Europe/London]
    Sat Mar 30 16:27:15 CET 2019    [Europe/Berlin]
    Sat Mar 30 22:27:15 +07 2019    [Asia/Bangkok]
    Sat Mar 30 22:27:15 +07 2019    [Asia/Ho_Chi_Minh]
    Sat Mar 30 22:27:15 WIB 2019    [Asia/Jakarta]
    Sat Mar 30 23:27:15 +08 2019    [Asia/Kuala_Lumpur]
    Sat Mar 30 23:27:15 +08 2019    [Asia/Singapore]
    --------------------------------------------------------
    
     
  11. Jimmy

    Jimmy Well-Known Member

    1,778
    388
    83
    Oct 24, 2015
    East Coast USA
    Ratings:
    +987
    Local Time:
    10:49 AM
    Yea, that's not good about ssdnodes.
     
  12. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Yeah they list on their site either Xeon E5 or Xeon Scalable cpus so it's random. It's one of my concerns with getting additional ssdnode based VPSes as to which cpu I end up with. Though for the price, either cpu is a good bargain.
     
  13. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Benchmarking ssdnodes 16GB 4CPU 80GB VPS running Intel Xoen E5-2699v4 with ELRepo YUM Linux 5.0.5 Kernel
    Code (Text):
    lscpu
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    1
    Socket(s):             4
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 79
    Model name:            Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
    Stepping:              1
    CPU MHz:               2199.998
    BogoMIPS:              4399.99
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat
    

    sysbench.sh benchmarks from centminmod/centminmod-sysbench compared to ssdnodes when on Intel Xeon Scalable Skylake based cpu here
    Code (Text):
    ./sysbench.sh cpu
    -------------------------------------------
    System Information
    -------------------------------------------
    
    5.0.5-1.el7.elrepo.x86_64
    
    CentOS Linux release 7.6.1810 (Core)
    
    Centmin Mod
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                4
    On-line CPU(s) list:   0-3
    Thread(s) per core:    1
    Core(s) per socket:    1
    Socket(s):             4
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 79
    Model name:            Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz
    Stepping:              1
    CPU MHz:               2199.998
    BogoMIPS:              4399.99
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0-3
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat
    
    CPU Flags
     fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat
    
    CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
    0   0    0      0    0:0:0      yes
    1   0    1      1    1:1:1      yes
    2   0    2      2    2:2:2      yes
    3   0    3      3    3:3:3      yes
    
                  total        used        free      shared  buff/cache   available
    Mem:          16040         731       14878          19         430       15005
    Low:          16040        1161       14878
    High:             0           0           0
    Swap:          1023           0        1023
    
    Filesystem      Size  Used Avail Use% Mounted on
    devtmpfs        7.9G     0  7.9G   0% /dev
    tmpfs           7.9G     0  7.9G   0% /dev/shm
    tmpfs           7.9G   17M  7.9G   1% /run
    tmpfs           7.9G     0  7.9G   0% /sys/fs/cgroup
    /dev/sda1        80G  6.6G   74G   9% /
    tmpfs           1.6G     0  1.6G   0% /run/user/0
    

    Code (Text):
    sysbench cpu --cpu-max-prime=20000 --threads=1 run
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    prime: 20000
    events/s: 335.54
    time: 10.0002s
    min: 2.86
    avg: 2.98
    max: 10.36
    95th: 3.36
    
    | cpu sysbench | threads: | events/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- |
    | 1.0.17 | 1 | 335.54 | 10.0002s | 2.86 | 2.98 | 10.36 | 3.36 |
    
    sysbench,threads,events/s,time,min,avg,max,95th
    1.0.17,1,335.54,10.0002s,2.86,2.98,10.36,3.36
    

    Code (Text):
    sysbench cpu --cpu-max-prime=20000 --threads=4 run
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    prime: 20000
    events/s: 1350.67
    time: 10.0036s
    min: 2.85
    avg: 2.96
    max: 19.75
    95th: 3.36
    
    | cpu sysbench | threads: | events/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- |
    | 1.0.17 | 4 | 1350.67 | 10.0036s | 2.85 | 2.96 | 19.75 | 3.36 |
    
    sysbench,threads,events/s,time,min,avg,max,95th
    1.0.17,4,1350.67,10.0036s,2.85,2.96,19.75,3.36
    

    Code (Text):
    ./sysbench.sh mem
    
    sysbench memory --threads=1 --memory-block-size=1K --memory-scope=global --memory-total-size=1G --memory-oper=read run
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    block-size: 1KiB
    total-size: 1024MiB
    operation: read
    scope: global
    total-ops: 1048576 (3685343.54 per second)
    transferred (3598.97 MiB/sec)
    time: 0.2827s
    min: 0.00
    avg: 0.00
    max: 0.14
    95th: 0.00
    
    | memory sysbench | sysbench | threads: | block-size: | total-size: | operation: | total-ops: | transferred | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | memory | 1.0.17 | 1 | 1KiB | 1024MiB | read | 1048576 | 3598.97 | 0.2827s | 0.00 | 0.00 | 0.14 | 0.00 |
    
    sysbench,sysbench,threads,block-size,total-size,operation,total-ops,transferred,time,min,avg,max,95th
    memory,1.0.17,1,1KiB,1024MiB,read,1048576,3598.97,0.2827s,0.00,0.00,0.14,0.00
    

    Code (Text):
    sysbench memory --threads=4 --memory-block-size=1K --memory-scope=global --memory-total-size=1G --memory-oper=read run
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    block-size: 1KiB
    total-size: 1024MiB
    operation: read
    scope: global
    total-ops: 1048576 (11577119.55 per second)
    transferred (11305.78 MiB/sec)
    time: 0.0888s
    min: 0.00
    avg: 0.00
    max: 0.13
    95th: 0.00
    
    | memory sysbench | sysbench | threads: | block-size: | total-size: | operation: | total-ops: | transferred | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | memory | 1.0.17 | 4 | 1KiB | 1024MiB | read | 1048576 | 11305.78 | 0.0888s | 0.00 | 0.00 | 0.13 | 0.00 |
    
    sysbench,sysbench,threads,block-size,total-size,operation,total-ops,transferred,time,min,avg,max,95th
    memory,1.0.17,4,1KiB,1024MiB,read,1048576,11305.78,0.0888s,0.00,0.00,0.13,0.00
    

    Code (Text):
    ./sysbench.sh file
    
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=seqrd prepare
    
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqrd-threads-1-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential read test
    reads/s: 10522.38
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 41.10
    written-MiB/s: 0.00
    time: 10.0003s
    min: 0.04
    avg: 0.09
    max: 17.49
    95th: 0.17
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 1 | 4KiB | I/O | read | 10522.38 | 0.00 | 0.00 | 41.10 | 0.00 | 10.0003s | 0.04 | 0.09 | 17.49 | 0.17 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,1,4KiB,I/O,read,10522.38,0.00,0.00,41.10,0.00,10.0003s,0.04,0.09,17.49,0.17
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=seqwr prepare
    
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqwr-threads-1-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential write (creation) test
    reads/s: 0.00
    writes/s: 4965.04
    fsyncs/s: 6355.76
    read-MiB/s: 0.00
    written-MiB/s: 19.39
    time: 10.0075s
    min: 0.03
    avg: 0.09
    max: 121.09
    95th: 0.16
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 1 | 4KiB | I/O | write | 0.00 | 4965.04 | 6355.76 | 0.00 | 19.39 | 10.0075s | 0.03 | 0.09 | 121.09 | 0.16 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,1,4KiB,I/O,write,0.00,4965.04,6355.76,0.00,19.39,10.0075s,0.03,0.09,121.09,0.16
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=rndrd prepare
    
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndrd-threads-1-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random read test
    reads/s: 11819.69
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 46.17
    written-MiB/s: 0.00
    time: 10.0001s
    min: 0.05
    avg: 0.08
    max: 10.11
    95th: 0.13
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 1 | 4KiB | I/O | read | 11819.69 | 0.00 | 0.00 | 46.17 | 0.00 | 10.0001s | 0.05 | 0.08 | 10.11 | 0.13 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,1,4KiB,I/O,read,11819.69,0.00,0.00,46.17,0.00,10.0001s,0.05,0.08,10.11,0.13
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=rndwr prepare
    
    sysbench fileio --threads=1 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndwr-threads-1-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random write test
    reads/s: 0.00
    writes/s: 4366.52
    fsyncs/s: 5594.54
    read-MiB/s: 0.00
    written-MiB/s: 17.06
    time: 10.0062s
    min: 0.04
    avg: 0.10
    max: 16.31
    95th: 0.18
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 1 | 4KiB | I/O | write | 0.00 | 4366.52 | 5594.54 | 0.00 | 17.06 | 10.0062s | 0.04 | 0.10 | 16.31 | 0.18 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,1,4KiB,I/O,write,0.00,4366.52,5594.54,0.00,17.06,10.0062s,0.04,0.10,16.31,0.18
    
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=seqrd prepare
    
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqrd-threads-4-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential read test
    reads/s: 51640.41
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 201.72
    written-MiB/s: 0.00
    time: 10.0001s
    min: 0.03
    avg: 0.08
    max: 19.20
    95th: 0.11
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 4 | 4KiB | I/O | read | 51640.41 | 0.00 | 0.00 | 201.72 | 0.00 | 10.0001s | 0.03 | 0.08 | 19.20 | 0.11 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,4,4KiB,I/O,read,51640.41,0.00,0.00,201.72,0.00,10.0001s,0.03,0.08,19.20,0.11
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=seqwr prepare
    
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=seqwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-seqwr-threads-4-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Using synchronous I/O mode
    Doing sequential write (creation) test
    reads/s: 0.00
    writes/s: 5575.37
    fsyncs/s: 7176.57
    read-MiB/s: 0.00
    written-MiB/s: 21.78
    time: 10.0244s
    min: 0.04
    avg: 0.31
    max: 62.59
    95th: 0.81
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 4 | 4KiB | I/O | write | 0.00 | 5575.37 | 7176.57 | 0.00 | 21.78 | 10.0244s | 0.04 | 0.31 | 62.59 | 0.81 |
    
    sysbench,sysbench,threads,Block-size,synchronous,sequential,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,4,4KiB,I/O,write,0.00,5575.37,7176.57,0.00,21.78,10.0244s,0.04,0.31,62.59,0.81
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=rndrd prepare
    
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndrd --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndrd-threads-4-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random read test
    reads/s: 46367.53
    writes/s: 0.00
    fsyncs/s: 0.00
    read-MiB/s: 181.12
    written-MiB/s: 0.00
    time: 10.0002s
    min: 0.03
    avg: 0.09
    max: 18.40
    95th: 0.13
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 4 | 4KiB | I/O | read | 46367.53 | 0.00 | 0.00 | 181.12 | 0.00 | 10.0002s | 0.03 | 0.09 | 18.40 | 0.13 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,4,4KiB,I/O,read,46367.53,0.00,0.00,181.12,0.00,10.0002s,0.03,0.09,18.40,0.13
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    sysbench fileio prepare
    sysbench fileio --file-total-size=2048M --file-test-mode=rndwr prepare
    
    sysbench fileio --threads=4 --file-num=128 --file-total-size=2048M --file-block-size=4096 --file-io-mode=sync --file-extra-flags=direct --file-test-mode=rndwr --time=10 --events=0 run
    raw log saved: /home/sysbench/sysbench-fileio-rndwr-threads-4-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random write test
    reads/s: 0.00
    writes/s: 11213.88
    fsyncs/s: 14403.50
    read-MiB/s: 0.00
    written-MiB/s: 43.80
    time: 10.0127s
    min: 0.04
    avg: 0.16
    max: 24.63
    95th: 0.23
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 4 | 4KiB | I/O | write | 0.00 | 11213.88 | 14403.50 | 0.00 | 43.80 | 10.0127s | 0.04 | 0.16 | 24.63 | 0.23 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,95th
    fileio,1.0.17,4,4KiB,I/O,write,0.00,11213.88,14403.50,0.00,43.80,10.0127s,0.04,0.16,24.63,0.23
    
    
    sysbench fileio cleanup
    sysbench fileio --file-total-size=2048M cleanup
    

    Code (Text):
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | sequential | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    |fileio | 1.0.17 | 1 | 4KiB | I/O | read | 10522.38 | 0.00 | 0.00 | 41.10 | 0.00 | 10.0003s | 0.04 | 0.09 | 17.49 | 0.17 |
    |fileio | 1.0.17 | 1 | 4KiB | I/O | write | 0.00 | 4965.04 | 6355.76 | 0.00 | 19.39 | 10.0075s | 0.03 | 0.09 | 121.09 | 0.16 |
    |fileio | 1.0.17 | 4 | 4KiB | I/O | read | 51640.41 | 0.00 | 0.00 | 201.72 | 0.00 | 10.0001s | 0.03 | 0.08 | 19.20 | 0.11 |
    |fileio | 1.0.17 | 4 | 4KiB | I/O | write | 0.00 | 5575.37 | 7176.57 | 0.00 | 21.78 | 10.0244s | 0.04 | 0.31 | 62.59 | 0.81 |
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    |fileio | 1.0.17 | 1 | 4KiB | I/O | read | 11819.69 | 0.00 | 0.00 | 46.17 | 0.00 | 10.0001s | 0.05 | 0.08 | 10.11 | 0.13 |
    |fileio | 1.0.17 | 1 | 4KiB | I/O | write | 0.00 | 4366.52 | 5594.54 | 0.00 | 17.06 | 10.0062s | 0.04 | 0.10 | 16.31 | 0.18 |
    |fileio | 1.0.17 | 4 | 4KiB | I/O | read | 46367.53 | 0.00 | 0.00 | 181.12 | 0.00 | 10.0002s | 0.03 | 0.09 | 18.40 | 0.13 |
    |fileio | 1.0.17 | 4 | 4KiB | I/O | write | 0.00 | 11213.88 | 14403.50 | 0.00 | 43.80 | 10.0127s | 0.04 | 0.16 | 24.63 | 0.23 |
    

    Code (Text):
    ./sysbench.sh file-fsync
    
    sysbench fileio fsync prepare
    sysbench fileio --time=30 --file-num=1 --file-extra-flags= --file-total-size=4096 --file-block-size=4096 --file-fsync-all=on --file-test-mode=rndwr --file-fsync-freq=0 --file-fsync-end=0 --threads=1 --percentile=99 prepare
    
    sysbench fileio --threads=1 --time=30 --file-num=1 --file-extra-flags= --file-total-size=4096 --file-block-size=4096 --file-fsync-all=on --file-test-mode=rndwr --file-fsync-freq=0 --file-fsync-end=0 --percentile=99 run
    raw log saved: /home/sysbench/sysbench-fileio-fsync-threads-1-raw.log
    
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 1
    Block-size 4KiB
    Read/Write ratio for combined random IO test: 1.50
    Using synchronous I/O mode
    Doing random write test
    reads/s: 0.00
    writes/s: 3025.56
    fsyncs/s: 3025.56
    read-MiB/s: 0.00
    written-MiB/s: 11.82
    time: 30.0001s
    min: 0.15
    avg: 0.33
    max: 28.19
    99th: 1.14
    
    | fileio sysbench | sysbench | threads: | Block-size | synchronous | random | reads/s: | writes/s: | fsyncs/s: | read-MiB/s: | written-MiB/s: | time: | min: | avg: | max: | 99th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | fileio | 1.0.17 | 1 | 4KiB | I/O | write | 0.00 | 3025.56 | 3025.56 | 0.00 | 11.82 | 30.0001s | 0.15 | 0.33 | 28.19 | 1.14 |
    
    sysbench,sysbench,threads,Block-size,synchronous,random,reads/s,writes/s,fsyncs/s,read-MiB/s,written-MiB/s,time,min,avg,max,99th
    fileio,1.0.17,1,4KiB,I/O,write,0.00,3025.56,3025.56,0.00,11.82,30.0001s,0.15,0.33,28.19,1.14
    
    
    sysbench fileio cleanup
    sysbench fileio --file-num=1 --file-extra-flags= --file-total-size=4096 --file-block-size=4096 cleanup
    

    Code (Text):
    ./sysbench.sh mysqloltpnew
    
    setup sbt database & user
    mysqladmin create database: sbt
    Grants for sbtest@localhost
    GRANT USAGE ON *.* TO 'sbtest'@'localhost' IDENTIFIED BY PASSWORD '*E6A410EB4C0B2737A6FC7845D7727289E65F2C8E'
    GRANT ALL PRIVILEGES ON `sbt`.* TO 'sbtest'@'localhost'
    
    MySQL Buffers
    aria_pagecache_buffer_size           1073741824
    aria_sort_buffer_size                268435456
    bulk_insert_buffer_size              8388608
    innodb_buffer_pool_chunk_size        134217728
    innodb_buffer_pool_dump_at_shutdown  ON
    innodb_buffer_pool_dump_now          OFF
    innodb_buffer_pool_dump_pct          25
    innodb_buffer_pool_filename          ib_buffer_pool
    innodb_buffer_pool_instances         4
    innodb_buffer_pool_load_abort        OFF
    innodb_buffer_pool_load_at_startup   ON
    innodb_buffer_pool_load_now          OFF
    innodb_buffer_pool_size              4294967296
    innodb_change_buffer_max_size        25
    innodb_change_buffering              all
    innodb_log_buffer_size               33554432
    innodb_sort_buffer_size              2097152
    join_buffer_size                     1048576
    join_buffer_space_limit              2097152
    key_buffer_size                      536870912
    mrr_buffer_size                      262144
    myisam_sort_buffer_size              536870912
    net_buffer_length                    16384
    optimizer_switch                     index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on
    preload_buffer_size                  32768
    read_buffer_size                     1048576
    read_rnd_buffer_size                 524288
    sort_buffer_size                     2097152
    sql_buffer_result                    OFF
    
    MySQL Limits
    aria_pagecache_division_limit         100
    delayed_insert_limit                  100
    eq_range_index_dive_limit             0
    expensive_subquery_limit              100
    ft_query_expansion_limit              20
    innodb_ft_result_cache_limit          2000000000
    join_buffer_space_limit               2097152
    key_cache_division_limit              100
    log_slow_rate_limit                   1
    min_examined_row_limit                0
    open_files_limit                      21415
    optimizer_selectivity_sampling_limit  100
    query_cache_limit                     1048576
    read_binlog_speed_limit               0
    relay_log_space_limit                 0
    sql_select_limit                      18446744073709551615
    thread_pool_stall_limit               500
    updatable_views_with_limit            YES
    
    MySQL Maxes
    aria_max_sort_file_size           9223372036853727232
    extra_max_connections             1
    ft_max_word_len                   84
    group_concat_max_len              1048576
    innodb_adaptive_max_sleep_delay   150000
    innodb_compression_pad_pct_max    50
    innodb_ft_max_token_size          84
    innodb_io_capacity_max            5000
    innodb_max_dirty_pages_pct        75.000000
    innodb_max_dirty_pages_pct_lwm    0.000000
    innodb_max_purge_lag              0
    innodb_max_purge_lag_delay        0
    innodb_max_undo_log_size          10485760
    innodb_online_alter_log_max_size  134217728
    max_allowed_packet                134217728
    max_binlog_cache_size             18446744073709547520
    max_binlog_size                   1073741824
    max_binlog_stmt_cache_size        18446744073709547520
    max_connect_errors                100000
    max_connections                   900
    max_delayed_threads               20
    max_digest_length                 1024
    max_error_count                   64
    max_heap_table_size               805306368
    max_insert_delayed_threads        20
    max_join_size                     18446744073709551615
    max_length_for_sort_data          1024
    max_long_data_size                134217728
    max_prepared_stmt_count           16382
    max_recursive_iterations          4294967295
    max_relay_log_size                1073741824
    max_seeks_for_key                 4294967295
    max_session_mem_used              9223372036854775807
    max_sort_length                   1024
    max_sp_recursion_depth            0
    max_statement_time                0.000000
    max_tmp_tables                    32
    max_user_connections              0
    max_write_lock_count              4294967295
    myisam_max_sort_file_size         4294967296
    slave_max_allowed_packet          1073741824
    slave_parallel_max_queued         131072
    thread_pool_max_threads           65536
    wsrep_max_ws_rows                 0
    wsrep_max_ws_size                 2147483647
    
    MySQL Concurrency
    concurrent_insert           ALWAYS
    innodb_commit_concurrency   0
    innodb_concurrency_tickets  5000
    innodb_thread_concurrency   12
    thread_concurrency          10
    
    MySQL Read/Write
    delay_key_write                 ON
    idle_write_transaction_timeout  0
    innodb_disallow_writes          OFF
    innodb_doublewrite              ON
    innodb_log_write_ahead_size     8192
    innodb_use_atomic_writes        ON
    max_write_lock_count            4294967295
    net_write_timeout               60
    wsrep_causal_reads              OFF
    wsrep_dirty_reads               OFF
    
    MySQL Threads
    aria_repair_threads                      1
    binlog_optimize_thread_scheduling        ON
    debug_no_thread_alarm                    OFF
    innodb_encryption_threads                0
    innodb_purge_threads                     2
    innodb_read_io_threads                   2
    innodb_thread_concurrency                12
    innodb_thread_sleep_delay                5000
    innodb_write_io_threads                  2
    max_delayed_threads                      20
    max_insert_delayed_threads               20
    myisam_repair_threads                    1
    performance_schema_max_thread_classes    50
    performance_schema_max_thread_instances  -1
    slave_domain_parallel_threads            0
    slave_parallel_threads                   0
    thread_cache_size                        384
    thread_concurrency                       10
    thread_handling                          one-thread-per-connection
    thread_pool_idle_timeout                 60
    thread_pool_max_threads                  65536
    thread_pool_oversubscribe                3
    thread_pool_prio_kickup_timer            1000
    thread_pool_priority                     auto
    thread_pool_size                         4
    thread_pool_stall_limit                  500
    thread_stack                             299008
    wsrep_slave_threads                      1
    
    MySQL Binlog
    binlog_annotate_row_events               ON
    binlog_cache_size                        32768
    binlog_checksum                          CRC32
    binlog_commit_wait_count                 0
    binlog_commit_wait_usec                  100000
    binlog_direct_non_transactional_updates  OFF
    binlog_file_cache_size                   16384
    binlog_format                            MIXED
    binlog_optimize_thread_scheduling        ON
    binlog_row_image                         FULL
    binlog_stmt_cache_size                   32768
    encrypt_binlog                           OFF
    gtid_binlog_pos
    gtid_binlog_state
    innodb_locks_unsafe_for_binlog           OFF
    log_bin                                  OFF
    log_bin_basename
    log_bin_compress                         OFF
    log_bin_compress_min_len                 256
    log_bin_index
    log_bin_trust_function_creators          OFF
    max_binlog_cache_size                    18446744073709547520
    max_binlog_size                          1073741824
    max_binlog_stmt_cache_size               18446744073709547520
    read_binlog_speed_limit                  0
    sql_log_bin                              ON
    sync_binlog                              0
    wsrep_forced_binlog_format               NONE
    
    MySQL InnoDB
    ignore_builtin_innodb                        OFF
    innodb_adaptive_flushing                     ON
    innodb_adaptive_flushing_lwm                 10.000000
    innodb_adaptive_hash_index                   ON
    innodb_adaptive_hash_index_parts             8
    innodb_adaptive_max_sleep_delay              150000
    innodb_autoextend_increment                  64
    innodb_autoinc_lock_mode                     1
    innodb_background_scrub_data_check_interval  3600
    innodb_background_scrub_data_compressed      OFF
    innodb_background_scrub_data_interval        604800
    innodb_background_scrub_data_uncompressed    OFF
    innodb_buf_dump_status_frequency             0
    innodb_buffer_pool_chunk_size                134217728
    innodb_buffer_pool_dump_at_shutdown          ON
    innodb_buffer_pool_dump_now                  OFF
    innodb_buffer_pool_dump_pct                  25
    innodb_buffer_pool_filename                  ib_buffer_pool
    innodb_buffer_pool_instances                 4
    innodb_buffer_pool_load_abort                OFF
    innodb_buffer_pool_load_at_startup           ON
    innodb_buffer_pool_load_now                  OFF
    innodb_buffer_pool_size                      4294967296
    innodb_change_buffer_max_size                25
    innodb_change_buffering                      all
    innodb_checksum_algorithm                    crc32
    innodb_checksums                             ON
    innodb_cmp_per_index_enabled                 OFF
    innodb_commit_concurrency                    0
    innodb_compression_algorithm                 zlib
    innodb_compression_default                   OFF
    innodb_compression_failure_threshold_pct     5
    innodb_compression_level                     6
    innodb_compression_pad_pct_max               50
    innodb_concurrency_tickets                   5000
    innodb_data_file_path                        ibdata1:10M:autoextend
    innodb_data_home_dir
    innodb_deadlock_detect                       ON
    innodb_default_encryption_key_id             1
    innodb_default_row_format                    dynamic
    innodb_defragment                            ON
    innodb_defragment_fill_factor                0.900000
    innodb_defragment_fill_factor_n_recs         20
    innodb_defragment_frequency                  40
    innodb_defragment_n_pages                    7
    innodb_defragment_stats_accuracy             0
    innodb_disable_sort_file_cache               OFF
    innodb_disallow_writes                       OFF
    innodb_doublewrite                           ON
    innodb_encrypt_log                           OFF
    innodb_encrypt_tables                        OFF
    innodb_encryption_rotate_key_age             1
    innodb_encryption_rotation_iops              100
    innodb_encryption_threads                    0
    innodb_fast_shutdown                         1
    innodb_fatal_semaphore_wait_threshold        600
    innodb_file_format
    innodb_file_per_table                        ON
    innodb_fill_factor                           100
    innodb_flush_log_at_timeout                  1
    innodb_flush_log_at_trx_commit               2
    innodb_flush_method                          O_DIRECT
    innodb_flush_neighbors                       0
    innodb_flush_sync                            ON
    innodb_flushing_avg_loops                    30
    innodb_force_load_corrupted                  OFF
    innodb_force_primary_key                     OFF
    innodb_force_recovery                        0
    innodb_ft_aux_table
    innodb_ft_cache_size                         8000000
    innodb_ft_enable_diag_print                  OFF
    innodb_ft_enable_stopword                    ON
    innodb_ft_max_token_size                     84
    innodb_ft_min_token_size                     3
    innodb_ft_num_word_optimize                  2000
    innodb_ft_result_cache_limit                 2000000000
    innodb_ft_server_stopword_table
    innodb_ft_sort_pll_degree                    2
    innodb_ft_total_cache_size                   640000000
    innodb_ft_user_stopword_table
    innodb_idle_flush_pct                        100
    innodb_immediate_scrub_data_uncompressed     OFF
    innodb_io_capacity                           2500
    innodb_io_capacity_max                       5000
    innodb_large_prefix
    innodb_lock_schedule_algorithm               fcfs
    innodb_lock_wait_timeout                     50
    innodb_locks_unsafe_for_binlog               OFF
    innodb_log_buffer_size                       33554432
    innodb_log_checksums                         ON
    innodb_log_compressed_pages                  ON
    innodb_log_file_size                         671088640
    innodb_log_files_in_group                    2
    innodb_log_group_home_dir                    ./
    innodb_log_optimize_ddl                      ON
    innodb_log_write_ahead_size                  8192
    innodb_lru_scan_depth                        1024
    innodb_max_dirty_pages_pct                   75.000000
    innodb_max_dirty_pages_pct_lwm               0.000000
    innodb_max_purge_lag                         0
    innodb_max_purge_lag_delay                   0
    innodb_max_undo_log_size                     10485760
    innodb_monitor_disable
    innodb_monitor_enable
    innodb_monitor_reset
    innodb_monitor_reset_all
    innodb_old_blocks_pct                        37
    innodb_old_blocks_time                       1000
    innodb_online_alter_log_max_size             134217728
    innodb_open_files                            10000
    innodb_optimize_fulltext_only                OFF
    innodb_page_cleaners                         4
    innodb_page_size                             16384
    innodb_prefix_index_cluster_optimization     OFF
    innodb_print_all_deadlocks                   OFF
    innodb_purge_batch_size                      300
    innodb_purge_rseg_truncate_frequency         128
    innodb_purge_threads                         2
    innodb_random_read_ahead                     OFF
    innodb_read_ahead_threshold                  56
    innodb_read_io_threads                       2
    innodb_read_only                             OFF
    innodb_replication_delay                     0
    innodb_rollback_on_timeout                   OFF
    innodb_rollback_segments                     128
    innodb_scrub_log                             OFF
    innodb_scrub_log_speed                       256
    innodb_sort_buffer_size                      2097152
    innodb_spin_wait_delay                       4
    innodb_stats_auto_recalc                     ON
    innodb_stats_include_delete_marked           OFF
    innodb_stats_method                          nulls_equal
    innodb_stats_modified_counter                0
    innodb_stats_on_metadata                     OFF
    innodb_stats_persistent                      ON
    innodb_stats_persistent_sample_pages         20
    innodb_stats_sample_pages                    8
    innodb_stats_traditional                     ON
    innodb_stats_transient_sample_pages          8
    innodb_status_output                         OFF
    innodb_status_output_locks                   OFF
    innodb_strict_mode                           ON
    innodb_sync_array_size                       1
    innodb_sync_spin_loops                       30
    innodb_table_locks                           ON
    innodb_temp_data_file_path                   ibtmp1:12M:autoextend
    innodb_thread_concurrency                    12
    innodb_thread_sleep_delay                    5000
    innodb_tmpdir
    innodb_undo_directory                        ./
    innodb_undo_log_truncate                     OFF
    innodb_undo_logs                             128
    innodb_undo_tablespaces                      0
    innodb_use_atomic_writes                     ON
    innodb_use_native_aio                        ON
    innodb_version                               10.3.13
    innodb_write_io_threads                      2
    

    Code (Text):
    sysbench prepare database: sbt
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql prepare
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    
    Initializing worker threads...
    
    Creating table 'sbtest2'...
    Creating table 'sbtest3'...
    Creating table 'sbtest4'...
    Creating table 'sbtest1'...
    Inserting 150000 records into 'sbtest3'
    Inserting 150000 records into 'sbtest2'
    Inserting 150000 records into 'sbtest1'
    Inserting 150000 records into 'sbtest4'
    Creating a secondary index on 'sbtest4'...
    Creating a secondary index on 'sbtest3'...
    Creating a secondary index on 'sbtest2'...
    Creating a secondary index on 'sbtest1'...
    Creating table 'sbtest8'...
    Inserting 150000 records into 'sbtest8'
    Creating table 'sbtest7'...
    Inserting 150000 records into 'sbtest7'
    Creating table 'sbtest6'...
    Inserting 150000 records into 'sbtest6'
    Creating table 'sbtest5'...
    Inserting 150000 records into 'sbtest5'
    Creating a secondary index on 'sbtest8'...
    Creating a secondary index on 'sbtest6'...
    Creating a secondary index on 'sbtest7'...
    Creating a secondary index on 'sbtest5'...
    
    +-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
    | Table Name  | Number of Rows | Storage Engine | Data Size | Index Size | Total   | ROW_FORMAT | TABLE_COLLATION |
    +-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
    | sbt.sbtest2 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest3 | 150000 Rows    | InnoDB         | 0.08MB    | 0.00MB     | 0.08MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest4 | 148032 Rows    | InnoDB         | 32.56MB   | 2.52MB     | 35.08MB | Dynamic    | utf8_general_ci |
    | sbt.sbtest1 | 148032 Rows    | InnoDB         | 32.56MB   | 0.00MB     | 32.56MB | Dynamic    | utf8_general_ci |
    | sbt.sbtest8 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest7 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest6 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    | sbt.sbtest5 | 150000 Rows    | InnoDB         | 0.02MB    | 0.00MB     | 0.02MB  | Dynamic    | utf8_general_ci |
    +-------------+----------------+----------------+-----------+------------+---------+------------+-----------------+
    
    sysbench mysql OLTP new benchmark:
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql run
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    
    Running the test with following options:
    Number of threads: 4
    Report intermediate results every 1 second(s)
    Initializing random number generator from seed (1).
    
    
    Initializing worker threads...
    
    Threads started!
    
    [ 1s ] thds: 4 tps: 884.26 qps: 17723.21 (r/w/o: 12413.63/3537.06/1772.52) lat (ms,95%): 7.30 err/s: 0.00 reconn/s: 0.00
    [ 2s ] thds: 4 tps: 1388.05 qps: 27780.03 (r/w/o: 19449.72/5554.21/2776.10) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
    [ 3s ] thds: 4 tps: 1039.97 qps: 20769.39 (r/w/o: 14531.58/4157.88/2079.94) lat (ms,95%): 6.21 err/s: 0.00 reconn/s: 0.00
    [ 4s ] thds: 4 tps: 850.87 qps: 17036.46 (r/w/o: 11930.22/3404.49/1701.75) lat (ms,95%): 7.43 err/s: 0.00 reconn/s: 0.00
    [ 5s ] thds: 4 tps: 1161.18 qps: 23233.62 (r/w/o: 16266.53/4644.72/2322.36) lat (ms,95%): 5.77 err/s: 0.00 reconn/s: 0.00
    [ 6s ] thds: 4 tps: 1254.78 qps: 25092.69 (r/w/o: 17561.99/5021.14/2509.57) lat (ms,95%): 5.18 err/s: 0.00 reconn/s: 0.00
    [ 7s ] thds: 4 tps: 857.71 qps: 17135.28 (r/w/o: 11990.00/3429.85/1715.43) lat (ms,95%): 7.56 err/s: 0.00 reconn/s: 0.00
    [ 8s ] thds: 4 tps: 923.31 qps: 18477.28 (r/w/o: 12938.40/3692.26/1846.63) lat (ms,95%): 6.55 err/s: 0.00 reconn/s: 0.00
    [ 9s ] thds: 4 tps: 1211.10 qps: 24217.01 (r/w/o: 16951.41/4843.40/2422.20) lat (ms,95%): 5.99 err/s: 0.00 reconn/s: 0.00
    [ 10s ] thds: 4 tps: 844.04 qps: 16880.84 (r/w/o: 11811.59/3380.17/1689.08) lat (ms,95%): 7.84 err/s: 0.00 reconn/s: 0.00
    [ 11s ] thds: 4 tps: 947.01 qps: 18931.18 (r/w/o: 13254.13/3784.04/1893.02) lat (ms,95%): 6.55 err/s: 0.00 reconn/s: 0.00
    [ 12s ] thds: 4 tps: 978.25 qps: 19584.02 (r/w/o: 13712.50/3915.01/1956.51) lat (ms,95%): 6.79 err/s: 0.00 reconn/s: 0.00
    [ 13s ] thds: 4 tps: 989.83 qps: 19771.57 (r/w/o: 13834.59/3957.32/1979.66) lat (ms,95%): 6.43 err/s: 0.00 reconn/s: 0.00
    [ 14s ] thds: 4 tps: 1027.98 qps: 20549.63 (r/w/o: 14382.74/4111.93/2054.96) lat (ms,95%): 6.21 err/s: 0.00 reconn/s: 0.00
    [ 15s ] thds: 4 tps: 1022.76 qps: 20485.18 (r/w/o: 14346.62/4092.04/2046.52) lat (ms,95%): 6.09 err/s: 0.00 reconn/s: 0.00
    [ 16s ] thds: 4 tps: 885.16 qps: 17691.25 (r/w/o: 12382.27/3539.65/1769.32) lat (ms,95%): 6.91 err/s: 0.00 reconn/s: 0.00
    [ 17s ] thds: 4 tps: 869.05 qps: 17413.98 (r/w/o: 12191.68/3483.20/1739.10) lat (ms,95%): 6.55 err/s: 0.00 reconn/s: 0.00
    [ 18s ] thds: 4 tps: 968.97 qps: 19350.38 (r/w/o: 13544.57/3868.88/1936.94) lat (ms,95%): 6.21 err/s: 0.00 reconn/s: 0.00
    [ 19s ] thds: 4 tps: 1009.01 qps: 20174.27 (r/w/o: 14119.19/4036.05/2019.03) lat (ms,95%): 6.21 err/s: 0.00 reconn/s: 0.00
    [ 20s ] thds: 4 tps: 881.06 qps: 17642.13 (r/w/o: 12352.79/3527.23/1762.11) lat (ms,95%): 6.55 err/s: 0.00 reconn/s: 0.00
    [ 21s ] thds: 4 tps: 1004.87 qps: 20102.36 (r/w/o: 14075.15/4017.47/2009.74) lat (ms,95%): 5.99 err/s: 0.00 reconn/s: 0.00
    [ 22s ] thds: 4 tps: 1058.09 qps: 21153.71 (r/w/o: 14803.19/4234.34/2116.17) lat (ms,95%): 5.99 err/s: 0.00 reconn/s: 0.00
    [ 23s ] thds: 4 tps: 1183.00 qps: 23660.01 (r/w/o: 16562.00/4732.00/2366.00) lat (ms,95%): 5.57 err/s: 0.00 reconn/s: 0.00
    [ 24s ] thds: 4 tps: 1462.48 qps: 29238.63 (r/w/o: 20467.74/5846.93/2923.96) lat (ms,95%): 3.96 err/s: 0.00 reconn/s: 0.00
    [ 25s ] thds: 4 tps: 1195.35 qps: 23916.06 (r/w/o: 16739.94/4784.41/2391.71) lat (ms,95%): 5.77 err/s: 0.00 reconn/s: 0.00
    [ 26s ] thds: 4 tps: 1193.03 qps: 23868.66 (r/w/o: 16707.46/4775.13/2386.07) lat (ms,95%): 5.47 err/s: 0.00 reconn/s: 0.00
    [ 27s ] thds: 4 tps: 1069.22 qps: 21380.33 (r/w/o: 14970.02/4271.88/2138.43) lat (ms,95%): 5.37 err/s: 0.00 reconn/s: 0.00
    [ 28s ] thds: 4 tps: 905.43 qps: 18092.64 (r/w/o: 12661.04/3620.73/1810.87) lat (ms,95%): 6.79 err/s: 0.00 reconn/s: 0.00
    [ 29s ] thds: 4 tps: 1274.12 qps: 25496.37 (r/w/o: 17845.66/5102.48/2548.24) lat (ms,95%): 5.09 err/s: 0.00 reconn/s: 0.00
    [ 30s ] thds: 4 tps: 1413.53 qps: 28275.61 (r/w/o: 19800.43/5648.13/2827.06) lat (ms,95%): 4.25 err/s: 0.00 reconn/s: 0.00
    SQL statistics:
        queries performed:
            read:                            444640
            write:                           127040
            other:                           63520
            total:                           635200
        transactions:                        31760  (1058.37 per sec.)
        queries:                             635200 (21167.31 per sec.)
        ignored errors:                      0      (0.00 per sec.)
        reconnects:                          0      (0.00 per sec.)
    
    General statistics:
        total time:                          30.0067s
        total number of events:              31760
    
    Latency (ms):
             min:                                    1.98
             avg:                                    3.78
             max:                                   85.99
             95th percentile:                        6.21
             sum:                               119915.24
    
    Threads fairness:
        events (avg/stddev):           7940.0000/70.03
        execution time (avg/stddev):   29.9788/0.00
    

    Code (Text):
    sysbench mysql OLTP new summary:
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql run
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    threads: 4
    read: 444640
    write: 127040
    other: 63520
    total: 635200
    transactions/s: 1058.37
    queries/s: 21167.31
    time: 30.0067s
    min: 1.98
    avg: 3.78
    max: 85.99
    95th: 6.21
    
    | mysql sysbench | sysbench | threads: | read: | write: | other: | total: | transactions/s: | queries/s: | time: | min: | avg: | max: | 95th: |
    | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
    | oltp_read_write.lua | 1.0.17 | 4 | 444640 | 127040 | 63520 | 635200 | 1058.37 | 21167.31 | 30.0067s | 1.98 | 3.78 | 85.99 | 6.21 |
    
    sysbench,sysbench,threads,read,write,other,total,transactions/s,queries/s,time,min,avg,max,95th
    oltp_read_write.lua,1.0.17,4,444640,127040,63520,635200,1058.37,21167.31,30.0067s,1.98,3.78,85.99,6.21
    
    sysbench mysql cleanup database: sbt
    sysbench oltp_read_write.lua --mysql-host=localhost --mysql-port=3306 --mysql-socket=/var/lib/mysql/mysql.sock --mysql-user=sbtest --mysql-password=sbtestpass --mysql-db=sbt --mysql-storage-engine=InnoDB --time=30 --threads=4 --report-interval=1 --rand-type=uniform --rand-seed=1 --table-size=150000 --tables=8 --db-driver=mysql cleanup
    sysbench 1.0.17 (using bundled LuaJIT 2.1.0-beta2)
    
    Dropping table 'sbtest1'...
    Dropping table 'sbtest2'...
    Dropping table 'sbtest3'...
    Dropping table 'sbtest4'...
    Dropping table 'sbtest5'...
    Dropping table 'sbtest6'...
    Dropping table 'sbtest7'...
    Dropping table 'sbtest8'...
    
     
  14. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Just thought I'd update with my experience wtih ssdnodes - the servers are great if you manage to get Intel Xeon Gold Scalable Skylake series or you maybe unlucky and get older Intel Xeon E5-26xx series. However, support response times are very very slow. Recently they have new deals with 2x disk and anniversary sale and I was trying to get my affiliate credits to use for their sale. Unfortunately my support ticket took them 2 weeks to reply and they didn't even fully transfer the credits I had !

    Before this experience, I would of been happy to get ssdnodes VPS for use and even thought about using them for centminmod.com site VPS cluster. But 2 weeks to reply is very long even for budget/lowend VPS provider ! As it stands ssdnodes seems good for testing or if you have strong/frequent external/remote backups of your data as they don't have native backups and I wouldn't be confident in relying on their technical support for matters which require a timely reply.
     
  15. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    LEB member decided to investigate at SSDNodes Singapore Launch - 32GB for $8.25/m and discussion onwards from that post the claim that ssdnode's memory allocation isn't giving users the full usage of their memory purchased.
    and
    Virtio balloon driver Virtio balloon
    The original user reporting ssdnode taking away it's cache/buffered memory at 4+ GB reported he moved to Singapore ssdnodes and not seeing that behaviour like on Frankfurt ssdnodes VPS SSDNodes Singapore Launch - 32GB for $8.25/m so could be new ssdnode VPS host nodes not getting that virtio_balloon due to less neighbours sharing Singapore VPS host node yet.

    So looks like there's some evidence you may not get to use your full memory allocation when ssdnode VPS host node is crowded with neighhours and virtio_balloon driver is in play which is default for all ssdnode VPSes.

    so you can check your memory buffer/cache usage via free command like
    Code (Text):
    free -mltw

    Code (Text):
    free -mltw
                  total        used        free      shared     buffers       cache   available
    Mem:          64000       12524       44037         553         304        7133       50407
    Low:          64000       19963       44037
    High:             0           0           0
    Swap:          2047           0        2047
    Total:        66048       12524       46085
     
  16. adamus007p

    adamus007p Member

    366
    18
    18
    Feb 8, 2019
    Ratings:
    +35
    Local Time:
    4:49 PM
    Hello @eva2000 thank you share your experiences.

    What is your recommendation for VPS?
    about 4GB ram size.
     
  17. eva2000

    eva2000 Administrator Staff Member

    53,250
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    12:49 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Should start your own thread ;) I only ever recommend web hosts I personally use/have used or where my paying clients I handle have use(d). With that said, pretty much my top picks for VPS hosts are ones I most recently benchmarked at DigitalOcean - Linode - Vultr - Benchmarks - Upcloud - 13-Way VPS Server Benchmark Comparison Tests - Upcloud vs DigitalOcean vs Linode vs Vultr vs Hetzner. So start there and test them all as they're all hourly billed anyway.

    Affiliate Links
    ;)

    My go to for new sites these days are Upcloud for performance and Linode for stability (resilient disk storage layer + image/cloning features + free network level DDOS protection).
     
    Last edited: Apr 26, 2020
  18. steph40

    steph40 Member

    84
    17
    8
    Jan 28, 2019
    Ratings:
    +34
    Local Time:
    10:49 AM
    1.1.5
    mariadb 10
    Hi all and @eva2000

    Been with ssdnodes for a long time and tough it was ok till I had an issue last week-end, basically I could not log in cause their firewall blacklisted my ip. They blamed it on me at first saying that they had nothing to do with users not knowing how to use tools like putty. I was not happy with that, I am not a power user but I know how to log in my server!!

    I sent a cancellation demand and told them they had 24h to look into it. That is when they found the firewall issue.

    In the meantime I opened an upcloud trial account and uploaded my site and of course centminmod install. Make a few tweaks and holly shit it is flying.

    How can a 1cpu 1gb vps be faster then a 8 cpu 32gb vps. SSDnones is asking if I want to give then another try but frankly I don't think I am.

    My head is just spinning cause upcloud is running circles around ssdnodes. Still not sure if under load, if I ever get any load, if ssdnodes would be better cause of the extra overhead?

    Any tough would be appreciated.

    BTW using invision power suite 4.5
     
  19. steph40

    steph40 Member

    84
    17
    8
    Jan 28, 2019
    Ratings:
    +34
    Local Time:
    10:49 AM
    1.1.5
    mariadb 10
    And now I am also looking at ovh cause they are closer to me, montreal.
     
  20. Jon Snow

    Jon Snow Active Member

    767
    157
    43
    Jun 30, 2017
    Ratings:
    +225
    Local Time:
    11:49 AM
    Nginx 1.13.9
    MariaDB 10.1.31
    Maybe on SSD Nodes people were stealing your resources because it's a shared environment?

    Did you check your steal via top?