Join the community today
Register Now

Previews centminmodbench.sh - benchmark script for Centmin Mod LEMP servers

Discussion in 'Beta release code' started by eva2000, Sep 8, 2014.

  1. Andy

    Andy Active Member

    540
    88
    28
    Aug 6, 2014
    Ratings:
    +131
    Local Time:
    4:44 AM
    I'm looking forward to it too. Don't want to be disappointed :)
    Btw, how do you get Linode to refund the money you deposit into your account when you no longer use them?

     
  2. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Terms of Service - Linode

     
  3. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    wonder if it's DNS related, I was testing on 768MB Vultr with new sysctl.conf tweaks in place and Linode Atlanta test location was slow <300KB/s. Then did manual wget tests and still slow. Then I disabled wget dns cache and set IPv4 addresses only and it sped up.

    wget standard
    Code:
    wget -O /dev/null http://speedtest.atlanta.linode.com/100MB-atlanta.bin            
    --2014-09-16 14:51:51--  http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    Resolving speedtest.atlanta.linode.com... 50.116.39.117, 2600:3c02::4b
    Connecting to speedtest.atlanta.linode.com|50.116.39.117|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 104857600 (100M) [application/octet-stream]
    Saving to: “/dev/null”
    
    24% [===========================>       ] 25,312,732  29.3K/s  eta 80s  
    
    wget with
    Code:
    --no-dns-cache
    Code:
    wget --no-dns-cache -O /dev/null http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    --2014-09-16 14:52:20--  http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    Resolving speedtest.atlanta.linode.com... 50.116.39.117, 2600:3c02::4b
    Connecting to speedtest.atlanta.linode.com|50.116.39.117|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 104857600 (100M) [application/octet-stream]
    Saving to: “/dev/null”
    
    100%[======================================================================================================================>] 104,857,600 2.07M/s   in 19s  
    
    2014-09-16 14:52:40 (5.13 MB/s) - “/dev/null” saved [104857600/104857600]
    
    wget with
    Code:
    -4 --no-dns-cache
    Code:
    wget -4 --no-dns-cache -O /dev/null http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    --2014-09-16 14:53:40--  http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    Resolving speedtest.atlanta.linode.com... 50.116.39.117
    Connecting to speedtest.atlanta.linode.com|50.116.39.117|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 104857600 (100M) [application/octet-stream]
    Saving to: “/dev/null”
    
    100%[======================================================================================================================>] 104,857,600 4.94M/s   in 11s  
    
    2014-09-16 14:53:51 (9.20 MB/s) - “/dev/null” saved [104857600/104857600]
    
    /etc/resolve.conf
    Code:
    cat /etc/resolv.conf
    # Generated by NetworkManager
    search guest
    nameserver 108.61.216.12
    nameserver 8.8.4.4
     
  4. Andy

    Andy Active Member

    540
    88
    28
    Aug 6, 2014
    Ratings:
    +131
    Local Time:
    4:44 AM
    Wow, there is something about this benchmark script that I think skew the results as far as external forces are concerned. Are there any other bandwidth testing out there that we can run to see if your conf is making a difference?
     
  5. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    FYI, /etc/resolve.conf is whatever Vultr by default sets not what Centmin Mod sets so each provider may have different defaults for that. I am retesting my 768MB Vultr with Google set primary nameserver now instead of what Vultr provided

    Code:
    cat /etc/resolv.conf
    nameserver 8.8.8.8
    nameserver 8.8.4.4
    Also bandwidth tests aren't 100% always the same due to congestion and network factors, so one day you're get one result and another day you can get another :)
     
    Last edited: Sep 17, 2014
  6. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Believe I nailed the problem, setting net.ipv4.tcp_sack to enable in /etc/sysctl.conf along with nameserver 8.8.8.8 in /etc/resolv.conf has Atlanta Linode at 20MB/s. If I disable dns cache and set IPv4 only get's a bit better at 22MB/s for Atlanta Linode download - but it sped up some but slowed down some other locations. Vultr tech support has confirmed at their end that tcp_sack enabled speeds things up. Will be redoing my tests :D

    Doesn't explain why only some VPS providers experience this though.

    Updated .08 beta01 with the change at enable net.ipv4.tcp_sack · 4fa30dd · centminmod/centminmod · GitHub. Strangely, just checked this forum's sysctl.conf and tcp_sack is enabled for my forums but disabled in .08 beta01 - must of been a boo boo :eek: :)

    Code:
    wget -O /dev/null http://speedtest.atlanta.linode.com/100MB-atlanta.bin           
    --2014-09-16 19:48:39--  http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    Resolving speedtest.atlanta.linode.com... 50.116.39.117, 2600:3c02::4b
    Connecting to speedtest.atlanta.linode.com|50.116.39.117|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 104857600 (100M) [application/octet-stream]
    Saving to: “/dev/null”
    
    100%[======================================================================================================================>] 104,857,600 27.2M/s   in 4.7s
    
    2014-09-16 19:48:44 (21.2 MB/s) - “/dev/null” saved [104857600/104857600]
    Code:
     wget -4 --no-dns-cache -O /dev/null http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    --2014-09-16 19:48:46--  http://speedtest.atlanta.linode.com/100MB-atlanta.bin
    Resolving speedtest.atlanta.linode.com... 50.116.39.117
    Connecting to speedtest.atlanta.linode.com|50.116.39.117|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 104857600 (100M) [application/octet-stream]
    Saving to: “/dev/null”
    
    100%[======================================================================================================================>] 104,857,600 29.2M/s   in 4.5s
    
    2014-09-16 19:48:51 (22.2 MB/s) - “/dev/null” saved [104857600/104857600]
    full retest with tcp_sack enabled for 768MB Vultr VPS Los Angeles

    Code:
    -------------------------------------------
    centminmodbench.sh 0.2
    http://bench.centminmod.com
    written by: George Liu (eva2000)
    http://centminmod.com
    -------------------------------------------
    
    -------------------------------------------
    System Information
    -------------------------------------------
    
    2.6.32-431.23.3.el6.x86_64
    
    CentOS release 6.5 (Final)
    
    Centmin Mod
    ----------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                1
    On-line CPU(s) list:   0
    Thread(s) per core:    1
    Core(s) per socket:    1
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 60
    Stepping:              1
    CPU MHz:               3392.158
    BogoMIPS:              6784.31
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0
    
    ----------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
    0   0    0      0    0:0:0      yes
    
    ----------------------------------------------
                 total       used       free     shared    buffers     cached
    Mem:           742        403        339          0         48        118
    Low:           742        403        339
    High:            0          0          0
    -/+ buffers/cache:        235        506
    Swap:         2047          0       2047
    
    ----------------------------------------------
    Filesystem      Size  Used Avail Use% Mounted on
    /dev/vda1        15G  8.7G  5.4G  62% /
    tmpfs           372M     0  372M   0% /dev/shm
    tmpfs           372M     0  372M   0% /tmp
    
    
    Code:
    -------------------------------------------
    disk ioping tests
    -------------------------------------------
    
    
    Running IOPing I/O benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4096 bytes from . (ext4 /dev/vda1): request=1 time=0.2 ms
    4096 bytes from . (ext4 /dev/vda1): request=2 time=0.4 ms
    4096 bytes from . (ext4 /dev/vda1): request=3 time=0.4 ms
    4096 bytes from . (ext4 /dev/vda1): request=4 time=0.4 ms
    4096 bytes from . (ext4 /dev/vda1): request=5 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=6 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=7 time=0.4 ms
    4096 bytes from . (ext4 /dev/vda1): request=8 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=9 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=10 time=0.3 ms
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    10 requests completed in 9004.3 ms, 2995 iops, 11.7 mb/s
    min/avg/max/mdev = 0.2/0.3/0.4/0.0 ms
    
    IOPing seek rate: ./ioping -RD .
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    11592 requests completed in 3000.1 ms, 5155 iops, 20.1 mb/s
    min/avg/max/mdev = 0.1/0.2/3.4/0.1 ms
    
    IOPing sequential: ./ioping -RL .
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    3321 requests completed in 3000.3 ms, 1214 iops, 303.5 mb/s
    min/avg/max/mdev = 0.7/0.8/5.4/0.3 ms
    
    IOPing cached: ./ioping -RC .
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    49657 requests completed in 3000.0 ms, 901871 iops, 3522.9 mb/s
    min/avg/max/mdev = 0.0/0.0/0.3/0.0 ms
    
    
    Code:
    -------------------------------------------
    disk DD tests
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 2.30907 s, 465 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 2.53548 s, 423 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 3.96786 s, 271 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 13.694 s, 78.4 MB/s
    
    Code:
    -------------------------------------------
    disk FIO tests
    -------------------------------------------
    
    
    Running FIO benchmark...
    
    
    FIO random reads:
    randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    randomreads: Laying out IO file(s) (1 file(s) / 1024MB)
    
    randomreads: (groupid=0, jobs=1): err= 0: pid=6990: Tue Sep 16 19:53:25 2014
      read : io=1024.3MB, bw=244482KB/s, iops=61120 , runt=  4290msec
      cpu          : usr=5.74%, sys=33.04%, ctx=70949, majf=0, minf=89
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
       READ: io=1024.3MB, aggrb=244482KB/s, minb=244482KB/s, maxb=244482KB/s, mint=4290msec, maxt=4290msec
    
    Disk stats (read/write):
      vda: ios=246663/0, merge=0/0, ticks=256798/0, in_queue=256754, util=97.66%
    
    FIO random writes:
    randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    
    randomwrites: (groupid=0, jobs=1): err= 0: pid=6994: Tue Sep 16 19:53:30 2014
      write: io=1024.3MB, bw=247599KB/s, iops=61899 , runt=  4236msec
      cpu          : usr=6.14%, sys=29.68%, ctx=37200, majf=0, minf=25
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
      WRITE: io=1024.3MB, aggrb=247598KB/s, minb=247598KB/s, maxb=247598KB/s, mint=4236msec, maxt=4236msec
    
    Disk stats (read/write):
      vda: ios=0/257018, merge=0/3, ticks=0/255957, in_queue=255924, util=97.67%
    
    
    Code:
    
    -------------------------------------------
    Running bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Download Cachefly: 85.5MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Download Linode, Atlanta, GA, USA: 19.5MB/s
    ----------------------------------------------
    Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Download Linode, Dallas, TX, USA: 37.6MB/s
    ----------------------------------------------
    Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Download Leaseweb, Manassas, VA, USA: 4.88MB/s
    ----------------------------------------------
    Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Seattle, WA, USA: 56.3MB/s
    ----------------------------------------------
    Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, San Jose, CA, USA: 76.9MB/s
    ----------------------------------------------
    Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Washington, DC, USA: 33.6MB/s
    ----------------------------------------------
    Download from VersaWeb, Las Vegas, Nevada (http://199.47.210.50/100mbtest.bin)
    Download VersaWeb, Las Vegas, Nevada: 79.5MB/s
    ----------------------------------------------
    Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Download OVH, BHS, Canada: 2.70MB/s
    ----------------------------------------------
    Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Los Angeles, California: 98.8MB/s
    ----------------------------------------------
    Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Seattle, Washington: 41.9MB/s
    ----------------------------------------------
    Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Dallas, Texas: 34.8MB/s
    ----------------------------------------------
    Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Chicago, Illinois: 22.1MB/s
    ----------------------------------------------
    Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Atlanta, Georgia: 648KB/s
    ----------------------------------------------
    Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Miami, Florida: 18.7MB/s
    ----------------------------------------------
    Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, New York / New Jersey: 5.52MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Download Linode, Tokyo, JP: 14.2MB/s
    ----------------------------------------------
    Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Singapore: 11.2MB/s
    ----------------------------------------------
    Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Tokyo, Japan: 12.1MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Download Linode, London, UK: 10.7MB/s
    ----------------------------------------------
    Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Download OVH, Paris, France: 7.45MB/s
    ----------------------------------------------
    Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Download SmartDC, Rotterdam, Netherlands: 6.02MB/s
    ----------------------------------------------
    Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Amsterdam, Netherlands: 5.39MB/s
    ----------------------------------------------
    Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, London, UK: 8.99MB/s
    ----------------------------------------------
    Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Paris, France: 8.15MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Sydney, Australia: 9.42MB/s
    
    Code:
    
    -------------------------------------------
    Running Axel multi-threaded bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Axel Download Cachefly: 88.41MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Axel Download Linode, Atlanta, GA, USA: 42.21MB/s
    ----------------------------------------------
    Axel Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Axel Download Linode, Dallas, TX, USA: 46.03MB/s
    ----------------------------------------------
    Axel Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Axel Download Leaseweb, Manassas, VA, USA: 26.51MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Seattle, WA, USA: 61.26MB/s
    ----------------------------------------------
    Axel Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, San Jose, CA, USA: 70.57MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Washington, DC, USA: 10.10MB/s
    ----------------------------------------------
    Axel Download from VersaWeb, Las Vegas, Nevada (http://199.47.210.50/100mbtest.bin)
    Axel Download VersaWeb, Las Vegas, Nevada: 83.12MB/s
    ----------------------------------------------
    Axel Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, BHS, Canada: 3.77MB/s
    ----------------------------------------------
    Axel Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Los Angeles, California: 89.54MB/s
    ----------------------------------------------
    Axel Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Seattle, Washington: 41.09MB/s
    ----------------------------------------------
    Axel Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Dallas, Texas: 38.77MB/s
    ----------------------------------------------
    Axel Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Chicago, Illinois: 21.94MB/s
    ----------------------------------------------
    Axel Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Atlanta, Georgia: .27MB/s
    ----------------------------------------------
    Axel Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Miami, Florida: 19.31MB/s
    ----------------------------------------------
    Axel Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, New York / New Jersey: 5.57MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Axel Download Linode, Tokyo, JP: 15.60MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Singapore: 15.45MB/s
    ----------------------------------------------
    Axel Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Tokyo, Japan: 10.94MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Axel Download Linode, London, UK: 22.82MB/s
    ----------------------------------------------
    Axel Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, Paris, France: 14.39MB/s
    ----------------------------------------------
    Axel Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Axel Download SmartDC, Rotterdam, Netherlands: 9.69MB/s
    ----------------------------------------------
    Axel Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Amsterdam, Netherlands: 4.92MB/s
    ----------------------------------------------
    Axel Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, London, UK: 8.88MB/s
    ----------------------------------------------
    Axel Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Paris, France: 8.11MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Sydney, Australia: 8.67MB/s
    
    Code:
    
    -------------------------------------------
    Running ping tests...
    -------------------------------------------
    
    ----------------------------------------------
    Pings (cachefly.cachefly.net):
    PING vip1.g.cachefly.net (205.234.175.175) 56(84) bytes of data.
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=1 ttl=60 time=0.398 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=2 ttl=60 time=0.382 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=3 ttl=60 time=0.531 ms
    
    --- vip1.g.cachefly.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 0.382/0.437/0.531/0.066 ms
    
    ----------------------------------------------
    Pings (syd-au-ping.vultr.com):
    PING syd-au-ping.vultr.com (108.61.212.117) 56(84) bytes of data.
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=1 ttl=53 time=137 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=2 ttl=53 time=160 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=3 ttl=53 time=159 ms
    
    --- syd-au-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2162ms
    rtt min/avg/max/mdev = 137.669/152.606/160.623/10.571 ms
    
    ----------------------------------------------
    Pings (hnd-jp-ping.vultr.com):
    PING hnd-jp-ping.vultr.com (108.61.201.151) 56(84) bytes of data.
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=1 ttl=53 time=112 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=2 ttl=53 time=112 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=3 ttl=53 time=109 ms
    
    --- hnd-jp-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2111ms
    rtt min/avg/max/mdev = 109.098/111.459/112.966/1.690 ms
    
    ----------------------------------------------
    Pings (lax-ca-us-ping.vultr.com):
    PING lax-ca-us-ping.vultr.com (108.61.219.200) 56(84) bytes of data.
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=1 ttl=63 time=0.968 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=2 ttl=63 time=0.710 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=3 ttl=63 time=0.727 ms
    
    --- lax-ca-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2002ms
    rtt min/avg/max/mdev = 0.710/0.801/0.968/0.122 ms
    
    ----------------------------------------------
    Pings (wa-us-ping.vultr.com):
    PING wa-us-ping.vultr.com (108.61.194.105) 56(84) bytes of data.
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=1 ttl=56 time=29.5 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=2 ttl=56 time=29.5 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=3 ttl=56 time=29.5 ms
    
    --- wa-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2032ms
    rtt min/avg/max/mdev = 29.557/29.561/29.569/0.140 ms
    
    ----------------------------------------------
    Pings (tx-us-ping.vultr.com):
    PING tx-us-ping.vultr.com (108.61.224.175) 56(84) bytes of data.
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=1 ttl=57 time=33.9 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=2 ttl=57 time=33.9 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=3 ttl=57 time=33.8 ms
    
    --- tx-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2036ms
    rtt min/avg/max/mdev = 33.849/33.922/33.980/0.054 ms
    
    ----------------------------------------------
    Pings (il-us-ping.vultr.com):
    PING il-us-ping.vultr.com (107.191.51.12) 56(84) bytes of data.
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=1 ttl=55 time=57.7 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=2 ttl=55 time=57.6 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=3 ttl=55 time=57.6 ms
    
    --- il-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2060ms
    rtt min/avg/max/mdev = 57.657/57.684/57.712/0.197 ms
    
    ----------------------------------------------
    Pings (ga-us-ping.vultr.com):
    PING ga-us-ping.vultr.com (108.61.193.166) 56(84) bytes of data.
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=1 ttl=55 time=94.4 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=2 ttl=55 time=94.4 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=3 ttl=55 time=94.4 ms
    
    --- ga-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2094ms
    rtt min/avg/max/mdev = 94.429/94.464/94.493/0.355 ms
    
    ----------------------------------------------
    Pings (fl-us-ping.vultr.com):
    PING fl-us-ping.vultr.com (104.156.244.232) 56(84) bytes of data.
    64 bytes from 104.156.244.232: icmp_seq=1 ttl=57 time=106 ms
    64 bytes from 104.156.244.232: icmp_seq=2 ttl=57 time=106 ms
    64 bytes from 104.156.244.232: icmp_seq=3 ttl=57 time=106 ms
    
    --- fl-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2109ms
    rtt min/avg/max/mdev = 106.663/106.689/106.715/0.377 ms
    
    ----------------------------------------------
    Pings (nj-us-ping.vultr.com):
    PING nj-us-ping.vultr.com (108.61.149.182) 56(84) bytes of data.
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=1 ttl=55 time=76.1 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=2 ttl=55 time=76.6 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=3 ttl=55 time=76.8 ms
    
    --- nj-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2080ms
    rtt min/avg/max/mdev = 76.156/76.545/76.855/0.368 ms
    
    ----------------------------------------------
    Pings (fra-de-ping.vultr.com):
    PING fra-de-ping.vultr.com (108.61.210.117) 56(84) bytes of data.
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=1 ttl=58 time=160 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=2 ttl=58 time=160 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=3 ttl=58 time=160 ms
    
    --- fra-de-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2162ms
    rtt min/avg/max/mdev = 160.309/160.403/160.467/0.067 ms
    
    ----------------------------------------------
    Pings (ams-nl-ping.vultr.com):
    PING ams-nl-ping.vultr.com (108.61.198.102) 56(84) bytes of data.
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=1 ttl=55 time=248 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=2 ttl=55 time=247 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=3 ttl=55 time=250 ms
    
    --- ams-nl-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2251ms
    rtt min/avg/max/mdev = 247.963/249.115/250.481/1.188 ms
    
    ----------------------------------------------
    Pings (lon-gb-ping.vultr.com):
    PING lon-gb-ping.vultr.com (108.61.196.101) 56(84) bytes of data.
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=1 ttl=55 time=150 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=2 ttl=55 time=144 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=3 ttl=55 time=147 ms
    
    --- lon-gb-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2148ms
    rtt min/avg/max/mdev = 144.344/147.712/150.934/2.728 ms
    
    ----------------------------------------------
    Pings (par-fr-ping.vultr.com):
    PING par-fr-ping.vultr.com (108.61.209.127) 56(84) bytes of data.
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=1 ttl=58 time=151 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=2 ttl=58 time=151 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=3 ttl=58 time=152 ms
    
    --- par-fr-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2155ms
    rtt min/avg/max/mdev = 151.904/151.987/152.076/0.070 ms
    
    ----------------------------------------------
    Pings (VersaWeb Las Vegas):
    PING 199.47.210.50 (199.47.210.50) 56(84) bytes of data.
    64 bytes from 199.47.210.50: icmp_seq=1 ttl=59 time=9.29 ms
    64 bytes from 199.47.210.50: icmp_seq=2 ttl=59 time=8.95 ms
    64 bytes from 199.47.210.50: icmp_seq=3 ttl=59 time=8.34 ms
    
    --- 199.47.210.50 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2011ms
    rtt min/avg/max/mdev = 8.346/8.863/9.293/0.399 ms
    
    ----------------------------------------------
    Pings (VersaWeb Seattle):
    PING 76.164.234.1 (76.164.234.1) 56(84) bytes of data.
    64 bytes from 76.164.234.1: icmp_seq=1 ttl=55 time=6800 ms
    64 bytes from 76.164.234.1: icmp_seq=2 ttl=54 time=5805 ms
    64 bytes from 76.164.234.1: icmp_seq=3 ttl=55 time=4807 ms
    
    --- 76.164.234.1 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 6807ms
    rtt min/avg/max/mdev = 4807.472/5804.615/6800.663/813.721 ms, pipe 3
    
    ----------------------------------------------
    Pings (OVH Canada):
    PING bhs.proof.ovh.net (192.99.19.165) 56(84) bytes of data.
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=1 ttl=51 time=79.3 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=2 ttl=51 time=77.8 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=3 ttl=51 time=78.4 ms
    
    --- bhs.proof.ovh.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2081ms
    rtt min/avg/max/mdev = 77.848/78.545/79.330/0.688 ms
    
    
    Code:
    
    -------------------------------------------
    Running mtr tests...
    -------------------------------------------
    
    ----------------------------------------------
    mtr --report --report-cycles=10 cachefly.cachefly.net
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.7   0.5   2.0   0.5
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    3.2   6.3   2.6  10.6   2.7
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    4.0   2.0   0.4   6.8   2.3
      4. vlan-73.ar1.lax1.us.as4436.g  0.0%    10    2.1   3.5   1.8   5.4   1.5
      5. vip1.G-anycast1.cachefly.net  0.0%    10    0.5   0.5   0.4   0.5   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 syd-au-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.9   0.5   3.9   1.1
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    9.1   6.6   4.7   9.1   1.7
      3. ae-7.r04.lsanca03.us.bb.gin.  0.0%    10    2.1   1.8   0.9   2.9   0.7
      4. ae-6.r21.lsanca03.us.bb.gin.  0.0%    10    4.3   3.3   0.7  14.8   4.6
      5. xe-0-0-0.r02.lsanca03.us.bb.  0.0%    10    0.7   1.8   0.6   3.8   1.2
      6. as-3.r05.sydnau01.au.bb.gin.  0.0%    10  181.6 155.2 137.3 182.0  22.8
      7. xe-1-0-0.r05.sydnau01.au.bb.  0.0%    10  137.2 146.5 137.2 159.9  11.1
      8. 202.68.67.42                  0.0%    10  159.8 151.0 137.1 160.3  11.3
      9. xe-1-0-0.gw102.sy1.ap.equini  0.0%    10  161.6 153.5 137.5 162.2  10.8
    10. xe-1-0-0.gw102.sy1.ap.equini  0.0%    10  160.0 155.6 137.5 184.1  16.6
    11. 27.111.243.214                0.0%    10  162.4 149.7 137.4 162.4  12.2
    12. 108.61.212.117.vultr.com     10.0%    10  137.4 147.9 137.4 161.0  12.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 hnd-jp-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.5   0.4   0.6   0.0
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    5.1   6.9   2.6  14.2   3.3
      3. ae-7.r04.lsanca03.us.bb.gin.  0.0%    10    1.4   1.2   0.9   1.5   0.2
      4. ae-6.r21.lsanca03.us.bb.gin.  0.0%    10    0.6   6.8   0.6  32.6  12.0
      5. ae-3.r21.tokyjp05.jp.bb.gin.  0.0%    10  102.0 103.4  98.9 107.3   3.3
      6. ae-0.r25.tokyjp05.jp.bb.gin.  0.0%    10  106.9 110.1  98.8 142.0  11.9
      7. ae-2.r01.tokyjp03.jp.bb.gin.  0.0%    10  101.6 105.1  99.9 108.5   3.5
      8. xe-0-0-0-30.r01.tokyjp03.jp.  0.0%    10  108.0 103.6 100.8 108.0   3.2
      9. 72.ae2.sw1.tko1.jp.scnet.net  0.0%    10  107.8 108.5 104.1 111.7   3.2
    10. unknown.servercentral.net     0.0%    10  114.3 110.3 105.2 115.0   3.8
    11. 108.61.201.151.vultr.com     10.0%    10  102.7 109.0 102.7 114.9   4.3
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lax-ca-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.5   0.5   0.6   0.0
      2. 108.61.219.200.vultr.com      0.0%    10    1.0   0.8   0.7   1.0   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 wa-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.5   0.5   0.6   0.0
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    6.6   7.0   2.5  10.7   3.0
      3. as2914.xe-2-0-2.ar1.lax2.us.  0.0%    10    0.9   1.2   0.8   2.7   0.7
      4. xe-0.level3.lsanca03.us.bb.g  0.0%    10   39.4  12.2   8.8  39.4   9.6
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    10. ae-1-51.edge2.Seattle1.Level  0.0%    10   29.5  29.4  29.4  29.6   0.1
    11. CHOOPA-LLC.edge2.Seattle1.Le  0.0%    10   29.7  29.7  29.6  29.7   0.0
    12. 108.61.194.105.vultr.com      0.0%    10   29.6  29.6  29.5  29.7   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 tx-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.7   0.5   2.1   0.5
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    9.3   7.5   2.7  14.3   3.2
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    0.4   1.4   0.3  11.0   3.4
      4. ae6-69.lax20.ip4.gtt.net      0.0%    10    0.8   0.6   0.6   0.8   0.1
      5. xe-0-0-0.dal33.ip4.gtt.net    0.0%    10   33.9  33.5  31.4  34.1   1.1
      6. ae10-69.cr1.dfw1.ip4.gtt.net  0.0%    10   34.0  37.8  34.0  72.1  12.1
      7. as20473.xe-5-1-2.cr1.dfw1.us  0.0%    10   31.3  31.6  31.3  33.5   0.7
      8. 108.61.224.175.vultr.com      0.0%    10   34.0  34.0  33.9  34.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 il-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.4   2.4   0.4   7.7   2.8
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    4.8   6.1   2.0  11.0   3.1
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    0.4   7.0   0.3  22.3   9.2
      4. ae6-214.lax20.ip4.gtt.net     0.0%    10    7.0   3.7   0.4  10.2   4.3
      5. xe-8-3-0.chi12.ip4.gtt.net    0.0%    10   61.0  61.0  60.9  61.1   0.0
      6. as23353.chi12.ip4.gtt.net     0.0%    10   55.8  61.3  55.7 108.1  16.5
      7. ae4.cr1.ord6.us.scnet.net     0.0%    10   56.5  56.9  56.4  59.0   1.0
      8. ae1.ar10.ord6.us.scnet.net    0.0%    10   62.4  63.1  62.2  70.8   2.7
      9. ethernet7-1-br1.chi2.choopa.  0.0%    10   56.6  59.3  56.5  68.0   3.6
    10. 107.191.51.12.vultr.com       0.0%    10   62.3  62.3  62.2  62.4   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ga-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   1.0   0.4   5.9   1.7
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10   11.2   7.7   1.4  14.3   4.1
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    0.4   5.0   0.4  46.2  14.5
      4. ae6-69.lax20.ip4.gtt.net      0.0%    10    2.6  15.3   0.6  42.4  17.8
      5. xe-7-2-0.atl11.ip4.gtt.net    0.0%    10   48.9  52.8  48.7  67.2   7.3
      6. gtt-gw.ip4.gtt.net            0.0%    10   72.5  72.7  69.9  94.0   7.5
      7. ae1-40g.cr2.atl1.us.as4436.g  0.0%    10   71.3  70.2  65.6  86.2   6.5
      8. as20473.xe-1-3-1.cr2.atl1.us  0.0%    10   94.6  94.8  94.4  97.7   1.0
      9. 108.61.193.166.vultr.com      0.0%    10   94.4  94.6  94.3  94.8   0.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fl-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.7   0.5   2.3   0.6
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    7.2   7.0   2.4  16.2   4.8
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    3.9   1.1   0.3   3.9   1.2
      4. ae6-69.lax20.ip4.gtt.net      0.0%    10    0.7   5.1   0.6  38.0  11.7
      5. xe-0-0-3.mia12.ip4.gtt.net    0.0%    10  106.9 107.0 106.7 108.2   0.5
      6. gtt-gw.ip4.gtt.net            0.0%    10  106.6 108.9 106.6 119.3   4.6
      7. as20473.ae5-1914.cr1.mia1.us  0.0%    10  106.9 107.5 106.9 110.0   1.1
      8. 104.156.244.232               0.0%    10  106.7 106.8 106.7 106.9   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 nj-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.5   0.5   0.9   0.1
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10   11.6   8.2   3.6  15.8   5.1
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    0.3   0.4   0.3   0.5   0.0
      4. ae6-69.lax20.ip4.gtt.net      0.0%    10    0.6   2.6   0.5  18.5   5.6
      5. xe-1-3-1.nyc41.ip4.gtt.net    0.0%    10   79.5  77.5  75.2  81.6   2.5
      6. ae5-69.cr1.ewr1.ip4.gtt.net   0.0%    10   75.1  80.6  75.1 129.1  17.0
      7. ae1-70g.ar2.ewr1.us.as4436.g  0.0%    10   80.6  81.9  80.5  86.9   2.0
      8. as20473.ae2.ar2.ewr1.us.as44  0.0%    10   83.4  84.6  79.9  89.8   3.8
      9. ethernet1-49-c11-8-c6-1.pnj1  0.0%    10   75.8  75.8  75.6  76.3   0.3
    10. 108.61.149.182.vultr.com      0.0%    10   75.7  75.7  75.7  75.9   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fra-de-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.5   0.4   0.6   0.0
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    7.6   7.4   2.1  21.8   6.2
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    0.4   2.7   0.4  19.4   5.9
      4. ae6-214.lax20.ip4.gtt.net     0.0%    10    0.5   3.4   0.4  28.3   8.8
      5. xe-4-2-2.fra61.ip4.gtt.net    0.0%    10  175.7 167.3 163.5 186.4   7.7
      6. choopa-gw.ip4.gtt.net         0.0%    10  160.5 160.5 160.4 160.6   0.1
      7. 108.61.210.117.vultr.com     10.0%    10  160.5 160.4 160.3 160.6   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ams-nl-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.5   0.5   1.0   0.2
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    7.7   6.9   4.1   9.8   2.1
      3. as2914.xe-3-0-1.ar1.lax2.us.  0.0%    10    2.0   1.3   0.7   3.5   0.9
      4. ae-5.r04.lsanca03.us.bb.gin.  0.0%    10    1.1   1.3   0.9   2.1   0.4
      5. xe-0.level3.lsanca03.us.bb.g 10.0%    10    8.8   8.9   8.8   9.1   0.1
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lon-gb-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.5   0.4   0.6   0.0
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    5.6   7.1   3.3  15.8   4.0
      3. as2914.xe-2-0-2.ar1.lax2.us.  0.0%    10    1.3   0.9   0.7   1.3   0.2
      4. xe-3.level3.lsanca03.us.bb.g 40.0%    10    9.0   8.9   8.9   9.0   0.1
      5. vlan60.csw1.LosAngeles1.Leve  0.0%    10  143.1 140.1 139.1 143.1   1.2
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 par-fr-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10   19.4   4.4   0.5  19.4   6.8
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10   13.1   7.4   1.9  13.1   3.5
      3. ae0-50g.cr1.lax2.us.as4436.g  0.0%    10    2.0  10.1   0.3  94.3  29.6
      4. ae6-214.lax20.ip4.gtt.net     0.0%    10    0.4   0.4   0.4   0.5   0.0
      5. xe-5-2-0.par90.ip4.gtt.net    0.0%    10  151.8 152.1 151.7 153.5   0.6
      6. choopa-gw.ip4.gtt.net         0.0%    10  152.1 152.1 152.0 152.4   0.2
      7. 108.61.209.127.vultr.com     10.0%    10  152.0 152.1 152.0 152.6   0.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Las Vegas
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.6   0.5   1.2   0.2
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    6.0   7.1   2.7  12.6   3.3
      3. ae-7.r04.lsanca03.us.bb.gin.  0.0%    10    0.9   1.3   0.8   2.2   0.5
      4. xe-0-1-0-5.r04.lsanca03.us.c  0.0%    10   11.0  13.5   8.0  18.8   3.8
      5. te3-4.core1.las1.fiberhub.ne  0.0%    10    8.0   8.2   7.9   8.5   0.2
      6. 199.47.210.50                 0.0%    10    8.6   8.4   8.1   9.0   0.3
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Seattle
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.5   0.6   0.5   1.6   0.3
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    3.1   7.9   3.1  16.5   4.5
      3. ae-7.r04.lsanca03.us.bb.gin.  0.0%    10    0.9   1.1   0.8   1.6   0.3
      4. ae-6.r21.lsanca03.us.bb.gin.  0.0%    10    0.6   2.6   0.6  13.7   4.4
      5. ae-1.r20.snjsca04.us.bb.gin. 10.0%    10    9.4   9.8   9.0  10.6   0.6
      6. ae-0.r21.snjsca04.us.bb.gin.  0.0%    10    9.3  10.4   9.0  16.1   2.5
      7. ae-3.r20.sttlwa01.us.bb.gin.  0.0%    10   26.9  30.8  25.6  62.8  11.4
      8. ae-1.r04.sttlwa01.us.bb.gin.  0.0%    10   28.0  28.0  26.9  30.0   1.1
      9. xe-0-0-0-15.r04.sttlwa01.us.  0.0%    10   28.1  27.9  26.3  29.6   0.9
    10. 76.164.234.1                  0.0%    10   28.5 453.9  26.5 2620. 868.7
    
    ----------------------------------------------
    mtr --report --report-cycles=10 OVH Canada
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 108.61.206.1                  0.0%    10    0.4   0.5   0.4   0.8   0.1
      2. xe-6-0-1.ar1.lax2.us.as4436.  0.0%    10    2.3   7.5   1.8  13.2   4.1
      3. ae1-80g.cr1.lax1.us.as4436.g  0.0%    10    0.4   6.3   0.3  39.1  13.2
      4. ae2-50g.ar1.lax1.us.as4436.g  0.0%    10    2.1   2.6   1.3   5.3   1.2
      5. xe-0-1-3.losangeles2.loa.sea  0.0%    10    0.6   0.5   0.4   0.6   0.0
      6. xe-2-1-0.paloalto2.pao.seabo  0.0%    10   10.2  10.3  10.1  11.1   0.3
      7. pal-5-6k.ca.us               30.0%    10   75.3  75.5  75.3  75.8   0.2
      8. 198.27.73.188                60.0%    10  110.1  97.4  75.3 114.9  18.4
      9. 198.27.73.175                10.0%    10   77.4  77.5  77.3  78.6   0.4
    10. bhs-g2-6k.qc.ca               0.0%    10   79.8  79.6  79.2  80.7   0.6
    11. 198.27.73.98                  0.0%    10   78.1  78.3  78.0  79.3   0.3
    12. ns238643.ip-192-99-19.net     0.0%    10   77.7  77.8  77.7  78.6   0.3
    
    
    Code:
    -------------------------------------------
    OpenSSL System Benchmark
    -------------------------------------------
    
    OpenSSL 1.0.1e-fips 11 Feb 2013
    -------------------------------------------
    openssl speed rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc -multi 1
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    md5              64125.74k   191202.47k   424052.14k   605287.42k   690372.61k
    sha1             71757.08k   200096.17k   431484.07k   650045.10k   778078.89k
    rc4             465067.28k   714087.13k   831724.89k   828923.22k   861503.49k
    aes-128 cbc     135267.74k   148098.77k   155273.64k   327506.60k   328111.45k
    aes-256 cbc     101223.39k   108227.56k   110160.30k   235951.10k   240896.68k
    sha256           52976.88k   120971.80k   207456.34k   248355.50k   269168.85k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.001086s 0.000034s    920.8  29411.8
    rsa 4096 bits 0.007728s 0.000122s    129.4   8196.7
                                  sign    verify    sign/s verify/s
    256 bit ecdsa (nistp256)   0.0001s   0.0004s  10101.0   2673.8
    -------------------------------------------
    openssl speed -evp aes256 -multi 1
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp             516572.20k   552890.18k   559606.95k   560099.33k   560747.86k
    -------------------------------------------
    openssl speed -evp aes128 -multi 1
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp             685817.94k   757148.93k   776397.82k   783619.41k   783417.34k
    
    Code:
    -------------------------------------------
    Running mysqlslap
    -------------------------------------------
    
    mysqlslap --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-secondary-indexes=5 --number-int-cols=5 --number-char-cols=5 --number-of-queries=25000 --auto-generate-sql-unique-query-number=40 --auto-generate-sql-unique-write-number=40 --auto-generate-sql-write-number=1000 --concurrency=64 --iterations=10 --engine=myisam
    Benchmark
            Running for engine myisam
            Average number of seconds to run all queries: 1.638 seconds
            Minimum number of seconds to run all queries: 1.598 seconds
            Maximum number of seconds to run all queries: 1.683 seconds
            Number of clients running queries: 64
            Average number of queries per client: 390
    
    Dropping the database is potentially a very bad thing to do.
    Any data stored in the database will be destroyed.
    
    Do you really want to drop the 'test' database [y/N] Database "test" dropped
    
    Code:
    -------------------------------------------
    System PHP Info
    -------------------------------------------
    
    CPU: 1 x Vultr Virtual CPU 2
                 total       used       free     shared    buffers     cached
    Mem:           742        352        389          0         43        100
    Low:           742        352        389
    High:            0          0          0
    -/+ buffers/cache:        208        534
    Swap:         2047          0       2047
    ----------------------------------------------
    PHP 5.4.32 (cli) (built: Sep  8 2014 18:30:48)
    Copyright (c) 1997-2014 The PHP Group
    Zend Engine v2.4.0, Copyright (c) 1998-2014 Zend Technologies
    ----------------------------------------------
    Configuration File (php.ini) Path: /usr/local/lib
    Loaded Configuration File:         /usr/local/lib/php.ini
    Scan for additional .ini files in: /etc/centminmod/php.d
    Additional .ini files parsed:      /etc/centminmod/php.d/apc.ini,
    /etc/centminmod/php.d/igbinary.ini,
    /etc/centminmod/php.d/imagick.ini,
    /etc/centminmod/php.d/memcache.ini,
    /etc/centminmod/php.d/memcached.ini
    
    ----------------------------------------------
    [PHP Modules]
    apc
    bcmath
    bz2
    calendar
    Core
    ctype
    curl
    date
    dom
    enchant
    ereg
    exif
    filter
    ftp
    gd
    gettext
    gmp
    hash
    iconv
    igbinary
    imagick
    imap
    intl
    json
    libxml
    mbstring
    mcrypt
    memcache
    memcached
    mhash
    mysql
    mysqli
    mysqlnd
    openssl
    pcntl
    pcre
    PDO
    pdo_mysql
    pdo_sqlite
    Phar
    posix
    pspell
    readline
    Reflection
    session
    shmop
    SimpleXML
    soap
    sockets
    SPL
    sqlite3
    standard
    sysvmsg
    sysvsem
    sysvshm
    tidy
    tokenizer
    xml
    xmlreader
    xmlrpc
    xmlwriter
    zip
    zlib
    
    [Zend Modules]
    
    ----------------------------------------------
    -------------------------------------------
    Run PHP test Zend/bench.php
    -------------------------------------------
    
    simple             0.055
    simplecall         0.096
    simpleucall        0.092
    simpleudcall       0.097
    mandel             0.138
    mandel2            0.192
    ackermann(7)       0.072
    ary(50000)         0.016
    ary2(50000)        0.014
    ary3(2000)         0.113
    fibo(30)           0.261
    hash1(50000)       0.027
    hash2(500)         0.030
    heapsort(20000)    0.061
    matrix(20)         0.070
    nestedloop(12)     0.107
    sieve(30)          0.072
    strcat(200000)     0.009
    ------------------------
    Total              1.520
    real: 1.53s user: 1.51s sys: 0.01s cpu: 99% maxmem: 123712 KB cswaits: 3
    
    simple             0.056
    simplecall         0.095
    simpleucall        0.092
    simpleudcall       0.097
    mandel             0.137
    mandel2            0.192
    ackermann(7)       0.072
    ary(50000)         0.015
    ary2(50000)        0.014
    ary3(2000)         0.113
    fibo(30)           0.255
    hash1(50000)       0.025
    hash2(500)         0.029
    heapsort(20000)    0.056
    matrix(20)         0.067
    nestedloop(12)     0.096
    sieve(30)          0.072
    strcat(200000)     0.009
    ------------------------
    Total              1.492
    real: 1.51s user: 1.49s sys: 0.01s cpu: 99% maxmem: 123712 KB cswaits: 1
    
    simple             0.057
    simplecall         0.094
    simpleucall        0.092
    simpleudcall       0.095
    mandel             0.143
    mandel2            0.195
    ackermann(7)       0.073
    ary(50000)         0.014
    ary2(50000)        0.013
    ary3(2000)         0.112
    fibo(30)           0.254
    hash1(50000)       0.025
    hash2(500)         0.028
    heapsort(20000)    0.056
    matrix(20)         0.069
    nestedloop(12)     0.095
    sieve(30)          0.071
    strcat(200000)     0.009
    ------------------------
    Total              1.497
    real: 1.51s user: 1.49s sys: 0.01s cpu: 99% maxmem: 123712 KB cswaits: 1
    
    bench.php results from 3 runs
    1.520
    1.492
    1.497
    
    bench.php avg: 1.5030
    Avg: real: 1.52s user: 1.50s sys: 0.01s cpu: 99.00% maxmem: 123712.00KB cswaits: 1.67
    created results log at /home/phpbench_logs/bench_160914-195236.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_160914-195236.log
    
    -------------------------------------------
    Run PHP test Zend/micro_bench.php
    -------------------------------------------
    
    empty_loop         0.091
    func()             0.251    0.160
    undef_func()       0.254    0.164
    int_func()         0.232    0.141
    $x = self::$x      0.206    0.115
    self::$x = 0       0.218    0.127
    isset(self::$x)    0.173    0.082
    empty(self::$x)    0.176    0.086
    $x = Foo::$x       0.172    0.081
    Foo::$x = 0        0.168    0.077
    isset(Foo::$x)     0.148    0.057
    empty(Foo::$x)     0.156    0.065
    self::f()          0.274    0.183
    Foo::f()           0.250    0.160
    $x = $this->x      0.183    0.093
    $this->x = 0       0.229    0.139
    $this->x += 2      0.177    0.086
    ++$this->x         0.156    0.065
    --$this->x         0.147    0.056
    $this->x++         0.178    0.088
    $this->x--         0.167    0.076
    isset($this->x)    0.162    0.072
    empty($this->x)    0.168    0.077
    $this->f()         0.309    0.219
    $x = Foo::TEST     0.158    0.067
    new Foo()          0.576    0.486
    $x = TEST          0.126    0.035
    $x = $_GET         0.286    0.195
    $x = $GLOBALS['v'] 0.447    0.356
    $x = $hash['v']    0.281    0.190
    $x = $str[0]       0.252    0.162
    $x = $a ?: null    0.173    0.082
    $x = $f ?: tmp     0.231    0.140
    $x = $f ? $f : $a  0.189    0.099
    $x = $f ? $f : tmp 0.231    0.140
    ------------------------
    Total              7.593
    real: 7.61s user: 7.59s sys: 0.00s cpu: 99% maxmem: 75536 KB cswaits: 1
    
    empty_loop         0.085
    func()             0.252    0.167
    undef_func()       0.390    0.306
    int_func()         0.240    0.155
    $x = self::$x      0.195    0.110
    self::$x = 0       0.184    0.100
    isset(self::$x)    0.174    0.089
    empty(self::$x)    0.178    0.093
    $x = Foo::$x       0.175    0.090
    Foo::$x = 0        0.163    0.079
    isset(Foo::$x)     0.154    0.069
    empty(Foo::$x)     0.170    0.086
    self::f()          0.280    0.195
    Foo::f()           0.241    0.157
    $x = $this->x      0.176    0.092
    $this->x = 0       0.239    0.155
    $this->x += 2      0.168    0.083
    ++$this->x         0.154    0.070
    --$this->x         0.145    0.061
    $this->x++         0.179    0.094
    $this->x--         0.166    0.081
    isset($this->x)    0.170    0.086
    empty($this->x)    0.187    0.103
    $this->f()         0.322    0.238
    $x = Foo::TEST     0.171    0.087
    new Foo()          0.628    0.543
    $x = TEST          0.131    0.047
    $x = $_GET         0.319    0.235
    $x = $GLOBALS['v'] 0.487    0.403
    $x = $hash['v']    0.283    0.198
    $x = $str[0]       0.252    0.168
    $x = $a ?: null    0.168    0.084
    $x = $f ?: tmp     0.230    0.146
    $x = $f ? $f : $a  0.181    0.096
    $x = $f ? $f : tmp 0.230    0.145
    ------------------------
    Total              7.868
    real: 7.88s user: 7.87s sys: 0.00s cpu: 99% maxmem: 75536 KB cswaits: 1
    
    empty_loop         0.085
    func()             0.256    0.172
    undef_func()       0.270    0.186
    int_func()         0.231    0.146
    $x = self::$x      0.193    0.108
    self::$x = 0       0.185    0.101
    isset(self::$x)    0.168    0.084
    empty(self::$x)    0.177    0.092
    $x = Foo::$x       0.174    0.090
    Foo::$x = 0        0.168    0.083
    isset(Foo::$x)     0.149    0.065
    empty(Foo::$x)     0.156    0.072
    self::f()          0.270    0.186
    Foo::f()           0.262    0.178
    $x = $this->x      0.182    0.098
    $this->x = 0       0.238    0.154
    $this->x += 2      0.170    0.086
    ++$this->x         0.151    0.067
    --$this->x         0.153    0.069
    $this->x++         0.187    0.102
    $this->x--         0.169    0.085
    isset($this->x)    0.159    0.074
    empty($this->x)    0.168    0.083
    $this->f()         0.277    0.193
    $x = Foo::TEST     0.157    0.072
    new Foo()          0.536    0.452
    $x = TEST          0.123    0.039
    $x = $_GET         0.286    0.202
    $x = $GLOBALS['v'] 0.430    0.346
    $x = $hash['v']    0.286    0.202
    $x = $str[0]       0.248    0.163
    $x = $a ?: null    0.166    0.082
    $x = $f ?: tmp     0.229    0.144
    $x = $f ? $f : $a  0.179    0.094
    $x = $f ? $f : tmp 0.234    0.149
    ------------------------
    Total              7.474
    real: 7.49s user: 7.47s sys: 0.00s cpu: 99% maxmem: 75536 KB cswaits: 1
    
    micro_bench.php results from 3 runs
    7.593
    7.868
    7.474
    
    micro_bench.php avg: 7.6450
    Avg: real: 7.66s user: 7.64s sys: 0.00s cpu: 99.00% maxmem: 75536.00KB cswaits: 1.00
    created results log at /home/phpbench_logs/bench_micro_160914-195236.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_160914-195236.log
    
    
    edit: re-ran DigitalOcean 48GB 16 CPU Core tests with tcp_sack enabled but on New York 3 region to compare directly with Vultr New Jersey. Will re-run with Linode in Newark and Vultr in New Jersey to compare all 3 with tcp_sack enabled

    digitalocean_linode_vultr_48gb_16cpus_bandwidth_do_only.png
     
    Last edited: Sep 17, 2014
  7. rdan

    rdan Well-Known Member

    5,439
    1,397
    113
    May 25, 2014
    Ratings:
    +2,186
    Local Time:
    5:44 PM
    Mainline
    10.2
    I have mine also net.ipv4.tcp_sack=0, Just change it to 1. How to apply? What service to restart? :)
     
  8. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    after editing sysctl.conf to reload the settings type

    Code:
    sysctl -p
    might add a check for net.ipv4.tcp_sack=0 in .08 beta01 and if it detects it, auto enable
     
  9. Andy

    Andy Active Member

    540
    88
    28
    Aug 6, 2014
    Ratings:
    +131
    Local Time:
    4:44 AM
    Just saw that it's not eanbled on my .08 installation. on another .07 installation, there is no net.ipv4.tcp_sack in the sysctl.conf file
     
  10. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    yeah .08 beta 01 is when i started adding it automatically :) FYI, by default tcp_sack is enabled for CentOS
     
  11. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    re-ran DigitalOcean 48GB 16 CPU Core tests with tcp_sack enabled but on New York 3 region to compare directly with Vultr New Jersey. Will re-run with Linode in Newark and Vultr in New Jersey to compare all 3 with tcp_sack enabled

    digitalocean_linode_vultr_48gb_16cpus_bandwidth_do_only.png
     
  12. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  13. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    working on a centminmodbench.sh public report results parser script which can just grab the numbers for copy and paste input into my Google Doc Spreadsheet template.

    Code:
    ./parser.sh
    ./parser.sh {all|ioping|dd|fio|ping|speed|axel|openssl|mysql|php}
    
    
    Code:
    ./parser.sh ioping _publicreport_120914-063713.log               
    3706
    14.5
    4236
    16.5
    3114
    778.6
    210410
    821.9
    
    Code:
    ./parser.sh dd _publicreport_120914-063713.log
    1.82459
    588
    1.8607
    577
    2.85784
    376
    8.44419
    127
    
    Code:
    ./parser.sh fio _publicreport_120914-063713.log
    1024.3
    292071
    3591
    1024.3
    292071
    
    Code:
    ./parser.sh ping _publicreport_120914-063713.log     
    2.147
    2.715
    3.415
    0.529
    156.907
    156.962
    157.027
    0.049
    111.377
    111.796
    112.312
    0.387
    9.668
    9.783
    9.873
    0.117
    18.163
    18.173
    18.181
    0.110
    63.084
    63.154
    63.258
    0.299
    52.988
    53.264
    53.785
    0.368
    174.281
    176.060
    178.284
    1.699
    81.188
    81.259
    81.356
    0.071
    71.320
    71.389
    71.515
    0.321
    168.455
    168.578
    168.756
    0.491
    161.135
    162.041
    162.665
    0.733
    144.826
    144.889
    144.926
    0.044
    163.049
    163.732
    164.997
    1.009
    16.496
    16.689
    17.006
    0.225
    18.297
    18.304
    18.316
    0.110
    68.339
    68.363
    68.385
    0.302
    
    Code:
    ./parser.sh speed _publicreport_120914-063713.log 
    31.2
    887
    45.0
    17.2
    56.0
    101
    34.0
    70.7
    18.9
    86.5
    51.0
    16.6
    24.7
    18.4
    16.6
    19.2
    21.3
    12.4
    12.5
    14.8
    11.1
    3.84
    8.19
    9.65
    8.11
    9.84
    
    Code:
    ./parser.sh axel _publicreport_120914-063713.log   
    48.62
    9.25
    98.24
    36.58
    79.58
    109.62
    31.90
    81.93
    25.58
    83.42
    63.00
    16.37
    25.50
    8.91
    17.00
    18.57
    41.02
    17.01
    11.38
    32.25
    34.81
    6.18
    8.12
    9.24
    7.61
    9.64
    
    Code:
    ./parser.sh openssl _publicreport_120914-063713.log 
    3973941.93
    3369893.89
    4855756.12
    799247.02
    559742.98
    1324321.45
    138546.9
    37691.3
    3466485.76
    4831647.96
    
    3486369.11
    2840088.92
    4829881.34
    798895.79
    555060.91
    1223262.21
    4061.0
    638.9
    3458045.27
    4825270.61
    
    Code:
    ./parser.sh mysql _publicreport_120914-063713.log     
    1.653
    1.549
    1.699
    
    Code:
    ./parser.sh php _publicreport_120914-063713.log   
    2.6867
    10.6397
    
     
    Last edited: Sep 19, 2014
  14. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    2GB Vultr Chicago VPS with floating IPs feature

    Code:
    -------------------------------------------
    centminmodbench.sh 0.3
    http://bench.centminmod.com
    written by: George Liu (eva2000)
    http://centminmod.com
    -------------------------------------------
    
    -------------------------------------------
    System Information
    -------------------------------------------
    
    2.6.32-431.el6.x86_64
    
    CentOS release 6.5 (Final)
    
    ----------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                2
    On-line CPU(s) list:   0,1
    Thread(s) per core:    1
    Core(s) per socket:    1
    Socket(s):             2
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 60
    Stepping:              1
    CPU MHz:               3392.158
    BogoMIPS:              6784.31
    Hypervisor vendor:     KVM
    Virtualization type:   full
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              4096K
    NUMA node0 CPU(s):     0,1
    
    ----------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2 ONLINE
    0   0    0      0    0:0:0      yes
    1   0    1      1    1:1:1      yes
    
    ----------------------------------------------
                 total       used       free     shared    buffers     cached
    Mem:          1877       1745        131          0         12       1598
    Low:          1877       1745        131
    High:            0          0          0
    -/+ buffers/cache:        135       1742
    Swap:         2047          0       2047
    
    ----------------------------------------------
    Filesystem      Size  Used Avail Use% Mounted on
    /dev/vda1        40G  4.6G   33G  13% /
    tmpfs           939M     0  939M   0% /dev/shm
    
    
    Code:
    -------------------------------------------
    disk ioping tests
    -------------------------------------------
    
    2014-09-23 06:22:51 URL:https://ioping.googlecode.com/files/ioping-0.6.tar.gz [6957/6957] -> "ioping-0.6.tar.gz" [1]
    Download done.
    ioping-0.6.tar.gz valid file.
    
    Running IOPing I/O benchmark...
    cc -std=c99 -g -Wall -Wextra -pedantic -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -DVERSION=\"0.6\" -c -o ioping.o ioping.c
    cc -o ioping ioping.o -std=c99 -g -Wall -Wextra -pedantic -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -lm
    
    IOPing I/O: ./ioping -c 10 .
    4096 bytes from . (ext4 /dev/vda1): request=1 time=0.2 ms
    4096 bytes from . (ext4 /dev/vda1): request=2 time=0.4 ms
    4096 bytes from . (ext4 /dev/vda1): request=3 time=0.4 ms
    4096 bytes from . (ext4 /dev/vda1): request=4 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=5 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=6 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=7 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=8 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=9 time=0.3 ms
    4096 bytes from . (ext4 /dev/vda1): request=10 time=0.3 ms
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    10 requests completed in 9004.2 ms, 3157 iops, 12.3 mb/s
    min/avg/max/mdev = 0.2/0.3/0.4/0.0 ms
    
    IOPing seek rate: ./ioping -RD .
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    11608 requests completed in 3000.0 ms, 5747 iops, 22.4 mb/s
    min/avg/max/mdev = 0.1/0.2/2.5/0.0 ms
    
    IOPing sequential: ./ioping -RL .
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    3495 requests completed in 3000.2 ms, 1287 iops, 321.7 mb/s
    min/avg/max/mdev = 0.7/0.8/2.9/0.1 ms
    
    IOPing cached: ./ioping -RC .
    
    --- . (ext4 /dev/vda1) ioping statistics ---
    49569 requests completed in 3000.0 ms, 894570 iops, 3494.4 mb/s
    min/avg/max/mdev = 0.0/0.0/0.0/0.0 ms
    
    
    Code:
    -------------------------------------------
    disk DD tests
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 2.5106 s, 428 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 2.54865 s, 421 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 4.05225 s, 265 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 13.0414 s, 82.3 MB/s
    
    Code:
    -------------------------------------------
    disk FIO tests
    -------------------------------------------
    
    2014-09-23 06:23:34 URL:https://raw.githubusercontent.com/Crowd9/Benchmark/master/fio-2.0.9.tar.gz [275092/275092] -> "fio-2.0.9.tar.gz" [1]
    Download done.
    fio-2.0.9.tar.gz valid file.
    
    Running FIO benchmark...
    
    FIO_VERSION = fio-2.0.9
    
    FIO random reads: 
    randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    randomreads: Laying out IO file(s) (1 file(s) / 1024MB)
    
    randomreads: (groupid=0, jobs=1): err= 0: pid=10213: Tue Sep 23 06:23:45 2014
      read : io=1024.3MB, bw=261032KB/s, iops=65258 , runt=  4018msec
      cpu          : usr=6.90%, sys=36.40%, ctx=67786, majf=0, minf=89
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
       READ: io=1024.3MB, aggrb=261032KB/s, minb=261032KB/s, maxb=261032KB/s, mint=4018msec, maxt=4018msec
    
    Disk stats (read/write):
      vda: ios=257470/0, merge=0/0, ticks=245190/0, in_queue=245190, util=97.58%
    
    FIO random writes: 
    randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    
    randomwrites: (groupid=0, jobs=1): err= 0: pid=10217: Tue Sep 23 06:23:50 2014
      write: io=1024.3MB, bw=242784KB/s, iops=60696 , runt=  4320msec
      cpu          : usr=5.77%, sys=32.46%, ctx=43140, majf=0, minf=25
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
      WRITE: io=1024.3MB, aggrb=242784KB/s, minb=242784KB/s, maxb=242784KB/s, mint=4320msec, maxt=4320msec
    
    Disk stats (read/write):
      vda: ios=0/251659, merge=0/5, ticks=0/257250, in_queue=257216, util=97.67%
    
    
    Code:
    
    -------------------------------------------
    Running bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Download Cachefly: 95.2MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Download Linode, Atlanta, GA, USA: 50.7MB/s
    ----------------------------------------------
    Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Download Linode, Dallas, TX, USA: 44.5MB/s
    ----------------------------------------------
    Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Download Leaseweb, Manassas, VA, USA: 53.8MB/s
    ----------------------------------------------
    Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Seattle, WA, USA: 33.8MB/s
    ----------------------------------------------
    Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, San Jose, CA, USA: 29.9MB/s
    ----------------------------------------------
    Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Washington, DC, USA: 58.7MB/s
    ----------------------------------------------
    Download from VersaWeb, Las Vegas, Nevada (http://199.47.210.50/100mbtest.bin)
    Download VersaWeb, Las Vegas, Nevada: 17.2MB/s
    ----------------------------------------------
    Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Download OVH, BHS, Canada: 45.5MB/s
    ----------------------------------------------
    Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Los Angeles, California: 26.2MB/s
    ----------------------------------------------
    Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Seattle, Washington: 24.0MB/s
    ----------------------------------------------
    Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Dallas, Texas: 40.9MB/s
    ----------------------------------------------
    Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Chicago, Illinois: 98.9MB/s
    ----------------------------------------------
    Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Atlanta, Georgia: 27.4MB/s
    ----------------------------------------------
    Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Miami, Florida: 20.4MB/s
    ----------------------------------------------
    Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, New York / New Jersey: 55.2MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Download Linode, Tokyo, JP: 10.7MB/s
    ----------------------------------------------
    Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Singapore: 7.63MB/s
    ----------------------------------------------
    Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Tokyo, Japan: 7.78MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Download Linode, London, UK: 19.0MB/s
    ----------------------------------------------
    Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Download OVH, Paris, France: 16.1MB/s
    ----------------------------------------------
    Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Download SmartDC, Rotterdam, Netherlands: 9.41MB/s
    ----------------------------------------------
    Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Amsterdam, Netherlands: 13.1MB/s
    ----------------------------------------------
    Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, London, UK: 15.4MB/s
    ----------------------------------------------
    Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Paris, France: 13.0MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Sydney, Australia: 7.53MB/s
    
    Code:
    
    -------------------------------------------
    Running ping tests...
    -------------------------------------------
    
    ----------------------------------------------
    Pings (cachefly.cachefly.net):
    PING vip1.g.cachefly.net (205.234.175.175) 56(84) bytes of data.
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=1 ttl=56 time=2.30 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=2 ttl=56 time=2.37 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=3 ttl=56 time=2.26 ms
    
    --- vip1.g.cachefly.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2005ms
    rtt min/avg/max/mdev = 2.265/2.317/2.378/0.046 ms
    
    ----------------------------------------------
    Pings (syd-au-ping.vultr.com):
    PING syd-au-ping.vultr.com (108.61.212.117) 56(84) bytes of data.
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=1 ttl=48 time=200 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=2 ttl=48 time=197 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=3 ttl=48 time=197 ms
    
    --- syd-au-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2198ms
    rtt min/avg/max/mdev = 197.259/198.552/200.841/1.623 ms
    
    ----------------------------------------------
    Pings (hnd-jp-ping.vultr.com):
    PING hnd-jp-ping.vultr.com (108.61.201.151) 56(84) bytes of data.
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=1 ttl=51 time=147 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=2 ttl=51 time=163 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=3 ttl=51 time=167 ms
    
    --- hnd-jp-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2171ms
    rtt min/avg/max/mdev = 147.451/159.593/167.760/8.767 ms
    
    ----------------------------------------------
    Pings (lax-ca-us-ping.vultr.com):
    PING lax-ca-us-ping.vultr.com (108.61.219.200) 56(84) bytes of data.
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=1 ttl=55 time=115 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=2 ttl=55 time=118 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=3 ttl=55 time=97.8 ms
    
    --- lax-ca-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2100ms
    rtt min/avg/max/mdev = 97.819/110.524/118.418/9.075 ms
    
    ----------------------------------------------
    Pings (wa-us-ping.vultr.com):
    PING wa-us-ping.vultr.com (108.61.194.105) 56(84) bytes of data.
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=1 ttl=55 time=51.6 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=2 ttl=55 time=50.7 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=3 ttl=55 time=51.6 ms
    
    --- wa-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2055ms
    rtt min/avg/max/mdev = 50.728/51.324/51.640/0.496 ms
    
    ----------------------------------------------
    Pings (tx-us-ping.vultr.com):
    PING tx-us-ping.vultr.com (108.61.224.175) 56(84) bytes of data.
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=1 ttl=56 time=28.2 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=2 ttl=56 time=28.2 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=3 ttl=56 time=28.0 ms
    
    --- tx-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2030ms
    rtt min/avg/max/mdev = 28.084/28.173/28.219/0.062 ms
    
    ----------------------------------------------
    Pings (il-us-ping.vultr.com):
    PING il-us-ping.vultr.com (107.191.51.12) 56(84) bytes of data.
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=1 ttl=64 time=0.338 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=2 ttl=64 time=0.320 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=3 ttl=64 time=0.307 ms
    
    --- il-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 0.307/0.321/0.338/0.024 ms
    
    ----------------------------------------------
    Pings (ga-us-ping.vultr.com):
    PING ga-us-ping.vultr.com (108.61.193.166) 56(84) bytes of data.
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=1 ttl=55 time=45.7 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=2 ttl=55 time=45.6 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=3 ttl=55 time=45.6 ms
    
    --- ga-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2049ms
    rtt min/avg/max/mdev = 45.641/45.680/45.721/0.177 ms
    
    ----------------------------------------------
    Pings (fl-us-ping.vultr.com):
    PING fl-us-ping.vultr.com (104.156.244.232) 56(84) bytes of data.
    64 bytes from 104.156.244.232: icmp_seq=1 ttl=56 time=60.4 ms
    64 bytes from 104.156.244.232: icmp_seq=2 ttl=56 time=60.4 ms
    64 bytes from 104.156.244.232: icmp_seq=3 ttl=56 time=60.5 ms
    
    --- fl-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2063ms
    rtt min/avg/max/mdev = 60.439/60.478/60.508/0.202 ms
    
    ----------------------------------------------
    Pings (nj-us-ping.vultr.com):
    PING nj-us-ping.vultr.com (108.61.149.182) 56(84) bytes of data.
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=1 ttl=54 time=21.6 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=2 ttl=54 time=21.7 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=3 ttl=55 time=21.2 ms
    
    --- nj-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2024ms
    rtt min/avg/max/mdev = 21.245/21.551/21.711/0.216 ms
    
    ----------------------------------------------
    Pings (fra-de-ping.vultr.com):
    PING fra-de-ping.vultr.com (108.61.210.117) 56(84) bytes of data.
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=1 ttl=57 time=104 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=2 ttl=57 time=104 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=3 ttl=57 time=104 ms
    
    --- fra-de-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2107ms
    rtt min/avg/max/mdev = 104.904/104.926/104.938/0.015 ms
    
    ----------------------------------------------
    Pings (ams-nl-ping.vultr.com):
    PING ams-nl-ping.vultr.com (108.61.198.102) 56(84) bytes of data.
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=1 ttl=50 time=99.0 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=2 ttl=50 time=98.8 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=3 ttl=50 time=99.0 ms
    
    --- ams-nl-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2101ms
    rtt min/avg/max/mdev = 98.859/98.960/99.012/0.266 ms
    
    ----------------------------------------------
    Pings (lon-gb-ping.vultr.com):
    PING lon-gb-ping.vultr.com (108.61.196.101) 56(84) bytes of data.
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=1 ttl=51 time=90.8 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=2 ttl=51 time=90.8 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=3 ttl=51 time=90.8 ms
    
    --- lon-gb-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2091ms
    rtt min/avg/max/mdev = 90.849/90.868/90.885/0.246 ms
    
    ----------------------------------------------
    Pings (par-fr-ping.vultr.com):
    PING par-fr-ping.vultr.com (108.61.209.127) 56(84) bytes of data.
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=1 ttl=57 time=97.1 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=2 ttl=57 time=97.2 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=3 ttl=57 time=97.1 ms
    
    --- par-fr-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2100ms
    rtt min/avg/max/mdev = 97.104/97.173/97.234/0.363 ms
    
    ----------------------------------------------
    Pings (VersaWeb Las Vegas):
    PING 199.47.210.50 (199.47.210.50) 56(84) bytes of data.
    64 bytes from 199.47.210.50: icmp_seq=1 ttl=52 time=66.5 ms
    64 bytes from 199.47.210.50: icmp_seq=2 ttl=52 time=66.6 ms
    64 bytes from 199.47.210.50: icmp_seq=3 ttl=52 time=77.2 ms
    
    --- 199.47.210.50 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2080ms
    rtt min/avg/max/mdev = 66.524/70.144/77.219/5.003 ms
    
    ----------------------------------------------
    Pings (VersaWeb Seattle):
    PING 76.164.234.1 (76.164.234.1) 56(84) bytes of data.
    64 bytes from 76.164.234.1: icmp_seq=1 ttl=54 time=52.6 ms
    64 bytes from 76.164.234.1: icmp_seq=2 ttl=54 time=47.9 ms
    64 bytes from 76.164.234.1: icmp_seq=3 ttl=54 time=48.0 ms
    
    --- 76.164.234.1 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2050ms
    rtt min/avg/max/mdev = 47.932/49.547/52.619/2.173 ms
    
    ----------------------------------------------
    Pings (OVH Canada):
    PING bhs.proof.ovh.net (192.99.19.165) 56(84) bytes of data.
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=1 ttl=55 time=18.6 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=2 ttl=55 time=18.5 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=3 ttl=55 time=18.5 ms
    
    --- bhs.proof.ovh.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2021ms
    rtt min/avg/max/mdev = 18.537/18.585/18.625/0.117 ms
    
    
    Code:
    
    -------------------------------------------
    Running mtr tests...
    -------------------------------------------
    
    ----------------------------------------------
    mtr --report --report-cycles=10 cachefly.cachefly.net
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   0.9   0.4   4.8   1.4
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   2.4   0.3  17.1   5.2
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    5.5  11.0   1.6  46.3  13.9
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.3   1.2   1.0   2.0   0.3
      5. ae13-104.chi11.ip4.gtt.net    0.0%    10    1.1  11.6   1.0  36.9  16.7
      6. vip1.G-anycast1.cachefly.net  0.0%    10    2.6   3.0   2.3   5.2   1.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.atlanta.linode.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    1.3   4.7   0.5   9.5   3.0
      2. 108.61.138.253.choopa.net     0.0%    10    0.4   1.0   0.3   3.8   1.4
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    5.5   8.3   2.7  29.2   7.6
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.3   7.1   1.0  49.8  15.1
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10    1.1   2.5   1.0   9.5   3.1
      6. xe-7-2-0.atl11.ip4.gtt.net    0.0%    10   45.2  49.3  45.2  85.4  12.7
      7. gtt-gw.ip4.gtt.net            0.0%    10   46.8  47.7  46.5  49.6   1.2
      8. as3595.xe-2-0-5-103.ar1.atl1  0.0%    10   34.0  37.0  33.4  67.5  10.7
      9. router2-atl.linode.com        0.0%    10   33.8  33.6  33.5  33.8   0.1
     10. speedtest.atlanta.linode.com  0.0%    10   33.4  33.2  33.0  33.4   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.dallas.linode.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.5   0.6   0.4   2.2   0.6
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   2.1   0.3   7.1   2.6
      3. ae10.cr1.ord6.us.scnet.net    0.0%    10   16.3   7.6   0.7  18.6   7.0
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    3.5   1.7   1.0   3.5   0.9
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    1.5   2.0   1.5   3.2   0.6
      6. ae-8.r05.chcgil09.us.bb.gin.  0.0%    10    1.7   1.5   1.3   1.9   0.2
      7. xe-1-0-1.bbr02.eq01.chi01.ne  0.0%    10    1.2   1.5   1.2   2.2   0.4
      8. ae7.bbr01.eq01.chi01.network  0.0%    10    1.3   6.1   1.3  25.8  10.0
      9. ae20.bbr01.eq01.dal03.networ  0.0%    10   29.2  26.8  24.0  29.2   1.9
     10. po31.dsr02.dllstx3.networkla  0.0%    10   20.9  24.1  20.9  28.7   3.9
     11. po2.car01.dllstx2.networklay  0.0%    10   24.2  25.0  20.8  38.5   5.0
     12. router1-dal.linode.com        0.0%    10   21.0  21.9  20.9  24.2   1.5
     13. speedtest.dallas.linode.com   0.0%    10   20.8  23.1  20.8  32.2   3.7
    
    ----------------------------------------------
    mtr --report --report-cycles=10 mirror.us.leaseweb.net
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.6   4.0   0.4   9.2   3.3
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   0.5   0.3   2.1   0.6
      3. ae10.cr2.ord6.us.scnet.net    0.0%    10    8.5   4.7   0.8   9.9   3.1
      4. ae4.cr2.ord1.us.scnet.net     0.0%    10   15.3  25.9   1.0  96.8  27.2
      5. ae-23.r05.chcgil09.us.bb.gin  0.0%    10    1.7   1.6   1.6   1.7   0.1
      6. ae-0.teliasonera.chcgil09.us  0.0%    10    1.6   1.5   1.4   1.6   0.1
      7. nyk-bb2-link.telia.net        0.0%    10   21.0  44.1  20.8 153.3  43.5
      8. ash-bb4-link.telia.net        0.0%    10   35.4  35.4  35.3  35.4   0.0
      9. ash-b2-link.telia.net         0.0%    10   28.4  28.4  28.4  28.6   0.1
     10. leaseweb-ic-150715-ash-b2.c.  0.0%    10   24.7  24.8  24.7  24.9   0.1
     11. 108.59.15.149                 0.0%    10   24.4  24.4  24.4  24.4   0.0
     12. mirror.us.leaseweb.net        0.0%    10   24.7  24.6  24.5  24.8   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sea01.softlayer.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    5.6   4.2   0.3  10.4   4.2
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   2.2   0.3  18.5   5.7
      3. ae10.cr1.ord6.us.scnet.net    0.0%    10    0.3   4.5   0.3   9.0   3.2
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.0  12.2   1.0  97.6  30.4
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    1.7   1.5   1.3   1.8   0.1
      6. ae-8.r05.chcgil09.us.bb.gin.  0.0%    10    1.7   2.2   1.7   3.7   0.8
      7. xe-1-0-1.bbr02.eq01.chi01.ne  0.0%    10    1.2   1.2   1.2   1.3   0.0
      8. ae1.bbr02.wb01.sea02.network  0.0%    10   51.1  51.1  51.1  51.1   0.0
      9. ae1.dar02.sr01.sea01.network  0.0%    10   46.8  46.7  46.7  46.8   0.0
     10. po2.fcr01.sr01.sea01.network  0.0%    10   47.9  47.4  46.8  49.3   0.8
     11. speedtest.sea01.softlayer.co  0.0%    10   46.7  46.7  46.6  46.8   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sjc01.softlayer.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    6.6   6.0   0.4  10.5   4.2
      2. 108.61.138.253.choopa.net     0.0%    10   18.0   7.6   0.3  48.0  15.2
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10   67.5  13.2   0.8  67.5  19.4
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    2.8   2.1   0.9   4.2   1.3
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    1.6   1.9   1.5   3.2   0.6
      6. ae-8.r05.chcgil09.us.bb.gin.  0.0%    10    1.8   2.0   1.6   3.5   0.7
      7. xe-1-0-1.bbr02.eq01.chi01.ne  0.0%    10    1.2   1.4   1.2   2.7   0.5
      8. ae1.bbr02.cs01.den01.network  0.0%    10   33.2  30.9  30.5  33.2   0.9
      9. ae1.bbr01.eq01.sjc02.network  0.0%    10   53.1  53.1  53.0  53.1   0.0
     10. ae5.dar01.sr01.sjc01.network  0.0%    10   53.6  53.6  53.6  53.7   0.0
     11. po1.fcr01.sr01.sjc01.network  0.0%    10   53.8  56.0  53.7  72.9   6.0
     12. speedtest.sjc01.softlayer.co  0.0%    10   52.9  52.9  52.9  53.1   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.wdc01.softlayer.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   3.3   0.4   8.1   2.8
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.4   2.2   0.3  18.6   5.8
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    4.9   6.1   1.0   9.7   2.6
      4. ae1.cr1.ord1.us.scnet.net     0.0%    10    1.2   5.2   0.9  41.7  12.8
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    3.1   1.9   1.4   3.1   0.6
      6. ae-8.r05.chcgil09.us.bb.gin.  0.0%    10    1.4   1.7   1.4   2.4   0.3
      7. ae0.bbr02.eq01.wdc02.network  0.0%    10   23.2   8.2   1.3  23.2  10.4
      8. ae1.dar01.sr01.wdc01.network  0.0%    10   23.1  23.4  23.0  24.0   0.4
      9. po1.fcr01.sr01.wdc01.network  0.0%    10   23.8  25.0  22.8  34.7   3.7
     10. speedtest.wdc01.softlayer.co  0.0%    10   22.7  27.8  22.7  31.2   4.4
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.tokyo.linode.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   0.4   0.3   0.5   0.1
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   0.4   0.2   1.2   0.3
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    8.7  10.5   1.4  54.4  15.7
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.8   1.1   1.0   1.8   0.3
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10   33.6   5.0   1.0  33.6  10.3
      6. xe-1-1-0.lax21.ip4.gtt.net    0.0%    10   57.9  58.7  57.8  61.6   1.3
      7. kddi-gw.ip4.gtt.net           0.0%    10   58.2  86.9  58.2 199.2  57.6
      8. lajbb001.int-gw.kddi.ne.jp    0.0%    10   57.9  57.9  57.8  57.9   0.0
      9. otejbb205.int-gw.kddi.ne.jp   0.0%    10  155.8 163.6 155.7 234.1  24.8
     10. cm-fcu203.kddnet.ad.jp        0.0%    10  171.6 168.3 164.1 176.1   4.3
     11. 124.215.199.122              10.0%    10  172.9 172.9 172.9 173.0   0.0
     12. speedtest.tokyo.linode.com   10.0%    10  163.6 163.6 163.5 164.1   0.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sng01.softlayer.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    9.3   2.5   0.4  10.6   4.0
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   1.5   0.3  11.8   3.6
      3. ae10.cr1.ord6.us.scnet.net    0.0%    10    7.2   6.8   1.7  11.7   3.4
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.0   2.3   0.9  14.2   4.2
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    1.6   1.6   1.4   2.4   0.3
      6. ae-7.r21.chcgil09.us.bb.gin. 10.0%    10    6.6   4.7   1.3  22.4   6.8
      7. ae-5.r20.snjsca04.us.bb.gin.  0.0%    10   52.3  57.8  52.2  87.1  11.6
      8. ae-2.r20.sngpsi05.sg.bb.gin. 10.0%    10  222.0 224.0 222.0 228.6   2.1
      9. ae-2.r00.sngpsi02.sg.bb.gin.  0.0%    10  226.4 226.3 223.7 227.8   1.1
     10. ae-0.softlayer.sngpsi02.sg.b  0.0%    10  221.6 221.7 221.6 223.1   0.5
     11. ae5.dar02.sr03.sng01.network  0.0%    10  223.7 224.9 223.7 235.7   3.8
     12. po2.fcr01.sr03.sng01.network 60.0%    10  238.8 241.8 238.5 251.3   6.4
     13. speedtest.sng01.softlayer.co 10.0%    10  228.4 230.6 228.3 242.6   4.6
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.london.linode.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10   11.4   2.7   0.4  11.4   3.9
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   3.3   0.3  27.8   8.6
      3. ae9.cr2.ord6.us.scnet.net     0.0%    10    8.4   5.2   1.4   9.9   3.1
      4. ae4.cr2.ord1.us.scnet.net     0.0%    10    1.0   1.1   0.9   1.7   0.3
      5. ae13-104.chi11.ip4.gtt.net    0.0%    10   30.6   4.0   1.0  30.6   9.3
      6. xe-1-1-3.lon21.ip4.gtt.net    0.0%    10   91.6  91.6  91.6  91.8   0.1
      7. telecity-gw.ip4.gtt.net       0.0%    10   92.1  92.0  91.9  92.1   0.1
      8. 212.111.33.238                0.0%    10   92.4  92.5  92.4  92.5   0.1
      9. speedtest.london.linode.com   0.0%    10   92.3  92.4  92.3  92.6   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 mirror.i3d.net
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   4.5   0.4   9.0   3.2
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   1.3   0.3   4.5   1.5
      3. ae9.cr2.ord6.us.scnet.net     0.0%    10   39.4  39.8   8.3  46.5  11.3
      4. ae1.cr2.ord1.us.scnet.net     0.0%    10    1.2   5.4   1.2  14.1   4.1
      5. ae-23.r05.chcgil09.us.bb.gin  0.0%    10    1.8   1.9   1.7   2.4   0.2
      6. ae-6.r20.chcgil09.us.bb.gin.  0.0%    10    1.3  11.0   1.3  46.5  16.4
      7. ae-4.r23.nycmny01.us.bb.gin.  0.0%    10   21.8  25.2  21.7  31.2   3.6
      8. ae-9.r20.asbnva02.us.bb.gin.  0.0%    10   32.7  29.7  24.0  36.0   4.5
      9. ae-0.r21.asbnva02.us.bb.gin.  0.0%    10   23.7  29.6  23.7  40.1   4.8
     10. ae-2.r23.amstnl02.nl.bb.gin.  0.0%    10  109.2 109.9 107.0 122.7   4.6
     11. ae-2.r02.amstnl02.nl.bb.gin.  0.0%    10  124.7 123.9 121.9 125.1   1.4
     12. i3d.r02.amstnl02.nl.ce.gin.n  0.0%    10  136.1 124.7 118.6 141.4   8.0
     13. 80ge.br2-cr0.smartdc.rtd.i3d  0.0%    10  114.1 132.2 114.1 217.1  30.7
     14. mirror.i3d.net               10.0%    10  106.0 111.2 106.0 119.1   4.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 syd-au-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   0.4   0.3   0.5   0.1
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   0.3   0.3   0.4   0.0
      3. ae10.cr2.ord6.us.scnet.net    0.0%    10    3.6   4.0   0.3   7.6   2.5
      4. ae1.cr2.ord1.us.scnet.net     0.0%    10    1.0   6.3   1.0  52.3  16.2
      5. ae-23.r05.chcgil09.us.bb.gin  0.0%    10    1.4   1.8   1.4   2.7   0.4
      6. ae-6.r21.chcgil09.us.bb.gin. 10.0%    10   11.4   3.1   1.2  11.4   3.5
      7. ae-3.r21.dllstx09.us.bb.gin.  0.0%    10   24.0  30.9  24.0  61.4  12.6
      8. ae-0.r20.dllstx09.us.bb.gin.  0.0%    10   27.5  26.9  23.9  29.3   1.7
      9. ae-5.r20.lsanca03.us.bb.gin.  0.0%    10   54.9  60.4  54.8  82.9   8.7
     10. xe-4-0-0.r02.lsanca03.us.bb.  0.0%    10   58.5  59.2  54.9  62.7   2.4
     11. as-3.r05.sydnau01.au.bb.gin.  0.0%    10  200.9 201.4 200.1 204.0   1.7
     12. xe-1-1-0.a00.sydnau02.au.ra.  0.0%    10  203.3 203.0 200.3 204.2   1.2
     13. 202.68.67.42                  0.0%    10  203.0 200.7 199.0 206.8   2.6
     14. xe-1-0-0.gw102.sy1.ap.equini  0.0%    10  207.2 208.0 204.2 212.4   2.3
     15. xe-1-0-1.gw102.sy3.ap.equini 10.0%    10  196.5 196.8 193.1 201.4   2.1
     16. 27.111.243.214               10.0%    10  200.5 200.7 200.4 201.9   0.5
     17. 108.61.212.117.vultr.com     10.0%    10  199.6 197.3 194.0 201.7   2.3
    
    ----------------------------------------------
    mtr --report --report-cycles=10 hnd-jp-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   2.1   0.4   5.5   2.1
      2. 108.61.138.253.choopa.net     0.0%    10    4.7   0.8   0.3   4.7   1.4
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    9.7  11.6   1.1  35.7  10.5
      4. ae1.cr2.ord1.us.scnet.net     0.0%    10    1.3   1.1   1.0   1.3   0.1
      5. ae-23.r05.chcgil09.us.bb.gin  0.0%    10    1.9   2.0   1.5   3.1   0.6
      6. ae-6.r20.chcgil09.us.bb.gin.  0.0%    10    9.3   2.1   1.2   9.3   2.5
      7. ae-5.r20.sttlwa01.us.bb.gin.  0.0%    10   69.1  51.0  47.6  69.1   6.7
      8. ae-6.r20.tokyjp05.jp.bb.gin.  0.0%    10  152.7 148.0 138.9 156.3   4.9
      9. ae-19.r25.tokyjp05.jp.bb.gin  0.0%    10  156.9 154.2 141.9 172.1   9.5
     10. ae-2.r01.tokyjp03.jp.bb.gin.  0.0%    10  163.3 161.0 152.0 167.4   4.7
     11. xe-0-0-0-30.r01.tokyjp03.jp.  0.0%    10  136.2 143.1 136.2 152.1   5.6
     12. 72.ae2.sw1.tko1.jp.scnet.net  0.0%    10  150.8 154.2 149.3 160.6   4.9
     13. unknown.servercentral.net    10.0%    10  148.1 155.0 148.1 159.6   5.1
     14. 108.61.201.151.vultr.com     10.0%    10  163.5 152.3 136.0 164.1  11.8
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lax-ca-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   2.4   0.4  11.6   3.7
      2. 108.61.138.253.choopa.net     0.0%    10    2.6   0.9   0.3   2.6   1.0
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    2.1   8.1   0.7  38.5  11.1
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.2   3.2   1.0  20.5   6.1
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10    1.2   4.1   1.0  31.4   9.6
      6. xe-8-3-0.lax20.ip4.gtt.net    0.0%    10   56.3  66.6  56.3 143.8  27.4
      7. gtt-gw-cr1.lax2.ip4.gtt.net   0.0%    10   56.3  56.5  56.2  57.6   0.6
      8. ae2-50g.ar1.lax2.us.as4436.g 60.0%    10   60.2  59.5  55.4  61.9   2.8
      9. as20473.xe-6-0-1.ar1.lax2.us  0.0%    10   53.9  54.4  53.9  55.2   0.7
     10. 108.61.219.200.vultr.com      0.0%    10   56.9  57.8  56.8  58.2   0.6
    
    ----------------------------------------------
    mtr --report --report-cycles=10 wa-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.3   1.6   0.3  11.8   3.6
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   3.9   0.3  36.0  11.3
      3. ae9.cr2.ord6.us.scnet.net     0.0%    10    7.6   5.6   0.5   9.1   2.7
      4. ae4.cr2.ord1.us.scnet.net     0.0%    10    1.0   4.0   0.9  31.5   9.7
      5. ae-23.r05.chcgil09.us.bb.gin  0.0%    10   25.1   3.7   1.0  25.1   7.5
      6. xe-1-2-0.chi11.ip4.gtt.net    0.0%    10    1.2   1.2   1.1   1.7   0.2
      7. as3356.chi11.ip4.gtt.net      0.0%    10   10.3   5.7   1.2  23.3   7.9
      8. vlan51.ebr1.Chicago2.Level3.  0.0%    10   50.4  50.4  50.3  50.5   0.0
      9. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     10. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     11. ae-2-52.edge2.Seattle1.Level  0.0%    10   50.6  50.1  49.6  50.6   0.5
     12. CHOOPA-LLC.edge2.Seattle1.Le  0.0%    10   51.7  51.1  50.7  51.7   0.4
     13. 108.61.194.105.vultr.com      0.0%    10   51.7  51.1  50.6  51.7   0.5
    
    ----------------------------------------------
    mtr --report --report-cycles=10 tx-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   1.5   0.4  11.0   3.4
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   5.1   0.3  45.8  14.3
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    4.7  10.0   1.0  25.3   8.9
      4. ae1.cr1.ord1.us.scnet.net     0.0%    10    1.0   2.6   1.0  14.4   4.2
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10    1.0   7.7   1.0  65.3  20.3
      6. xe-2-0-0.dal33.ip4.gtt.net    0.0%    10   27.9  27.9  27.8  28.0   0.0
      7. gtt-gw.ip4.gtt.net            0.0%    10   27.9  28.7  27.8  36.1   2.6
      8. as20473.xe-5-1-2.cr1.dfw1.us  0.0%    10   28.1  28.4  28.0  31.6   1.1
      9. 108.61.224.175.vultr.com      0.0%    10   27.3  27.3  27.2  27.3   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 il-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 107.191.51.12.vultr.com       0.0%    10    0.4   0.4   0.3   1.2   0.3
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ga-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   0.4   0.3   0.5   0.0
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   0.5   0.3   2.5   0.7
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    9.8   5.6   1.4   9.8   2.9
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.4  10.4   1.0  52.9  19.9
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10    1.0   3.7   1.0  17.0   5.5
      6. xe-8-2-0.atl11.ip4.gtt.net    0.0%    10  109.4  51.1  44.4 109.4  20.5
      7. ae4-150.cr1.atl1.ip4.gtt.net  0.0%    10   44.5  44.6  44.5  44.6   0.0
      8. ae1-40g.cr2.atl1.us.as4436.g  0.0%    10   44.5  44.6  44.5  44.7   0.1
      9. as20473.xe-1-3-1.cr2.atl1.us  0.0%    10   44.8  44.9  44.7  46.5   0.6
     10. 108.61.193.166.vultr.com      0.0%    10   44.8  44.8  44.7  44.8   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fl-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.8   3.7   0.4   8.3   2.9
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   3.1   0.3  10.4   4.5
      3. ae9.cr2.ord6.us.scnet.net     0.0%    10   10.0   8.8   0.8  16.4   6.0
      4. ae4.cr2.ord1.us.scnet.net     0.0%    10    1.0   1.0   0.9   1.0   0.0
      5. ae13-104.chi11.ip4.gtt.net    0.0%    10    1.0   1.0   1.0   1.1   0.0
      6. xe-8-0-1.mia12.ip4.gtt.net    0.0%    10   60.2  59.9  59.8  60.2   0.2
      7. gtt-gw-cr1.mia1.ip4.gtt.net   0.0%    10   60.2  66.5  59.8 124.6  20.4
      8. as20473.ae5-1914.cr1.mia1.us  0.0%    10   60.3  60.4  60.2  60.6   0.2
      9. 104.156.244.232               0.0%    10   60.2  60.3  60.1  60.6   0.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 nj-us-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   2.0   0.4   5.3   2.0
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   1.0   0.2   4.6   1.6
      3. ae10.cr2.ord6.us.scnet.net    0.0%    10    4.6   4.8   0.8   9.4   2.9
      4. ae1.cr2.ord1.us.scnet.net     0.0%    10    1.2   1.6   1.2   4.6   1.0
      5. ae13-104.chi11.ip4.gtt.net    0.0%    10    1.1   4.7   1.1  37.0  11.3
      6. xe-2-1-1.nyc39.ip4.gtt.net    0.0%    10   20.9  20.9  20.8  21.4   0.2
      7. gtt-gw.ip4.gtt.net            0.0%    10   22.9  21.1  20.7  22.9   0.7
      8. ae1-50g.ar1.nyc3.us.as4436.g  0.0%    10   37.9  29.7  24.9  37.9   4.2
      9. as20473.ae7.ar1.nyc3.us.as44  0.0%    10   24.9  27.1  24.8  31.1   2.3
     10. ethernet1-50-c11-8-c6-1.pnj1  0.0%    10   24.5  24.5  24.4  24.6   0.1
     11. 108.61.149.182.vultr.com      0.0%    10   24.3  26.4  24.3  36.7   4.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fra-de-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   0.4   0.3   0.5   0.0
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   3.4   0.3  22.2   6.8
      3. ae10.cr1.ord6.us.scnet.net    0.0%    10    6.6   7.3   0.8  22.8   6.4
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    1.1   1.3   1.0   4.2   1.0
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10    1.0   3.6   1.0  26.8   8.1
      6. xe-8-1-0.fra61.ip4.gtt.net    0.0%    10  104.7 105.2 104.6 108.0   1.1
      7. choopa-gw.ip4.gtt.net         0.0%    10  105.1 105.1 105.0 105.1   0.0
      8. 108.61.210.117.vultr.com      0.0%    10  104.9 105.0 104.8 105.5   0.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ams-nl-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.3   3.7   0.3  10.4   3.7
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10    0.3   1.9   0.3  13.9   4.3
      3. ae10.cr1.ord6.us.scnet.net    0.0%    10    9.0   7.2   0.7  29.7   8.5
      4. ae1.cr1.ord1.us.scnet.net     0.0%    10    1.1   1.2   0.9   3.0   0.6
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    2.8   2.0   1.4   2.8   0.6
      6. Xe-9-1-edge2.nwr1.level3.net 10.0%    10    1.2   1.5   1.2   3.6   0.8
      7. vlan51.ebr1.Chicago2.Level3.  0.0%    10   98.1  98.9  98.1 105.9   2.5
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lon-gb-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    8.1   3.2   0.4  11.6   4.6
      2. xe-0-1-1.ar10.ord6.us.scnet.  0.0%    10   34.7   6.6   0.3  34.7  11.5
      3. ae10.cr1.ord6.us.scnet.net    0.0%    10    9.7  10.2   1.5  51.0  14.6
      4. ae4.cr1.ord1.us.scnet.net     0.0%    10    0.9   3.2   0.9  21.8   6.5
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10    3.6   1.3   1.0   3.6   0.8
      6. as3356.chi11.ip4.gtt.net      0.0%    10    1.2   5.8   1.1  43.4  13.2
      7. vlan51.ebr1.Chicago2.Level3.  0.0%    10    1.2  54.9   1.2  91.0  46.2
      8. vlan51.ebr1.Chicago2.Level3. 40.0%    10   90.5  90.5  90.5  90.6   0.0
      9. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     10. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     11. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     12. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     13. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
     14. ae-235-3611.edge5.london1.Le 50.0%    10   90.8  92.5  90.7  99.3   3.8
     15. ae-235-3611.edge5.london1.Le  0.0%     9   90.5  90.5  90.4  90.7   0.1
     16. CHOOPA-LLC.edge5.London1.Lev  0.0%     7   90.3  90.6  90.2  91.0   0.4
     17. 108.61.196.101.vultr.com     14.3%     7   91.0  91.0  90.8  91.1   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 par-fr-ping.vultr.com
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   2.8   0.3   9.4   3.0
      2. 108.61.138.253.choopa.net     0.0%    10    2.1   0.5   0.3   2.1   0.6
      3. ae10.cr1.ord6.us.scnet.net    0.0%    10    9.2   5.0   0.9   9.2   2.9
      4. ae1.cr1.ord1.us.scnet.net     0.0%    10    1.1   4.5   0.9  34.8  10.6
      5. ae3-103.chi12.ip4.gtt.net     0.0%    10   48.2   5.8   1.0  48.2  14.9
      6. xe-8-3-0.par90.ip4.gtt.net    0.0%    10   99.8 101.6  99.4 120.4   6.6
      7. choopa-gw.ip4.gtt.net         0.0%    10   99.8  99.8  99.7  99.9   0.0
      8. 108.61.209.127.vultr.com      0.0%    10   99.8  99.8  99.7  99.8   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Las Vegas
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    9.5   2.8   0.4  10.9   4.0
      2. 108.61.138.253.choopa.net     0.0%    10    0.4   0.5   0.3   1.3   0.3
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    2.2   5.2   2.1   8.7   2.7
      4. ae1.cr1.ord1.us.scnet.net     0.0%    10    1.7   9.0   0.9  55.6  18.0
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    1.7   1.6   1.4   2.2   0.2
      6. ae-7.r21.chcgil09.us.bb.gin.  0.0%    10    1.4   1.4   1.3   1.5   0.1
      7. ae-3.r21.dllstx09.us.bb.gin.  0.0%    10   24.0  26.7  23.8  51.4   8.7
      8. ae-0.r20.dllstx09.us.bb.gin.  0.0%    10   27.4  30.5  23.8  49.4   9.6
      9. ae-5.r20.lsanca03.us.bb.gin.  0.0%    10   66.2  61.9  54.8  66.2   3.9
     10. ae-1.r04.lsanca03.us.bb.gin.  0.0%    10   62.9  63.8  62.7  70.7   2.5
     11. xe-0-1-0-5.r04.lsanca03.us.c  0.0%    10   62.0  64.1  62.0  69.2   2.5
     12. te3-4.core1.las1.fiberhub.ne  0.0%    10   62.2  64.0  62.2  70.1   2.7
     13. 199.47.210.50                 0.0%    10   69.5  68.6  63.0  74.2   3.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Seattle
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10   10.6   1.4   0.4  10.6   3.2
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   0.5   0.3   2.0   0.5
      3. ae9.cr2.ord6.us.scnet.net     0.0%    10    4.7   8.9   1.4  30.7   8.2
      4. ae1.cr2.ord1.us.scnet.net     0.0%    10    1.3   7.6   1.0  62.2  19.2
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    1.9   1.7   1.5   1.9   0.2
      6. ae-7.r20.chcgil09.us.bb.gin.  0.0%    10    1.4   4.3   1.2  21.1   6.7
      7. ae-5.r20.sttlwa01.us.bb.gin.  0.0%    10   52.4  51.1  47.6  52.7   2.3
      8. ae-1.r04.sttlwa01.us.bb.gin.  0.0%    10   48.1  50.1  48.0  52.9   2.4
      9. xe-0-0-0-15.r04.sttlwa01.us.  0.0%    10   57.2  55.1  52.2  57.2   2.4
     10. 76.164.234.1                  0.0%    10   47.7  53.1  47.7  57.5   4.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 OVH Canada
    HOST: hostname                 Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 10.247.1.1                    0.0%    10    0.4   0.9   0.4   5.4   1.6
      2. 108.61.138.253.choopa.net     0.0%    10    0.3   0.4   0.3   1.0   0.2
      3. ae9.cr1.ord6.us.scnet.net     0.0%    10    1.9   5.0   0.5   9.2   2.6
      4. ae1.cr1.ord1.us.scnet.net     0.0%    10    1.2   2.6   0.9  13.9   4.1
      5. ae-6.r06.chcgil09.us.bb.gin.  0.0%    10    1.5   1.6   1.4   2.9   0.5
      6. 64.86.78.17                   0.0%    10    1.0   1.1   1.0   1.1   0.0
      7. chi-2-6k.il.us               90.0%    10    1.1   1.1   1.1   1.1   0.0
      8. 198.27.73.179                10.0%    10   24.6  18.4  17.4  24.6   2.4
      9. bhs-g1-6k.qc.ca               0.0%    10   18.9  18.9  18.9  19.1   0.1
     10. 198.27.73.92                  0.0%    10   19.0  19.6  18.9  21.2   0.9
     11. ns238643.ip-192-99-19.net     0.0%    10   18.6  18.6  18.5  18.7   0.0
    
    
    Code:
    -------------------------------------------
    OpenSSL System Benchmark
    -------------------------------------------
    
    OpenSSL 1.0.1e-fips 11 Feb 2013
    -------------------------------------------
    openssl speed rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc -multi 2
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) 
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    md5             105772.67k   318805.44k   728309.16k  1126917.46k  1281067.69k
    sha1            146515.51k   406972.93k   881251.84k  1300625.41k  1591061.16k
    rc4             963655.22k  1443662.38k  1657293.57k  1656915.63k  1723777.02k
    aes-128 cbc     274368.17k   302209.62k   308811.18k   662461.10k   672710.66k
    aes-256 cbc     202605.79k   216726.02k   219759.70k   485795.16k   492120.75k
    sha256          107081.27k   241023.77k   411907.58k   514916.69k   540884.99k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000539s 0.000017s   1855.3  60606.1
    rsa 4096 bits 0.003855s 0.000061s    259.4  16461.2
                                  sign    verify    sign/s verify/s
     256 bit ecdsa (nistp256)   0.0000s   0.0002s  20517.7   5524.9
    -------------------------------------------
    openssl speed -evp aes256 -multi 2
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) 
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp            1049279.86k  1107444.52k  1140797.53k  1145469.61k  1124048.90k
    -------------------------------------------
    openssl speed -evp aes128 -multi 2
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) 
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp            1413204.73k  1531671.68k  1556784.73k  1570694.49k  1579371.02k
    
    Code:
    -------------------------------------------
    centminmodbench.sh completed
    -------------------------------------------
    
    centminmodbench.sh Total Run Time: 707.666170186 seconds
    
     
  15. Josephm

    Josephm Active Member

    132
    44
    28
    Aug 26, 2014
    Ratings:
    +48
    Local Time:
    4:44 PM
    1.9.5
    10.0.21
    Sorry but what does "floating IPs feature" mean?
     
  16. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Vultr's new beta feature, allows you to move the same IP address between VPSes
     
  17. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Next 0.4 version of centminmodbench.sh will have a test for system entropy pool availability as discussed at Nginx - Centmin Mod Nginx VHOST SPDY SSL Generator testing | Centmin Mod Community

    update: committed to latest version of centminmodbench.sh these new tests i.e. on a poor entropy available system results are

    Code:
    entropy_avail: 173
    entropy_avail: 188
    entropy_avail: 133
    entropy_avail: 148
    edit: also updated Google Spreadsheet with the entropy template table
     
    Last edited: Sep 25, 2014
  18. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Adding memory bandwidth tests in the form of a more practical usage scenario - as a tmpfs ramdisk test :)

    commit made add memory bandwidth test via tmpfs ramdisk · a2d3d4f · centminmod/centminmodbench · GitHub

    e.g. test output for tmpfs 160MB ramdisk on my laptop's 960GB Crucial M500 SSD drive in Virtualbox guest server instance.

    Code:
    -------------------------------------------
    ramdisk DD tests - memory bandwidth
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.0436569 s, 3.1 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.0479497 s, 2.8 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.0422385 s, 3.2 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.0492466 s, 2.7 GB/s
    
    Code:
    -------------------------------------------
    ramdisk ioping tests - memory bandwidth
    -------------------------------------------
    
    2014-09-30 17:55:29 URL:https://ioping.googlecode.com/files/ioping-0.6.tar.gz [6957/6957] -> "ioping-0.6.tar.gz" [1]
    Download done.
    ioping-0.6.tar.gz valid file.
    
    Running IOPing I/O ramdisk benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4096 bytes from . (tmpfs tmpfs): request=1 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=2 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=3 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=4 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=5 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=6 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=7 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=8 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=9 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=10 time=0.0 ms
    
    --- . (tmpfs tmpfs) ioping statistics ---
    10 requests completed in 9009.7 ms, 149254 iops, 583.0 mb/s
    min/avg/max/mdev = 0.0/0.0/0.0/0.0 ms
    
    IOPing seek rate: ./ioping -RD .
    ioping: fcntl failed: Invalid argument
    ioping: please retry without -D
    
    IOPing sequential: ./ioping -RL .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    8233 requests completed in 3000.1 ms, 29556 iops, 7388.9 mb/s
    min/avg/max/mdev = 0.0/0.0/0.8/0.0 ms
    
    IOPing cached: ./ioping -RC .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    15545 requests completed in 3028.5 ms, 239589 iops, 935.9 mb/s
    min/avg/max/mdev = 0.0/0.0/0.7/0.0 ms
    
    
    looks like tmpfs because it doesn't support direct io, disk fio tests can't be run on tmpfs ramdisk, nor can ioping with -D command for direct io test
    Code:
    IOPing seek rate: ./ioping -RD .
    ioping: fcntl failed: Invalid argument
    ioping: please retry without -D
    fixed removing -D
    Code:
    -------------------------------------------
    ramdisk DD tests - memory bandwidth
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.0443935 s, 3.0 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.0503158 s, 2.7 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=128k count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    134217728 bytes (134 MB) copied, 0.044807 s, 3.0 GB/s
    
    dd if=/dev/zero of=sb-io-test bs=8k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    134217728 bytes (134 MB) copied, 0.0526821 s, 2.5 GB/s
    
    Code:
    -------------------------------------------
    ramdisk ioping tests - memory bandwidth
    -------------------------------------------
    
    2014-09-30 18:03:30 URL:https://ioping.googlecode.com/files/ioping-0.6.tar.gz [6957/6957] -> "ioping-0.6.tar.gz" [1]
    Download done.
    ioping-0.6.tar.gz valid file.
    
    Running IOPing I/O ramdisk benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4096 bytes from . (tmpfs tmpfs): request=1 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=2 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=3 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=4 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=5 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=6 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=7 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=8 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=9 time=0.0 ms
    4096 bytes from . (tmpfs tmpfs): request=10 time=0.0 ms
    
    --- . (tmpfs tmpfs) ioping statistics ---
    10 requests completed in 9013.0 ms, 133333 iops, 520.8 mb/s
    min/avg/max/mdev = 0.0/0.0/0.0/0.0 ms
    
    IOPing seek rate: ./ioping -R .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    9910 requests completed in 3000.0 ms, 252195 iops, 985.1 mb/s
    min/avg/max/mdev = 0.0/0.0/0.4/0.0 ms
    
    IOPing sequential: ./ioping -RL .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    8074 requests completed in 3000.0 ms, 30332 iops, 7583.0 mb/s
    min/avg/max/mdev = 0.0/0.0/0.4/0.0 ms
    
    IOPing cached: ./ioping -RC .
    
    --- . (tmpfs tmpfs) ioping statistics ---
    23292 requests completed in 3000.0 ms, 244756 iops, 956.1 mb/s
    min/avg/max/mdev = 0.0/0.0/0.5/0.0 ms
    
    
     
    Last edited: Oct 1, 2014
  19. eva2000

    eva2000 Administrator Staff Member

    53,149
    12,110
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,645
    Local Time:
    7:44 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+