Get the most out of your Centmin Mod LEMP stack
Become a Member

Featured OVH Benchmarks SoYouStart E3-SSD-3 - Intel Xeon E3-1245v2, 32GB, 3x120GB Intel 320 SSD

Discussion in 'Dedicated server hosting' started by eva2000, Sep 20, 2014.

  1. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Dedicated thread to my first time adventures using SoYouStart E3-SSD-3 server in their BHS, Canada datacenter :)


    ID validation & Order Process



    It took ~15hrs for ID validation to process my submitted IDs and then took ~4hrs for them to setup the server for me. So all up ~19hrs from time of order to getting the email that my E3-SSD-3 server was ready. No horror stories of extended delays ! :D

    Server Hardware specs



    SoYouStart E3-SSD-3 plan consists of:
    • Intel Xeon E3-1245v2 Ivy Bridge based processor quad core + hyperthreading = 8 cpu threads total
    • 32GB memory
    • 3x 120GB Intel 320 SSD series in raid 1
    Dig deeper into hardware specs seems to be:
    Intel Micro-ATX desktop DH67BL motherboard
    Code:
    # dmidecode 2.12
    SMBIOS 2.7 present.
    
    Handle 0x0000, DMI type 0, 24 bytes
    BIOS Information
            Vendor: Intel Corp.
            Version: BLH6710H.86A.0160.2012.1204.1156
            Release Date: 12/04/2012
            Address: 0xF0000
            Runtime Size: 64 kB
            ROM Size: 1024 kB
            Characteristics:
                    PCI is supported
                    BIOS is upgradeable
                    BIOS shadowing is allowed
                    Boot from CD is supported
                    Selectable boot is supported
                    BIOS ROM is socketed
                    EDD is supported
                    5.25"/1.2 MB floppy services are supported (int 13h)
                    3.5"/720 kB floppy services are supported (int 13h)
                    3.5"/2.88 MB floppy services are supported (int 13h)
                    Print screen service is supported (int 5h)
                    8042 keyboard services are supported (int 9h)
                    Serial services are supported (int 14h)
                    Printer services are supported (int 17h)
                    ACPI is supported
                    USB legacy is supported
                    BIOS boot specification is supported
                    Targeted content distribution is supported
                    UEFI is supported
    Kingston memory DDR3-1333Mhz
    Code:
    # dmidecode 2.12
    SMBIOS 2.7 present.
    
    Handle 0x0026, DMI type 16, 23 bytes
    Physical Memory Array
            Location: System Board Or Motherboard
            Use: System Memory
            Error Correction Type: None
            Maximum Capacity: 32 GB
            Error Information Handle: No Error
            Number Of Devices: 4
    
    Handle 0x0029, DMI type 17, 34 bytes
    Memory Device
            Array Handle: 0x0026
            Error Information Handle: No Error
            Total Width: 64 bits
            Data Width: 64 bits
            Size: 8192 MB
            Form Factor: DIMM
            Set: None
            Locator: DIMM3
            Bank Locator: CHANNEL A DIMM0
            Type: DDR3
            Type Detail: Synchronous
            Speed: 1333 MHz
            Manufacturer: Kingston   
            Serial Number: 873D6239
            Asset Tag: A1_AssetTagNum0
            Part Number: 99U5471-040.A00LF
            Rank: 2
            Configured Clock Speed: Unknown
    
    Handle 0x002C, DMI type 17, 34 bytes
    Memory Device
            Array Handle: 0x0026
            Error Information Handle: No Error
            Total Width: 64 bits
            Data Width: 64 bits
            Size: 8192 MB
            Form Factor: DIMM
            Set: None
            Locator: DIMM1
            Bank Locator: CHANNEL A DIMM1
            Type: DDR3
            Type Detail: Synchronous
            Speed: 1333 MHz
            Manufacturer: Kingston   
            Serial Number: 853D8639
            Asset Tag: A1_AssetTagNum1
            Part Number: 99U5471-040.A00LF
            Rank: 2
            Configured Clock Speed: Unknown
    
    Handle 0x002F, DMI type 17, 34 bytes
    Memory Device
            Array Handle: 0x0026
            Error Information Handle: No Error
            Total Width: 64 bits
            Data Width: 64 bits
            Size: 8192 MB
            Form Factor: DIMM
            Set: None
            Locator: DIMM4
            Bank Locator: CHANNEL B DIMM0
            Type: DDR3
            Type Detail: Synchronous
            Speed: 1333 MHz
            Manufacturer: Kingston   
            Serial Number: 8A3D8339
            Asset Tag: A1_AssetTagNum2
            Part Number: 99U5471-040.A00LF
            Rank: 2
            Configured Clock Speed: Unknown
    
    Handle 0x0032, DMI type 17, 34 bytes
    Memory Device
            Array Handle: 0x0026
            Error Information Handle: No Error
            Total Width: 64 bits
            Data Width: 64 bits
            Size: 8192 MB
            Form Factor: DIMM
            Set: None
            Locator: DIMM2
            Bank Locator: CHANNEL B DIMM1
            Type: DDR3
            Type Detail: Synchronous
            Speed: 1333 MHz
            Manufacturer: Kingston   
            Serial Number: 863D7739
            Asset Tag: A1_AssetTagNum3
            Part Number: 99U5471-040.A00LF
            Rank: 2
            Configured Clock Speed: Unknown

    SoYouStart Dashboard Manager



    soyoustart_dashboard_manager_00.png

    soyoustart_dashboard_manager_monitoring_summary_00.png

    CentOS 6.5 64 bit setup with distro's Kernel



    Selecting linux distribution via SoYouStart manager, chose CentOS 6.5 64bit

    soyoustart_dashboard_manager_installos_00.png

    soyoustart_dashboard_manager_installos_01.png

    soyoustart_dashboard_manager_installos_02.png

    Proceed with CentOS 6.5 disk setup for SoYouStart server. I discarded their default partitioning for my own with EXT4 partitions :)

    soyoustart_dashboard_manager_installos_disksetup_00.png

    Proceed with CentOS 6.5 64bit install on SoYouStart server

    soyoustart_dashboard_manager_installos_04.png
    soyoustart_dashboard_manager_installos_05.png

    CentOS 6.5 64bit install complete
    soyoustart_dashboard_manager_installos_06.png

    Initial Virgin centminmodbench.sh results



    Did initial virgin before Centmin Mod LEMP web stack install benchmarks using centminmodbench.sh. You can grab latest version via official Github repository at bench.centminmod.com

    Code:
    -------------------------------------------
    centminmodbench.sh 0.3
    http://bench.centminmod.com
    written by: George Liu (eva2000)
    http://centminmod.com
    -------------------------------------------
    
    -------------------------------------------
    System Information
    -------------------------------------------
    
    2.6.32-431.29.2.el6.x86_64
    
    CentOS release 6.5 (Final)
    
    ----------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                8
    On-line CPU(s) list:   0-7
    Thread(s) per core:    2
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 58
    Stepping:              9
    CPU MHz:               3392.335
    BogoMIPS:              6784.67
    Virtualization:        VT-x
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              256K
    L3 cache:              8192K
    NUMA node0 CPU(s):     0-7
    
    ----------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2:L3 ONLINE
    0   0    0      0    0:0:0:0       yes
    1   0    0      1    1:1:1:0       yes
    2   0    0      2    2:2:2:0       yes
    3   0    0      3    3:3:3:0       yes
    4   0    0      0    0:0:0:0       yes
    5   0    0      1    1:1:1:0       yes
    6   0    0      2    2:2:2:0       yes
    7   0    0      3    3:3:3:0       yes
    
    ----------------------------------------------
                 total       used       free     shared    buffers     cached
    Mem:         32138        436      31701          0         13        139
    Low:         32138        436      31701
    High:            0          0          0
    -/+ buffers/cache:        283      31855
    Swap:         6140          0       6140
    
    ----------------------------------------------
    Filesystem      Size  Used Avail Use% Mounted on
    rootfs           77G  1.6G   72G   3% /
    devtmpfs         16G  212K   16G   1% /dev
    tmpfs            16G     0   16G   0% /dev/shm
    /dev/md1         77G  1.6G   72G   3% /
    /dev/md2         12G  158M   12G   2% /fastdrive
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/etc/named
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/var/named
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/etc/named.conf
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/etc/named.rfc1912.zones
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/etc/rndc.key
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/usr/lib64/bind
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/etc/named.iscdlv.key
    /dev/md1         77G  1.6G   72G   3% /var/named/chroot/etc/named.root.key
    
    
    Code:
    -------------------------------------------
    disk ioping tests
    -------------------------------------------
    
    2014-09-19 20:23:29 URL:https://ioping.googlecode.com/files/ioping-0.6.tar.gz [6957/6957] -> "ioping-0.6.tar.gz" [1]
    Download done.
    ioping-0.6.tar.gz valid file.
    
    Running IOPing I/O benchmark...
    cc -std=c99 -g -Wall -Wextra -pedantic -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -DVERSION=\"0.6\" -c -o ioping.o ioping.c
    cc -o ioping ioping.o -std=c99 -g -Wall -Wextra -pedantic -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -lm
    
    IOPing I/O: ./ioping -c 10 .
    4096 bytes from . (ext4 /dev/md1): request=1 time=2.9 ms
    4096 bytes from . (ext4 /dev/md1): request=2 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=3 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=4 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=5 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=6 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=7 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=8 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=9 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=10 time=0.2 ms
    
    --- . (ext4 /dev/md1) ioping statistics ---
    10 requests completed in 9005.9 ms, 2013 iops, 7.9 mb/s
    min/avg/max/mdev = 0.2/0.5/2.9/0.8 ms
    
    IOPing seek rate: ./ioping -RD .
    
    --- . (ext4 /dev/md1) ioping statistics ---
    11425 requests completed in 3000.1 ms, 5260 iops, 20.5 mb/s
    min/avg/max/mdev = 0.2/0.2/9.5/0.1 ms
    
    IOPing sequential: ./ioping -RL .
    
    --- . (ext4 /dev/md1) ioping statistics ---
    2463 requests completed in 3000.8 ms, 884 iops, 221.1 mb/s
    min/avg/max/mdev = 1.0/1.1/4.4/0.2 ms
    
    IOPing cached: ./ioping -RC .
    
    --- . (ext4 /dev/md1) ioping statistics ---
    54457 requests completed in 3000.1 ms, 766072 iops, 2992.5 mb/s
    min/avg/max/mdev = 0.0/0.0/0.0/0.0 ms
    
    
    Code:
    -------------------------------------------
    disk DD tests
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 8.22555 s, 131 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 8.09943 s, 133 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 10.289 s, 104 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 22.2915 s, 48.2 MB/s
    
    disk fio results show random writes pretty spot on with it's ratings at ARK | Intel® SSD 320 Series (120GB, 2.5in SATA 3Gb/s, 25nm, MLC)
    Code:
    -------------------------------------------
    disk FIO tests
    -------------------------------------------
    
    2014-09-19 20:24:40 URL:https://raw.githubusercontent.com/Crowd9/Benchmark/master/fio-2.0.9.tar.gz [275092/275092] -> "fio-2.0.9.tar.gz" [1]
    Download done.
    fio-2.0.9.tar.gz valid file.
    
    Running FIO benchmark...
    
    FIO_VERSION = fio-2.0.9
    
    FIO random reads:
    randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    randomreads: Laying out IO file(s) (1 file(s) / 1024MB)
    
    randomreads: (groupid=0, jobs=1): err= 0: pid=4447: Fri Sep 19 20:24:53 2014
      read : io=1024.3MB, bw=402004KB/s, iops=100500 , runt=  2609msec
      cpu          : usr=13.00%, sys=86.73%, ctx=315, majf=0, minf=90
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
       READ: io=1024.3MB, aggrb=402003KB/s, minb=402003KB/s, maxb=402003KB/s, mint=2609msec, maxt=2609msec
    
    Disk stats (read/write):
        md1: ios=239605/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=87402/1, aggrmerge=0/0, aggrticks=36155/0, aggrin_queue=36141, aggrutil=95.81%
      sda: ios=88107/1, merge=0/0, ticks=36955/0, in_queue=36944, util=95.81%
      sdc: ios=86727/1, merge=0/0, ticks=35407/0, in_queue=35394, util=95.81%
      sdb: ios=87373/1, merge=0/0, ticks=36103/0, in_queue=36085, util=95.81%
    
    FIO random writes:
    randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    
    randomwrites: (groupid=0, jobs=1): err= 0: pid=4451: Fri Sep 19 20:25:10 2014
      write: io=1024.3MB, bw=62308KB/s, iops=15576 , runt= 16833msec
      cpu          : usr=5.15%, sys=23.21%, ctx=73243, majf=0, minf=25
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
      WRITE: io=1024.3MB, aggrb=62307KB/s, minb=62307KB/s, maxb=62307KB/s, mint=16833msec, maxt=16833msec
    
    Disk stats (read/write):
        md1: ios=0/259391, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/262207, aggrmerge=0/22, aggrticks=0/769659, aggrin_queue=769610, aggrutil=97.41%
      sda: ios=0/262198, merge=0/31, ticks=0/756741, in_queue=756677, util=96.94%
      sdc: ios=0/262208, merge=0/21, ticks=0/825112, in_queue=825068, util=97.41%
      sdb: ios=0/262215, merge=0/14, ticks=0/727125, in_queue=727085, util=96.96%
    
    
    Code:
    
    -------------------------------------------
    Running bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Download Cachefly: 73.8MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Download Linode, Atlanta, GA, USA: 6.35MB/s
    ----------------------------------------------
    Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Download Linode, Dallas, TX, USA: 8.56MB/s
    ----------------------------------------------
    Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Download Leaseweb, Manassas, VA, USA: 11.8MB/s
    ----------------------------------------------
    Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Seattle, WA, USA: 7.18MB/s
    ----------------------------------------------
    Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, San Jose, CA, USA: 5.36MB/s
    ----------------------------------------------
    Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Washington, DC, USA: 42.2MB/s
    ----------------------------------------------
    Download from VersaWeb, Las Vegas, Nevada (http://199.47.210.50/100mbtest.bin)
    Download VersaWeb, Las Vegas, Nevada: 3.87MB/s
    ----------------------------------------------
    Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Download OVH, BHS, Canada: 96.5MB/s
    ----------------------------------------------
    Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Los Angeles, California: 9.15MB/s
    ----------------------------------------------
    Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Seattle, Washington: 4.16MB/s
    ----------------------------------------------
    Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Dallas, Texas: 2.19MB/s
    ----------------------------------------------
    Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Chicago, Illinois: 43.8MB/s
    ----------------------------------------------
    Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Atlanta, Georgia: 4.56MB/s
    ----------------------------------------------
    Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Miami, Florida: 14.8MB/s
    ----------------------------------------------
    Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, New York / New Jersey: 32.0MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Download Linode, Tokyo, JP: 2.32MB/s
    ----------------------------------------------
    Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Singapore: 4.95MB/s
    ----------------------------------------------
    Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Tokyo, Japan: 1.74MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Download Linode, London, UK: 3.15MB/s
    ----------------------------------------------
    Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Download OVH, Paris, France: 4.98MB/s
    ----------------------------------------------
    Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Download SmartDC, Rotterdam, Netherlands: 2.94MB/s
    ----------------------------------------------
    Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Amsterdam, Netherlands: 6.51MB/s
    ----------------------------------------------
    Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, London, UK: 10.4MB/s
    ----------------------------------------------
    Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Paris, France: 5.08MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Sydney, Australia: 6.05MB/s
    
    Code:
    
    -------------------------------------------
    Running ping tests...
    -------------------------------------------
    
    ----------------------------------------------
    Pings (cachefly.cachefly.net):
    PING cachefly.cachefly.net (184.170.128.58) 56(84) bytes of data.
    64 bytes from 184.170.128.58: icmp_seq=1 ttl=57 time=20.1 ms
    64 bytes from 184.170.128.58: icmp_seq=2 ttl=57 time=20.5 ms
    64 bytes from 184.170.128.58: icmp_seq=3 ttl=57 time=20.4 ms
    
    --- cachefly.cachefly.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 4440ms
    rtt min/avg/max/mdev = 20.131/20.371/20.500/0.169 ms
    
    ----------------------------------------------
    Pings (syd-au-ping.vultr.com):
    PING syd-au-ping.vultr.com (108.61.212.117) 56(84) bytes of data.
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=1 ttl=51 time=248 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=2 ttl=51 time=248 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=3 ttl=51 time=248 ms
    
    --- syd-au-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2590ms
    rtt min/avg/max/mdev = 248.905/248.928/248.950/0.407 ms
    
    ----------------------------------------------
    Pings (hnd-jp-ping.vultr.com):
    PING hnd-jp-ping.vultr.com (108.61.201.151) 56(84) bytes of data.
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=1 ttl=48 time=275 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=2 ttl=48 time=275 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=3 ttl=48 time=275 ms
    
    --- hnd-jp-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2278ms
    rtt min/avg/max/mdev = 275.405/275.435/275.480/0.032 ms
    
    ----------------------------------------------
    Pings (lax-ca-us-ping.vultr.com):
    PING lax-ca-us-ping.vultr.com (108.61.219.200) 56(84) bytes of data.
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=1 ttl=53 time=78.8 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=2 ttl=53 time=78.9 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=3 ttl=53 time=78.9 ms
    
    --- lax-ca-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2082ms
    rtt min/avg/max/mdev = 78.877/78.914/78.956/0.325 ms
    
    ----------------------------------------------
    Pings (wa-us-ping.vultr.com):
    PING wa-us-ping.vultr.com (108.61.194.105) 56(84) bytes of data.
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=1 ttl=50 time=78.4 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=2 ttl=50 time=78.5 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=3 ttl=50 time=78.5 ms
    
    --- wa-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2081ms
    rtt min/avg/max/mdev = 78.477/78.524/78.561/0.231 ms
    
    ----------------------------------------------
    Pings (tx-us-ping.vultr.com):
    PING tx-us-ping.vultr.com (108.61.224.175) 56(84) bytes of data.
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=1 ttl=51 time=124 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=2 ttl=51 time=124 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=3 ttl=51 time=124 ms
    
    --- tx-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2125ms
    rtt min/avg/max/mdev = 124.491/124.525/124.574/0.408 ms
    
    ----------------------------------------------
    Pings (il-us-ping.vultr.com):
    PING il-us-ping.vultr.com (107.191.51.12) 56(84) bytes of data.
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=1 ttl=54 time=18.4 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=2 ttl=54 time=18.4 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=3 ttl=54 time=18.4 ms
    
    --- il-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2020ms
    rtt min/avg/max/mdev = 18.473/18.480/18.492/0.008 ms
    
    ----------------------------------------------
    Pings (ga-us-ping.vultr.com):
    PING ga-us-ping.vultr.com (108.61.193.166) 56(84) bytes of data.
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=1 ttl=53 time=29.5 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=2 ttl=53 time=29.6 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=3 ttl=53 time=29.5 ms
    
    --- ga-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2032ms
    rtt min/avg/max/mdev = 29.510/29.593/29.677/0.156 ms
    
    ----------------------------------------------
    Pings (fl-us-ping.vultr.com):
    PING fl-us-ping.vultr.com (104.156.244.232) 56(84) bytes of data.
    64 bytes from 104.156.244.232: icmp_seq=1 ttl=53 time=42.5 ms
    64 bytes from 104.156.244.232: icmp_seq=2 ttl=53 time=42.5 ms
    64 bytes from 104.156.244.232: icmp_seq=3 ttl=53 time=42.5 ms
    
    --- fl-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2045ms
    rtt min/avg/max/mdev = 42.520/42.540/42.579/0.170 ms
    
    ----------------------------------------------
    Pings (nj-us-ping.vultr.com):
    PING nj-us-ping.vultr.com (108.61.149.182) 56(84) bytes of data.
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=1 ttl=58 time=10.0 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=2 ttl=58 time=10.0 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=3 ttl=58 time=9.91 ms
    
    --- nj-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2012ms
    rtt min/avg/max/mdev = 9.913/10.024/10.085/0.113 ms
    
    ----------------------------------------------
    Pings (fra-de-ping.vultr.com):
    PING fra-de-ping.vultr.com (108.61.210.117) 56(84) bytes of data.
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=1 ttl=54 time=93.2 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=2 ttl=54 time=93.2 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=3 ttl=54 time=93.3 ms
    
    --- fra-de-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2096ms
    rtt min/avg/max/mdev = 93.238/93.267/93.321/0.038 ms
    
    ----------------------------------------------
    Pings (ams-nl-ping.vultr.com):
    PING ams-nl-ping.vultr.com (108.61.198.102) 56(84) bytes of data.
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=1 ttl=49 time=95.1 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=2 ttl=49 time=95.3 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=3 ttl=49 time=95.1 ms
    
    --- ams-nl-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2097ms
    rtt min/avg/max/mdev = 95.150/95.217/95.330/0.080 ms
    
    ----------------------------------------------
    Pings (lon-gb-ping.vultr.com):
    PING lon-gb-ping.vultr.com (108.61.196.101) 56(84) bytes of data.
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=1 ttl=56 time=77.5 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=2 ttl=56 time=77.5 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=3 ttl=56 time=77.8 ms
    
    --- lon-gb-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2080ms
    rtt min/avg/max/mdev = 77.506/77.654/77.894/0.364 ms
    
    ----------------------------------------------
    Pings (par-fr-ping.vultr.com):
    PING par-fr-ping.vultr.com (108.61.209.127) 56(84) bytes of data.
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=1 ttl=52 time=85.4 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=2 ttl=52 time=85.4 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=3 ttl=52 time=85.4 ms
    
    --- par-fr-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2088ms
    rtt min/avg/max/mdev = 85.421/85.438/85.451/0.337 ms
    
    ----------------------------------------------
    Pings (VersaWeb Las Vegas):
    PING 199.47.210.50 (199.47.210.50) 56(84) bytes of data.
    64 bytes from 199.47.210.50: icmp_seq=1 ttl=58 time=76.6 ms
    64 bytes from 199.47.210.50: icmp_seq=2 ttl=58 time=76.3 ms
    64 bytes from 199.47.210.50: icmp_seq=3 ttl=58 time=76.3 ms
    
    --- 199.47.210.50 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2079ms
    rtt min/avg/max/mdev = 76.313/76.437/76.685/0.364 ms
    
    ----------------------------------------------
    Pings (VersaWeb Seattle):
    PING 76.164.234.1 (76.164.234.1) 56(84) bytes of data.
    64 bytes from 76.164.234.1: icmp_seq=1 ttl=58 time=88.6 ms
    64 bytes from 76.164.234.1: icmp_seq=2 ttl=58 time=87.5 ms
    64 bytes from 76.164.234.1: icmp_seq=3 ttl=58 time=87.7 ms
    
    --- 76.164.234.1 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2091ms
    rtt min/avg/max/mdev = 87.589/87.989/88.601/0.501 ms
    
    ----------------------------------------------
    Pings (OVH Canada):
    PING bhs.proof.ovh.net (192.99.19.165) 56(84) bytes of data.
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=1 ttl=62 time=0.281 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=2 ttl=62 time=0.289 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=3 ttl=62 time=0.291 ms
    
    --- bhs.proof.ovh.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2000ms
    rtt min/avg/max/mdev = 0.281/0.287/0.291/0.004 ms
    
    
    Code:
    
    -------------------------------------------
    Running mtr tests...
    -------------------------------------------
    
    ----------------------------------------------
    mtr --report --report-cycles=10 cachefly.cachefly.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4  10.0   0.3  65.7  22.1
      2. bhs-g1-6k.qc.ca               0.0%    10    0.6   0.9   0.6   1.9   0.4
      3. mtl-2-6k.qc.ca               10.0%    10    1.6  29.9   1.6 170.7  57.4
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. bx5-chicagodt.bell.ca         0.0%    10   17.7  26.5  17.7  80.9  20.6
      6. newcore1-chicagocp_xe-4-0-0_  0.0%    10   28.2  38.3  26.2  72.1  15.7
      7. tcore4-toronto63_POS00-6-0-0  0.0%    10   33.6  31.6  28.6  34.4   2.0
      8. Ncore3-montreal02_POS0-15-0-  0.0%    10   32.2  30.1  27.3  33.0   1.8
      9. agg2-montreal02_xe5-0-0.net.  0.0%    10   26.2  30.3  25.9  51.0   7.5
    10. dis53-montreal02_5-0-0.net.b  0.0%    10   30.3  29.9  25.9  43.4   5.0
    11. 204.101.4.238                 0.0%    10   20.6  20.0  18.4  23.3   1.5
    12. v3950.AK4C.800SQ.as10929.net  0.0%    10   22.0  21.8  19.3  24.0   1.4
    13. 184.170.128.58                0.0%    10   18.4  19.3  18.4  20.6   1.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.atlanta.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 10.0%    10    0.5   2.1   0.4  14.8   4.8
      2. 2607:5300::a5                 0.0%    10    0.9   1.0   0.8   2.1   0.4
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. nwk-1-6k.nj.us                0.0%    10    8.7   8.7   8.7   8.7   0.0
      5. vl-51.car2.Newark1.Level3.ne  0.0%    10    9.0   9.0   8.9   9.0   0.0
      6. vl-4063.edge2.Washington1.Le  0.0%    10   13.5  13.5  13.5  13.6   0.0
      7. vl-4040.car1.Atlanta2.Level3  0.0%    10  196.2 112.5  30.7 247.9  85.4
      8. vl-51.ear1.Atlanta2.Level3.n  0.0%    10   27.4 136.3  27.4 919.9 282.2
      9. GIGLINX-INC.edge4.Atlanta2.L  0.0%    10   27.6  31.9  27.6  70.2  13.5
    10. 2604:b900:1:1::2              0.0%    10   27.5  27.5  27.4  27.6   0.0
    11. speedtest.atlanta.linode.com  0.0%    10   27.2  27.3  27.2  27.3   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.dallas.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 10.0%    10    0.7  21.9   0.5 132.0  45.8
      2. 2607:5300::a7                 0.0%    10    1.0   1.1   1.0   1.5   0.1
      3. 2607:5300::98                10.0%    10    1.8  24.5   1.7 169.8  55.2
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. bbr01.eq01.chi01.networklaye  0.0%    10   25.4  25.4  25.4  25.4   0.0
      6. po3.bbr01.eq01.dal01.network  0.0%    10   37.6  37.7  37.6  37.9   0.1
      7. 2607.f0d0.0002.0002.0000.000  0.0%    10   37.9  37.9  37.9  38.1   0.1
      8. 2607.f0d0.0002.0004.0000.000  0.0%    10   38.7  38.1  38.0  38.7   0.2
      9. 2607.f0d0.0002.0004.0000.000  0.0%    10   62.4  63.1  37.8  92.2  12.9
    10. 2607.f0d0.0002.0004.0000.000 20.0%    10   62.8  59.7  38.2  62.9   8.7
    11. speedtest.dallas.linode.com  10.0%    10   62.5  61.0  49.1  62.6   4.5
    
    ----------------------------------------------
    mtr --report --report-cycles=10 mirror.us.leaseweb.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 60.0%    10   93.5  25.3   0.6  93.5  45.5
      2. 2607:5300::a5                 0.0%    10    0.9   1.1   0.8   2.2   0.5
      3. 2607:5300::f8                40.0%    10   81.9  21.0   8.8  81.9  29.8
      4. nwk-1-6k.nj.us                0.0%    10    8.8  13.2   8.7  32.8   9.5
      5. vl-52.car2.Newark1.Level3.ne  0.0%    10    9.2  47.1   9.0 189.3  64.9
      6. vl-4063.edge2.Washington1.Le  0.0%    10   13.5  17.1  13.5  36.0   7.2
      7. vl-4083.edge1.Washington1.Le  0.0%    10   13.6  19.3  13.6  70.2  17.9
      8. FIBERRING-B.edge1.Washington  0.0%    10   78.8  78.9  78.7  79.6   0.3
      9. 2604:9a00::48                 0.0%    10   78.1  78.1  78.1  78.2   0.0
    10. 2604:9a00:2010:a001:1:face:b  0.0%    10   78.2  78.2  78.2  78.2   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sea01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10   11.0   6.7   0.4  46.0  15.1
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   1.2   0.7   3.5   1.0
      3. mtl-2-6k.qc.ca                0.0%    10    1.7   1.7   1.6   1.9   0.1
      4. 198.27.73.180                80.0%    10   17.8  17.7  17.7  17.8   0.0
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   17.7  17.7  17.7  17.8   0.0
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   18.0  17.9  17.9  18.0   0.0
      7. ae1.bbr02.wb01.sea02.network  0.0%    10  179.3 173.3 161.9 179.3   5.0
      8. ae1.dar01.sr01.sea01.network  0.0%    10  176.7 173.9 166.3 177.1   3.4
      9. po1.fcr01.sr01.sea01.network  0.0%    10   77.9  78.5  77.9  79.5   0.6
    10. speedtest.sea01.softlayer.co 10.0%    10  174.5 173.4 168.1 176.7   3.5
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sjc01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4  19.6   0.3 134.3  44.7
      2. bhs-g2-6k.qc.ca               0.0%    10    0.9   0.8   0.8   0.9   0.1
      3. mtl-2-6k.qc.ca                0.0%    10    2.1  27.0   1.6 186.9  60.1
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   18.0  18.8  17.7  28.5   3.4
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   18.0  18.0  18.0  18.0   0.0
      7. ae1.bbr02.cs01.den01.network  0.0%    10   47.2  47.5  47.2  48.2   0.4
      8. ae1.bbr01.eq01.sjc02.network  0.0%    10   67.6  67.6  67.6  67.6   0.0
      9. ae5.dar01.sr01.sjc01.network  0.0%    10   68.0  68.0  68.0  68.1   0.0
    10. po1.fcr01.sr01.sjc01.network 10.0%    10   68.1  69.7  68.1  82.0   4.6
    11. speedtest.sjc01.softlayer.co  0.0%    10   68.0  68.1  68.0  68.2   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.wdc01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                20.0%    10    0.4  11.7   0.4  78.8  27.4
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   1.4   0.8   2.4   0.7
      3. mtl-2-6k.qc.ca               40.0%    10   21.7   5.0   1.6  21.7   8.2
      4. 198.27.73.178                90.0%    10   17.7  17.7  17.7  17.7   0.0
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   17.7  17.7  17.7  17.7   0.0
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   18.0  18.3  17.9  20.9   1.0
      7. ae0.bbr02.eq01.wdc02.network  0.0%    10   25.4  25.4  25.4  25.8   0.1
      8. ae1.dar01.sr01.wdc01.network  0.0%    10   26.1  26.2  26.1  27.2   0.4
      9. po1.fcr01.sr01.wdc01.network  0.0%    10   26.7  27.2  26.5  32.3   1.8
    10. speedtest.wdc01.softlayer.co  0.0%    10   26.5  26.6  26.5  26.8   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.tokyo.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 10.0%    10    0.7  10.1   0.4  80.0  26.3
      2. 2607:5300::a5                 0.0%    10    0.9   1.0   0.8   2.0   0.3
      3. 2607:5300::f8                90.0%    10    8.8   8.8   8.8   8.8   0.0
      4. 2607:5300::d0                 0.0%    10   68.9  68.9  68.8  69.0   0.1
      5. 2607:5300::105                0.0%    10   69.1  69.0  68.8  69.6   0.2
      6. 6lajbb001.int-gw.kddi.ne.jp   0.0%    10  107.8  72.5  68.6 107.8  12.4
      7. 6otejbb205.int-gw.kddi.ne.jp  0.0%    10  167.5 171.6 167.5 208.2  12.9
      8. 6cm-fcu203.int-gw.kddi.ne.jp  0.0%    10  172.7 172.4 167.7 178.7   4.4
      9. 2001:268:f702:6c::2           0.0%    10  168.0 168.5 167.9 173.2   1.7
    10. speedtest.tokyo.linode.com   10.0%    10  167.5 167.5 167.4 167.7   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sng01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                20.0%    10    0.4  28.5   0.3 212.9  74.6
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   0.9   0.7   1.8   0.3
      3. mtl-2-6k.qc.ca               50.0%    10    1.7   1.8   1.6   2.3   0.3
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   17.7  17.7  17.7  17.8   0.0
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   17.9  18.2  17.9  19.8   0.6
      7. ae1.bbr02.cs01.den01.network  0.0%    10   48.2  48.0  47.3  50.2   1.0
      8. ae1.bbr01.eq01.sjc02.network  0.0%    10   67.9  67.9  67.8  68.0   0.1
      9. ae7.bbr02.eq01.sjc02.network  0.0%    10   68.0  68.2  67.9  69.1   0.5
    10. ae0.bbr01.eq01.tok01.network  0.0%    10  176.3 176.7 176.3 177.6   0.5
    11. ae1.bbr01.eq01.sng02.network 90.0%    10  260.0 260.0 260.0 260.0   0.0
    12. ae5.dar01.sr03.sng01.network 10.0%    10  260.0 260.0 259.9 260.1   0.1
    13. po1.fcr01.sr03.sng01.network 60.0%    10  260.0 296.1 260.0 404.4  72.2
    14. speedtest.sng01.softlayer.co 10.0%    10  259.9 259.9 259.8 259.9   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.london.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f  0.0%    10    0.5  11.3   0.4 107.2  33.7
      2. 2607:5300::a5                 0.0%    10    0.7   0.9   0.7   1.0   0.1
      3. 2607:5300::f8                60.0%    10    9.0  12.3   8.8  22.7   6.9
      4. nwk-1-6k.nj.us                0.0%    10    8.8   9.7   8.7  19.0   3.2
      5. vl-52.car1.Newark1.Level3.ne  0.0%    10    8.9  37.8   8.9 206.0  63.1
      6. 2001:1900:4:1::ce             0.0%    10    9.6  11.6   9.2  21.5   4.6
      7. vl-4080.car1.NewYork1.Level3  0.0%    10    9.3  11.1   9.3  26.6   5.5
      8. vl-4086.edge3.London1.Level3  0.0%    10   78.3  78.3  78.3  78.4   0.0
      9. REDBUS-INTE.edge3.London1.Le 20.0%    10   79.2  79.1  79.0  79.2   0.1
    10. 2001:4d78:fe01:2:2::c         0.0%    10   79.6  79.4  79.3  79.6   0.1
    11. speedtest.london.linode.com   0.0%    10   77.9  77.9  77.9  78.2   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 mirror.i3d.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 20.0%    10   85.1  56.6   0.5 257.5  90.3
      2. 2607:5300::a7                 0.0%    10    1.0   1.1   0.9   1.8   0.3
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. 10ge.linx-jnpr.th-n.i3d.net   0.0%    10  113.2  87.2  77.5 117.0  15.0
      6. 20ge.cr1-lr0.smartdc.rtd.i3d  0.0%    10   82.8  86.0  82.8  89.2   2.9
      7. 80ge.br2-cr1.smartdc.rtd.i3d  0.0%    10   89.1  91.4  84.7  99.9   5.7
      8. 2a00:1630:1:13d::13d          0.0%    10   88.7  88.6  88.6  88.7   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 syd-au-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                20.0%    10    0.4  25.4   0.4 105.6  36.4
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   1.2   0.7   2.2   0.6
      3. mtl-2-6k.qc.ca                0.0%    10    1.6  41.0   1.6 201.4  82.9
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. 198.27.73.150                 0.0%    10  208.9 161.5  65.6 264.2  73.8
      6. 198.27.73.248                10.0%    10   66.1  66.1  66.1  66.2   0.0
      7. eqix.sv1.ppc1.com             0.0%    10  268.7 267.5 265.8 269.0   1.0
      8. 203-219-35-15.static.tpgi.co  0.0%    10  265.5 265.6 265.5 265.7   0.1
      9. 203-219-106-138.tpgi.com.au   0.0%    10  263.0 263.1 262.9 263.5   0.2
    10. lag41.sclarinte01.aapt.net.a 90.0%    10  273.1 273.1 273.1 273.1   0.0
    11. lag30.sglebinte01.aapt.net.a 40.0%    10  272.2 266.9 263.9 272.2   3.6
    12. 203-174-189-250.syd.static-i 10.0%    10  248.8 249.5 248.7 255.2   2.2
    13. 27.111.243.214               10.0%    10  249.4 249.3 249.3 249.4   0.0
    14. 108.61.212.117.vultr.com     10.0%    10  248.9 248.9 248.9 249.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 hnd-jp-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10  356.8  69.4   0.4 356.8 118.6
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   0.7   0.6   0.9   0.1
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. nyk-1-6k.ny.us               40.0%    10    9.2  14.7   9.2  42.2  13.5
      5. eqix2-ny.pacnet.com           0.0%    10   86.1  86.2  86.1  86.5   0.1
      6. gi9-0-0.cr2.nrt1.asianetcom.  0.0%    10  188.5 188.5 188.5 188.6   0.0
      7. xe0-0-2.gw2.nrt4.asianetcom.  0.0%    10  188.6 188.9 188.6 191.9   1.0
      8. SRV-0001.asianetcom.net       0.0%    10  266.4 268.0 266.4 282.0   4.9
      9. 71.ae1.sw1.tko1.jp.scnet.net 10.0%    10  281.6 281.7 281.6 281.9   0.1
    10. unknown.servercentral.net    10.0%    10  267.2 267.2 267.2 267.3   0.0
    11. 108.61.201.151.vultr.com     10.0%    10  275.4 275.7 275.4 276.1   0.3
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lax-ca-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10   86.8  14.1   0.3  86.8  32.2
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   1.0   0.7   2.1   0.4
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. nwk-1-6k.nj.us               70.0%    10    9.6   9.7   9.6   9.8   0.1
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ae-4-90.edge8.NewYork1.Level 10.0%    10   10.1  10.2  10.1  10.3   0.1
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%    10   10.2  10.2  10.1  10.3   0.1
    11. xe-10-2-0.lax20.ip4.gtt.net   0.0%    10   80.9  81.1  80.9  82.2   0.4
    12. gtt-gw-cr1.lax2.ip4.gtt.net   0.0%    10   78.2  78.5  78.1  81.2   1.0
    13. ae2-50g.ar1.lax2.us.as4436.g 10.0%    10   82.6  92.7  82.6 103.9   5.5
    14. as20473.xe-6-0-1.ar1.lax2.us  0.0%    10   81.5  79.2  78.7  81.5   0.9
    15. 108.61.219.200.vultr.com     10.0%    10   78.9  79.0  78.9  79.2   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 wa-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10   58.0  35.8   0.3 250.0  82.5
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   1.1   0.6   2.0   0.6
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ae-6-6.ebr2.Chicago2.Level3.  0.0%    10   78.9  78.9  78.8  78.9   0.1
    10. ???                           0.0%     0    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 tx-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.3  23.4   0.3 102.3  36.7
      2. bhs-g2-6k.qc.ca               0.0%    10    0.9   0.9   0.8   1.0   0.1
      3. mtl-1-6k.qc.ca               40.0%    10    1.6  67.2   1.6 190.0  80.8
      4. nwk-1-6k.nj.us               80.0%    10    9.6  15.2   9.6  20.7   7.8
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ae-3-80.edge8.NewYork1.Level  0.0%    10   10.5  10.7  10.2  13.3   1.0
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%    10   12.1  11.1  10.2  12.3   0.8
    11. xe-2-0-0.dal33.ip4.gtt.net    0.0%    10   51.5  51.9  51.5  54.7   1.0
    12. gtt-gw.ip4.gtt.net            0.0%    10  124.5 124.6 124.5 125.2   0.2
    13. as20473.xe-5-1-2.cr1.dfw1.us  0.0%    10  123.9 123.9 123.9 124.0   0.1
    14. 108.61.224.175.vultr.com     11.1%     9  123.9 123.9 123.9 124.0   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 il-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.8  19.4   0.3 102.8  38.1
      2. bhs-g1-6k.qc.ca               0.0%    10    0.6   0.7   0.6   0.9   0.1
      3. mtl-1-6k.qc.ca               90.0%    10    1.7   1.7   1.7   1.7   0.0
      4. chi-1-6k.il.us               90.0%    10   17.7  17.7  17.7  17.7   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ae-0.gtt-offnet.chcgil09.us.  0.0%    10   17.8  18.1  17.8  20.8   1.0
      7. ae4.cr1.ord6.us.scnet.net     0.0%    10   19.4  21.9  18.4  48.9   9.5
      8. ae1.ar9.ord6.us.scnet.net     0.0%    10   18.4  18.4  18.4  18.5   0.0
      9. ethernet1-1-br1.chi2.choopa.  0.0%    10   22.1  22.8  18.6  28.9   4.0
    10. 107.191.51.12.vultr.com       0.0%    10   18.5  18.5  18.5  18.6   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ga-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10  194.7  30.0   0.3 194.7  72.8
      2. bhs-g1-6k.qc.ca               0.0%    10    0.8   0.9   0.7   2.1   0.4
      3. 198.27.73.204                90.0%    10    8.7   8.7   8.7   8.7   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ae-72-72.csw2.NewYork1.Level 10.0%    10    9.3   9.4   9.1  10.0   0.3
      8. ae-2-70.edge8.NewYork1.Level  0.0%    10    9.4   9.4   9.2   9.7   0.1
      9. IntelQ-Tinet-level3-1ge.NewY  0.0%    10    9.2  10.5   9.2  22.1   4.0
    10. xe-7-0-0.atl11.ip4.gtt.net    0.0%    10   29.0  36.2  28.8  76.1  16.1
    11. ae4-150.cr1.atl1.ip4.gtt.net  0.0%    10   29.5  34.5  29.5  78.0  15.3
    12. ae1-40g.cr2.atl1.us.as4436.g  0.0%    10   29.8  36.1  29.6  90.4  19.1
    13. as20473.xe-1-3-1.cr2.atl1.us  0.0%    10   30.8  30.9  30.8  31.1   0.1
    14. 108.61.193.166.vultr.com      0.0%    10   29.6  29.7  29.5  30.2   0.2
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fl-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    0.5  44.8   0.4 139.7  57.0
      2. bhs-g2-6k.qc.ca               0.0%    10    2.5   1.3   0.8   2.5   0.7
      3. mtl-1-6k.qc.ca               80.0%    10    1.6   1.6   1.6   1.6   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level  0.0%    10   10.2  10.6  10.2  12.2   0.7
      9. ae-2-70.edge8.NewYork1.Level  0.0%    10   10.5  12.5  10.1  31.9   6.8
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%    10   10.2  12.3  10.1  24.1   4.7
    11. xe-7-1-2.mia12.ip4.gtt.net    0.0%    10   43.0  42.4  42.2  43.1   0.3
    12. gtt-gw-cr1.mia1.ip4.gtt.net   0.0%    10   42.6  43.9  42.6  49.6   2.7
    13. as20473.ae5-1914.cr1.mia1.us  0.0%    10   43.1  43.2  43.1  43.5   0.1
    14. 104.156.244.232               0.0%    10   42.6  42.6  42.5  42.6   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 nj-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.3  16.6   0.3  85.8  32.7
      2. bhs-g2-6k.qc.ca               0.0%    10    0.7   0.9   0.7   1.7   0.3
      3. 198.27.73.206                90.0%    10    8.7   8.7   8.7   8.7   0.0
      4. nyk-5-6k.ny.us               70.0%    10    9.3   9.2   9.2   9.3   0.1
      5. nyiix.gi3-6.cr1.nyc1.choopa.  0.0%    10   24.5  16.0  10.1  33.5   8.8
      6. ethernet1-49-c11-8-c6-1.pnj1  0.0%    10   10.0  10.0  10.0  10.0   0.0
      7. 108.61.149.182.vultr.com      0.0%    10   10.1  10.1  10.0  10.2   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fra-de-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10    0.7  28.9   0.3 134.7  51.9
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   1.2   0.8   2.1   0.5
      3. mtl-1-6k.qc.ca               50.0%    10  177.7  36.8   1.6 177.7  78.7
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level  0.0%    10   11.2  11.3  10.1  16.1   2.0
      9. ae-2-70.edge8.NewYork1.Level  0.0%    10   10.2  10.2  10.1  10.2   0.1
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%    10   10.1  11.3  10.1  21.9   3.7
    11. xe-8-1-0.fra61.ip4.gtt.net    0.0%    10   95.7  95.8  95.7  95.9   0.1
    12. choopa-gw.ip4.gtt.net         0.0%    10   96.0  96.0  96.0  96.1   0.1
    13. 108.61.210.117.vultr.com     10.0%    10   93.3  93.2  93.1  93.3   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ams-nl-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                60.0%    10    0.4  13.4   0.4  51.5  25.3
      2. bhs-g2-6k.qc.ca               0.0%    10    0.9   1.1   0.8   2.1   0.5
      3. mtl-1-6k.qc.ca               90.0%    10    1.6   1.6   1.6   1.6   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level 90.0%    10   91.8  91.8  91.8  91.8   0.0
      9. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lon-gb-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4   4.8   0.3  39.8  13.2
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   0.7   0.6   0.9   0.1
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ae-72-72.csw2.NewYork1.Level 90.0%    10   76.9  76.9  76.9  76.9   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 par-fr-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10  287.7  50.7   0.4 287.7  93.0
      2. bhs-g2-6k.qc.ca               0.0%    10    2.3   1.3   0.8   2.3   0.6
      3. mtl-1-6k.qc.ca               50.0%    10    1.6   1.9   1.6   2.8   0.5
      4. nwk-1-6k.nj.us               50.0%    10    9.6  14.2   9.6  32.7  10.3
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level 90.0%    10   10.2  10.2  10.2  10.2   0.0
      9. ae-1-60.edge8.NewYork1.Level  0.0%    10   10.3  10.6  10.2  12.2   0.7
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%     9   10.2  10.2  10.1  10.2   0.0
    11. xe-3-0-1.par90.ip4.gtt.net    0.0%     9   95.6  92.4  89.3 101.3   4.8
    12. choopa-gw.ip4.gtt.net         0.0%     9   85.7  86.1  85.6  89.1   1.2
    13. 108.61.209.127.vultr.com     11.1%     9   85.5  85.5  85.4  85.5   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Las Vegas
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    4.5  48.0   0.4 353.1 110.0
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   0.8   0.7   0.9   0.0
      3. 198.27.73.204                90.0%    10    8.7   8.7   8.7   8.7   0.0
      4. 198.27.73.166                 0.0%    10   68.8  79.8  68.7 179.3  35.0
      5. 198.27.73.158                 0.0%    10   68.7 143.7  68.7 355.7 106.1
      6. any2ix.coresite.com           0.0%    10   76.0  76.7  76.0  79.4   1.3
      7. te3-4.core1.las1.fiberhub.ne  0.0%    10   76.5  76.2  76.1  76.5   0.1
      8. 199.47.210.50                 0.0%    10   76.3  76.4  76.3  76.7   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Seattle
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4  18.1   0.3  84.3  35.2
      2. bhs-g2-6k.qc.ca               0.0%    10    1.2   1.5   0.7   2.7   0.7
      3. mtl-1-6k.qc.ca               30.0%    10    1.6   1.7   1.6   1.9   0.1
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level 10.0%    10   10.1  10.2  10.1  10.3   0.1
      9. ae-2-70.edge2.NewYork1.Level  0.0%    10   10.2  10.3  10.1  10.4   0.1
    10. ae1.er4.lga5.us.above.net     0.0%    10   10.3  10.7  10.1  12.9   0.9
    11. ae3.cr2.lga5.us.above.net     0.0%    10   10.8  14.1  10.4  37.6   8.6
    12. ae6.cr2.ord2.us.above.net     0.0%    10   29.8  30.5  29.7  33.5   1.3
    13. ae11.cr1.ord2.us.above.net    0.0%    10   23.0  27.9  22.9  49.8   9.8
    14. ae16.mpr1.sea1.us.above.net   0.0%    10   73.6  74.1  73.5  76.4   1.1
    15. 208.185.185.146.IPYX-086691-  0.0%    10   87.8  88.9  87.1  92.5   1.9
    16. 76.164.234.1                 10.0%    10   87.8  89.4  87.6  98.3   3.4
    
    ----------------------------------------------
    mtr --report --report-cycles=10 OVH Canada
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 10.0%    10    0.5  13.4   0.4 116.8  38.8
      2. 2001:41d0::210c               0.0%    10    2.5   1.6   0.8   2.6   0.7
      3. 2607:5300:60:44a5::1          0.0%    10    0.3   0.3   0.3   0.3   0.0
    
    
    Code:
    -------------------------------------------
    OpenSSL System Benchmark
    -------------------------------------------
    
    OpenSSL 1.0.1e-fips 11 Feb 2013
    -------------------------------------------
    openssl speed rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc -multi 8
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    md5             292051.50k   918657.77k  2230417.66k  3442208.09k  4012116.65k
    sha1            273491.40k   748589.38k  1576694.19k  2251222.02k  2675471.70k
    rc4            2499026.02k  3358354.69k  3877983.74k  3985628.50k  4082365.78k
    aes-128 cbc     523997.67k   570361.24k   609404.42k   613614.25k   611650.22k
    aes-256 cbc     383235.43k   410772.82k   433732.78k   435649.88k   433662.63k
    sha256          197707.92k   431525.50k   736591.66k   890377.22k   985314.65k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000300s 0.000009s   3331.0 116794.5
    rsa 4096 bits 0.001973s 0.000031s    506.9  31904.6
                                  sign    verify    sign/s verify/s
    256 bit ecdsa (nistp256)   0.0000s   0.0001s  44077.5  10484.4
    -------------------------------------------
    openssl speed -evp aes256 -multi 8
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp            2798154.13k  3499689.09k  3743517.21k  3807949.14k  3823007.06k
    -------------------------------------------
    openssl speed -evp aes128 -multi 8
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp            3634035.07k  4786234.62k  5188511.32k  5280527.70k  5324775.42k
    
    Code:
    -------------------------------------------
    centminmodbench.sh completed
    -------------------------------------------
    
    centminmodbench.sh Total Run Time: 1117.218260281 seconds
    
    ----------------------------------------------------
    Generated Public Report Log you can share...
    at: /home/centminmodbench_logs/_publicreport_190914-202328.log
    ----------------------------------------------------
    
     
    Last edited: Dec 5, 2014
  2. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    Centmin Mod .08 beta01 install



    Will be installing Centmin Mod .08 beta01 LEMP web stack for the server.

    Default CentOS 6.5 64bit OS installed has selinux enabled, so disable it first and reboot server.

    Code:
    sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config && setenforce 0
    shutdown -r now
    Used the command line installer.sh method for Centmin Mod .08 beta01 install:

    Code:
    curl -sL https://gist.github.com/centminmod/dbe765784e03bc4b0d40/raw/installer.sh | bash
    One of the fastest Centmin Mod .08 beta01 installs I've done - 857 seconds :D
    Code:
    ccache stats:
    cache directory                     /home/.ccache
    cache hit (direct)                   767
    cache hit (preprocessed)             304
    cache miss                          3999
    called for link                      234
    called for preprocessing             244
    compile failed                        55
    preprocessor error                    62
    bad compiler arguments                54
    unsupported source language           74
    autoconf compile/link                611
    unsupported compiler option           14
    no input file                        130
    files in cache                      8606
    cache size                         216.6 Mbytes
    max cache size                       2.0 Gbytes
    
    Total YUM Time: 230.661645395 seconds
    Total Centmin Mod Install Time: 857.408128619 seconds
    Post install check list
    Code:
    *************************************************
    * Post-Install Check List....
    *************************************************
    
    --------------------------------------------------------
    Check ccache Version:
    --------------------------------------------------------
    ccache version 3.1.6
    
    Copyright (C) 2002-2007 Andrew Tridgell
    Copyright (C) 2009-2011 Joel Rosdahl
    
    This program is free software; you can redistribute it and/or modify it under
    the terms of the GNU General Public License as published by the Free Software
    Foundation; either version 3 of the License, or (at your option) any later
    version.
    
    --------------------------------------------------------
    Check Nginx Version:
    --------------------------------------------------------
    nginx version: nginx/1.7.5
    built by gcc 4.4.7 20120313 (Red Hat 4.4.7-4) (GCC)
    TLS SNI support enabled
    configure arguments: --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --with-http_ssl_module --with-http_gzip_static_module --with-http_stub_status_module --with-http_sub_module --with-http_addition_module --with-http_image_filter_module --with-http_secure_link_module --with-http_flv_module --with-http_realip_module --with-openssl-opt=enable-tlsext --add-module=../ngx-fancyindex-ngx-fancyindex --add-module=../ngx_cache_purge-2.1 --add-module=../headers-more-nginx-module-0.25 --add-module=../nginx-accesskey-2.0.3 --add-module=../nginx-http-concat-master --with-http_dav_module --add-module=../nginx-dav-ext-module-0.0.3 --add-module=../openresty-memc-nginx-module-1518da4 --add-module=../openresty-srcache-nginx-module-ffa9ab7 --add-module=../nginx-sticky-module-1.2.5 --add-module=../nginx_upstream_check_module-0.1.9 --with-openssl=../openssl-1.0.1i --with-libatomic --with-pcre=../pcre-8.35 --with-pcre-jit --with-http_spdy_module --add-module=../ngx_pagespeed-release-1.9.32.1-beta
    
    --------------------------------------------------------
    Check PHP-FPM Version:
    --------------------------------------------------------
    PHP 5.4.33 (cli) (built: Sep 20 2014 02:51:10)
    Copyright (c) 1997-2014 The PHP Group
    Zend Engine v2.4.0, Copyright (c) 1998-2014 Zend Technologies
    
    --------------------------------------------------------
    Check MariaDB installed RPM Versions:
    --------------------------------------------------------
    MariaDB-client-10.0.13-1.el6.x86_64
    MariaDB-shared-10.0.13-1.el6.x86_64
    MariaDB-compat-10.0.13-1.el6.x86_64
    MariaDB-devel-10.0.13-1.el6.x86_64
    MariaDB-common-10.0.13-1.el6.x86_64
    MariaDB-server-10.0.13-1.el6.x86_64
    
    --------------------------------------------------------
    Check Memcached Server Version:
    --------------------------------------------------------
    memcached 1.4.20
    
    --------------------------------------------------------
    Check CSF Firewall Version:
    --------------------------------------------------------
    csf: v7.15 (generic)
    
    --------------------------------------------------------
    Check Siege Benchmark Version:
    --------------------------------------------------------
    SIEGE 3.0.7
    
    Copyright (C) 2014 by Jeffrey Fulmer, et al.
    This is free software; see the source for copying conditions.
    There is NO warranty; not even for MERCHANTABILITY or FITNESS
    FOR A PARTICULAR PURPOSE.
    
    
    --------------------------------------------------------
    Check ngx_pagespeed Control Script:
    http://centminmod.com/nginx_ngx_pagespeed.html
    --------------------------------------------------------
    Detected 6.5
    pscontrol handler
    pscontrol edit
    pscontrol on
    pscontrol off
    pscontrol statson
    pscontrol statsoff
    
    --------------------------------------------------------
    Check mysqlreport version:
    --------------------------------------------------------
    mysqlreport v3.5-maria11 Jul 4 2013
    
    --------------------------------------------------------
    Check NSD Bind Version:
    --------------------------------------------------------
    NSD version 3.2.17
    Written by NLnet Labs.
    
    Copyright (C) 2001-2011 NLnet Labs.  This is free software.
    There is NO warranty; not even for MERCHANTABILITY or FITNESS
    FOR A PARTICULAR PURPOSE.
    
    --------------------------------------------------------
    Check YUM Repo List
    --------------------------------------------------------
    Loaded plugins: downloadonly, fastestmirror, priorities
    Loading mirror speeds from cached hostfile
    * base: mirror.us.leaseweb.net
    * epel: less.cogeco.net
    * extras: mirror.us.leaseweb.net
    * rpmforge: repoforge.mirror.constant.com
    * updates: mirror.us.leaseweb.net
    1570 packages excluded due to repository priority protections
    repo id        repo name                                             status
    base           CentOS-6 - Base                                       4,859+1,508
    epel           Extra Packages for Enterprise Linux 6 - x86_64        8,484+2,625
    extras         CentOS-6 - Extras                                              15
    mariadb        MariaDB                                                      12+1
    rpmforge       RHEL 6 - RPMforge.net - dag                           3,198+1,520
    updates        CentOS-6 - Updates                                      1,095+412
    repolist: 17,663
    The new Centmin Mod .08 beta01 default Nginx installed index.html page :D

    centminmod_installed_default.png

    The Centmin Mod .08 beta01 menu where all the magic happens :D

    Code:
    --------------------------------------------------------
    Centmin Mod 1.2.3-eva2000.08 - http://centminmod.com
    --------------------------------------------------------
                       Centmin Mod Menu               
    --------------------------------------------------------
    1).  Centmin Install
    2).  Add Nginx vhost domain
    3).  NSD setup domain name DNS
    4).  Nginx Upgrade / Downgrade
    5).  PHP Upgrade / Downgrade
    6).  XCache Re-install
    7).  APC Cache Re-install
    8).  XCache Install
    9).  APC Cache Install
    10). Memcached Server Re-install
    11). MariaDB 5.2, 5.5, 10 Upgrade Sub-Menu
    12). Zend OpCache Install/Re-install
    13). Install ioping.sh vbtechsupport.com/1239/
    14). SELinux disable
    15). Install/Re-install ImageMagick PHP Extension
    16). Change SSHD Port Number
    17). Multi-thread compression: pigz,pbzip2,lbzip2,p7zip etc
    18). Suhosin PHP Extension install
    19). Install FFMPEG and FFMPEG PHP Extension
    20). NSD Re-install
    21). Update - Nginx + PHP-FPM + Siege
    22). Exit
    --------------------------------------------------------
    Enter option [ 1 - 22 ]
    --------------------------------------------------------
     
    Last edited: Sep 20, 2014
  3. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    Post-Centmin Mod install fastdrive benchmarks



    I setup a raid 0 partition mounted as /fastdrive across 3x 120GB Intel 320 SSD and did some individual benchmarks first.

    Code:
    cat /proc/mdstat
    Personalities : [raid1] [raid0]
    md1 : active raid1 sdc1[2] sdb1[1] sda1[0]
          81918912 blocks [3/3] [UUU]
      
    md2 : active raid0 sdc2[2] sda2[0] sdb2[1]
          12578304 blocks 512k chunks
    First the individual disks tested.

    Code:
    hdparm -t /dev/sda
    
    /dev/sda:
    Timing buffered disk reads: 648 MB in  3.00 seconds = 215.88 MB/sec
    
    Code:
    hdparm -t /dev/sdb
    
    /dev/sdb:
    Timing buffered disk reads: 654 MB in  3.00 seconds = 217.91 MB/sec
    
    Code:
    hdparm -t /dev/sdc
    
    /dev/sdc:
    Timing buffered disk reads: 640 MB in  3.01 seconds = 212.86 MB/sec
    
    Raid 1 performance
    Code:
    cd /
    dd bs=1M count=512 if=/dev/zero of=test conv=fdatasync
    512+0 records in
    512+0 records out
    536870912 bytes (537 MB) copied, 4.03928 s, 133 MB/s
    
    Raid 0 performance
    Code:
    cd /fastdrive/
    dd bs=1M count=512 if=/dev/zero of=test conv=fdatasync
    512+0 records in
    512+0 records out
    536870912 bytes (537 MB) copied, 1.53197 s, 350 MB/s
    disk dd tests on raid 0 md2

    Code:
    dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 3.04886 s, 352 MB/s
    
    Code:
    dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 3.06296 s, 351 MB/s
    
    Code:
    dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 5.27678 s, 203 MB/s
    
    Code:
    dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 16.2967 s, 65.9 MB/s
    
    Ioping tests on raid 0 md2 didn't show any signs of improvement compared to raid 1 md1 ??

    Code:
    IOPing I/O: ./ioping -c 10 .
    4096 bytes from . (ext4 /dev/md2): request=1 time=2.8 ms
    4096 bytes from . (ext4 /dev/md2): request=2 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=3 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=4 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=5 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=6 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=7 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=8 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=9 time=0.2 ms
    4096 bytes from . (ext4 /dev/md2): request=10 time=0.2 ms
    
    --- . (ext4 /dev/md2) ioping statistics ---
    10 requests completed in 9005.9 ms, 2064 iops, 8.1 mb/s
    min/avg/max/mdev = 0.2/0.5/2.8/0.8 ms
    
    IOPing seek rate: ./ioping -RD .
    
    --- . (ext4 /dev/md2) ioping statistics ---
    11492 requests completed in 3000.0 ms, 5322 iops, 20.8 mb/s
    min/avg/max/mdev = 0.2/0.2/1.2/0.0 ms
    
    IOPing sequential: ./ioping -RL .
    
    --- . (ext4 /dev/md2) ioping statistics ---
    2451 requests completed in 3000.5 ms, 883 iops, 220.8 mb/s
    min/avg/max/mdev = 1.0/1.1/2.9/0.2 ms
    
    IOPing cached: ./ioping -RC .
    
    --- . (ext4 /dev/md2) ioping statistics ---
    54397 requests completed in 3000.0 ms, 725574 iops, 2834.3 mb/s
    min/avg/max/mdev = 0.0/0.0/0.0/0.0 ms
    But disk fio showed that raid 0 md2 improved write speeds compared to raid 1 md1. With raid 1 random reads at 392.5MB/s and random writes at 60.8MB/s versus raid 0 random reads at 424.5MB/s and random writes at 3x times faster with 181.3MB/s due to raid 0 with 3x 120GB Intel 320 SSD. Disk random write IOPs was improved too with raid 0 at 46,408 IOPs vs raid 1 at 15,576 IOPs.

    disk fio performance

    md1 raid 1
    • random read : io=1024.3MB, bw=402004KB/s, iops=100500 , runt= 2609msec
    • random write: io=1024.3MB, bw=62308KB/s, iops=15576 , runt= 16833msec
    md2 raid 0
    • random read : io=1024.3MB, bw=434657KB/s, iops=108664 , runt= 2413msec
    • random write: io=1024.3MB, bw=185633KB/s, iops=46408 , runt= 5650msec

    Code:
    ./fio reads.ini
    randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    randomreads: Laying out IO file(s) (1 file(s) / 1024MB)
    Jobs: 1 (f=1): [r] [-.-% done] [425.4M/0K /s] [109K/0  iops] [eta 00m:00s]
    randomreads: (groupid=0, jobs=1): err= 0: pid=25756: Sat Sep 20 03:35:24 2014
      read : io=1024.3MB, bw=434657KB/s, iops=108664 , runt=  2413msec
      cpu          : usr=10.28%, sys=65.75%, ctx=28041, majf=0, minf=89
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
       READ: io=1024.3MB, aggrb=434657KB/s, minb=434657KB/s, maxb=434657KB/s, mint=2413msec, maxt=2413msec
    
    Disk stats (read/write):
        md2: ios=245291/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=87402/1, aggrmerge=0/0, aggrticks=48733/0, aggrin_queue=48721, aggrutil=95.68%
      sdb: ios=87437/1, merge=0/0, ticks=48824/0, in_queue=48811, util=95.68%
      sdc: ios=87269/1, merge=0/0, ticks=48664/0, in_queue=48650, util=95.64%
      sda: ios=87501/1, merge=0/0, ticks=48712/0, in_queue=48703, util=95.68%
    
    ./fio writes.ini
    randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    Jobs: 1 (f=1): [w] [100.0% done] [0K/190.6M /s] [0 /48.8K iops] [eta 00m:00s]
    randomwrites: (groupid=0, jobs=1): err= 0: pid=25761: Sat Sep 20 03:35:53 2014
      write: io=1024.3MB, bw=185633KB/s, iops=46408 , runt=  5650msec
      cpu          : usr=8.25%, sys=39.87%, ctx=55776, majf=0, minf=25
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
      WRITE: io=1024.3MB, aggrb=185633KB/s, minb=185633KB/s, maxb=185633KB/s, mint=5650msec, maxt=5650msec
    
    Disk stats (read/write):
        md2: ios=0/250252, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/87409, aggrmerge=0/0, aggrticks=0/117542, aggrin_queue=117527, aggrutil=95.45%
      sdb: ios=0/87442, merge=0/1, ticks=0/119454, in_queue=119439, util=95.45%
      sdc: ios=0/87275, merge=0/0, ticks=0/111816, in_queue=111800, util=94.86%
      sda: ios=0/87510, merge=0/0, ticks=0/121357, in_queue=121343, util=94.58%
    
     
    Last edited: Sep 20, 2014
  4. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    Post-Centmin Mod install centminmodbench.sh



    Will re-run centminmodbench.sh with Centmin Mod .08 beta01 LEMP web stack installed to compare with virgin setup.

    Looks like I need to work on tuning Centmin Mod's tweaked TCP settings in /etc/sysctl.conf as they lowered local or closer geographical region bandwidth speed for single threaded wget but improved bandwidth speed for locations on the other side of the world. The gains for other side of the world percentage wise are much higher than percentage lost on same local region bandwidth speed though for some cities. Either way I need to tune and test more :)

    Note the cachefly results, according to mtr tests, trace route took a different route compared to the default TCP tests

    default TCP mtr for cachefly
    Code:
    -------------------------------------------
    Running mtr tests...
    -------------------------------------------
    
    ----------------------------------------------
    mtr --report --report-cycles=10 cachefly.cachefly.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4  10.0   0.3  65.7  22.1
      2. bhs-g1-6k.qc.ca               0.0%    10    0.6   0.9   0.6   1.9   0.4
      3. mtl-2-6k.qc.ca               10.0%    10    1.6  29.9   1.6 170.7  57.4
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. bx5-chicagodt.bell.ca         0.0%    10   17.7  26.5  17.7  80.9  20.6
      6. newcore1-chicagocp_xe-4-0-0_  0.0%    10   28.2  38.3  26.2  72.1  15.7
      7. tcore4-toronto63_POS00-6-0-0  0.0%    10   33.6  31.6  28.6  34.4   2.0
      8. Ncore3-montreal02_POS0-15-0-  0.0%    10   32.2  30.1  27.3  33.0   1.8
      9. agg2-montreal02_xe5-0-0.net.  0.0%    10   26.2  30.3  25.9  51.0   7.5
    10. dis53-montreal02_5-0-0.net.b  0.0%    10   30.3  29.9  25.9  43.4   5.0
    11. 204.101.4.238                 0.0%    10   20.6  20.0  18.4  23.3   1.5
    12. v3950.AK4C.800SQ.as10929.net  0.0%    10   22.0  21.8  19.3  24.0   1.4
    13. 184.170.128.58                0.0%    10   18.4  19.3  18.4  20.6   1.0
    whereas mtr tests for Centmin Mod TCP tuned took a different route with much higher ping times at 93-94ms versus stock TCP 18-20ms pings

    Code:
    mtr --report --report-cycles=10 cachefly.cachefly.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10  128.6 119.0   0.5 370.0 127.6
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   0.9   0.7   1.1   0.1
      3. 198.27.73.206                90.0%    10    8.8   8.8   8.8   8.8   0.0
      4. 198.27.73.29                 80.0%    10   81.3  81.3  81.3  81.3   0.0
      5. vip1.G-anycast1.cachefly.net  0.0%    10   93.7  93.8  93.7  94.1   0.1
    side by side view of mtr for cachefly

    mtr_diff_cachefly.png

    similar case with Linode Dallas and Softlayer Seattle huge differences in ping times which could account for differences in bandwidth speed at the time of the test run

    mtr_diff_linode_dallas.png

    mtr_diff_softlayer_seattle.png

    router issues on hop 2 within BHS1 OVH for speed tests for Vultr Amsterdam and Vultr London ?

    mtr_diff_vultr_amsterdam_london.png

    Vultr New Jersey on tuned TCP tests, mtr shows hop 3 with ICMP rate limiting ??? and hop 4 with worst ping time of 213ms maybe rated to drop in bandwidth speed ??

    mtr_diff_vultr_newjersey.png

    left (CentOS 6.5 64bit default TCP settings of of box) vs right (Centmin Mod tuned TCP settings)

    before_after.png

    Code:
    -------------------------------------------
    centminmodbench.sh 0.3
    http://bench.centminmod.com
    written by: George Liu (eva2000)
    http://centminmod.com
    -------------------------------------------
    
    -------------------------------------------
    System Information
    -------------------------------------------
    
    2.6.32-431.29.2.el6.x86_64
    
    CentOS release 6.5 (Final)
    
    Centmin Mod
    ----------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                8
    On-line CPU(s) list:   0-7
    Thread(s) per core:    2
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 58
    Stepping:              9
    CPU MHz:               3392.335
    BogoMIPS:              6784.67
    Virtualization:        VT-x
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              256K
    L3 cache:              8192K
    NUMA node0 CPU(s):     0-7
    
    ----------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2:L3 ONLINE
    0   0    0      0    0:0:0:0       yes
    1   0    0      1    1:1:1:0       yes
    2   0    0      2    2:2:2:0       yes
    3   0    0      3    3:3:3:0       yes
    4   0    0      0    0:0:0:0       yes
    5   0    0      1    1:1:1:0       yes
    6   0    0      2    2:2:2:0       yes
    7   0    0      3    3:3:3:0       yes
    
    ----------------------------------------------
                 total       used       free     shared    buffers     cached
    Mem:         32138       4228      27910          0        722       2900
    Low:         32138       4228      27910
    High:            0          0          0
    -/+ buffers/cache:        605      31532
    Swap:         6140          0       6140
    
    ----------------------------------------------
    Filesystem      Size  Used Avail Use% Mounted on
    rootfs           77G  5.5G   68G   8% /
    devtmpfs         16G  212K   16G   1% /dev
    tmpfs            16G     0   16G   0% /dev/shm
    /dev/md1         77G  5.5G   68G   8% /
    /dev/md2         12G  1.2G   11G  11% /fastdrive
    tmpfs            16G  4.0K   16G   1% /tmp
    
    
    Code:
    -------------------------------------------
    disk ioping tests
    -------------------------------------------
    
    
    Running IOPing I/O benchmark...
    
    IOPing I/O: ./ioping -c 10 .
    4096 bytes from . (ext4 /dev/md1): request=1 time=2.1 ms
    4096 bytes from . (ext4 /dev/md1): request=2 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=3 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=4 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=5 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=6 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=7 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=8 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=9 time=0.2 ms
    4096 bytes from . (ext4 /dev/md1): request=10 time=0.2 ms
    
    --- . (ext4 /dev/md1) ioping statistics ---
    10 requests completed in 9005.2 ms, 2396 iops, 9.4 mb/s
    min/avg/max/mdev = 0.2/0.4/2.1/0.6 ms
    
    IOPing seek rate: ./ioping -RD .
    
    --- . (ext4 /dev/md1) ioping statistics ---
    11480 requests completed in 3000.1 ms, 5309 iops, 20.7 mb/s
    min/avg/max/mdev = 0.2/0.2/2.3/0.0 ms
    
    IOPing sequential: ./ioping -RL .
    
    --- . (ext4 /dev/md1) ioping statistics ---
    2525 requests completed in 3000.9 ms, 915 iops, 228.8 mb/s
    min/avg/max/mdev = 1.0/1.1/2.6/0.1 ms
    
    IOPing cached: ./ioping -RC .
    
    --- . (ext4 /dev/md1) ioping statistics ---
    54353 requests completed in 3000.0 ms, 709792 iops, 2772.6 mb/s
    min/avg/max/mdev = 0.0/0.0/0.0/0.0 ms
    
    
    Code:
    -------------------------------------------
    disk DD tests
    -------------------------------------------
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k conv=fdatasync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 8.23952 s, 130 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k conv=fdatasync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 8.35521 s, 129 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=1M count=1k oflag=dsync
    1024+0 records in
    1024+0 records out
    1073741824 bytes (1.1 GB) copied, 10.8339 s, 99.1 MB/s
    
    dd if=/dev/zero of=sb-io-test bs=64k count=16k oflag=dsync
    16384+0 records in
    16384+0 records out
    1073741824 bytes (1.1 GB) copied, 22.7713 s, 47.2 MB/s
    
    Code:
    -------------------------------------------
    disk FIO tests
    -------------------------------------------
    
    
    Running FIO benchmark...
    
    
    FIO random reads:
    randomreads: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    randomreads: Laying out IO file(s) (1 file(s) / 1024MB)
    
    randomreads: (groupid=0, jobs=1): err= 0: pid=27569: Sat Sep 20 04:06:33 2014
      read : io=1024.3MB, bw=403706KB/s, iops=100926 , runt=  2598msec
      cpu          : usr=12.71%, sys=86.91%, ctx=420, majf=0, minf=89
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=262207/w=0/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
       READ: io=1024.3MB, aggrb=403705KB/s, minb=403705KB/s, maxb=403705KB/s, mint=2598msec, maxt=2598msec
    
    Disk stats (read/write):
        md1: ios=248288/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=87402/1, aggrmerge=0/0, aggrticks=36425/0, aggrin_queue=36409, aggrutil=95.76%
      sda: ios=88026/1, merge=0/0, ticks=37288/0, in_queue=37273, util=95.76%
      sdc: ios=86653/1, merge=0/0, ticks=35626/0, in_queue=35610, util=95.76%
      sdb: ios=87528/1, merge=0/0, ticks=36363/0, in_queue=36345, util=95.76%
    
    FIO random writes:
    randomwrites: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=64
    fio-2.0.9
    Starting 1 process
    
    randomwrites: (groupid=0, jobs=1): err= 0: pid=27573: Sat Sep 20 04:06:51 2014
      write: io=1024.3MB, bw=60791KB/s, iops=15197 , runt= 17253msec
      cpu          : usr=4.54%, sys=23.45%, ctx=73792, majf=0, minf=25
      IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
         submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
         complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
         issued    : total=r=0/w=262207/d=0, short=r=0/w=0/d=0
    
    Run status group 0 (all jobs):
      WRITE: io=1024.3MB, aggrb=60791KB/s, minb=60791KB/s, maxb=60791KB/s, mint=17253msec, maxt=17253msec
    
    Disk stats (read/write):
        md1: ios=0/260720, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/262221, aggrmerge=0/37, aggrticks=0/793466, aggrin_queue=793416, aggrutil=96.20%
      sda: ios=0/262220, merge=0/39, ticks=0/772547, in_queue=772478, util=95.93%
      sdc: ios=0/262211, merge=0/48, ticks=0/814261, in_queue=814221, util=96.06%
      sdb: ios=0/262234, merge=0/25, ticks=0/793592, in_queue=793549, util=96.20%
    
    
    Code:
    
    -------------------------------------------
    Running bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Download Cachefly: 5.93MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Download Linode, Atlanta, GA, USA: 8.83MB/s
    ----------------------------------------------
    Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Download Linode, Dallas, TX, USA: 6.19MB/s
    ----------------------------------------------
    Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Download Leaseweb, Manassas, VA, USA: 6.20MB/s
    ----------------------------------------------
    Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Seattle, WA, USA: 10.1MB/s
    ----------------------------------------------
    Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, San Jose, CA, USA: 7.48MB/s
    ----------------------------------------------
    Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Washington, DC, USA: 27.6MB/s
    ----------------------------------------------
    Download from VersaWeb, Las Vegas, Nevada (http://199.47.210.50/100mbtest.bin)
    Download VersaWeb, Las Vegas, Nevada: 7.55MB/s
    ----------------------------------------------
    Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Download OVH, BHS, Canada: 86.1MB/s
    ----------------------------------------------
    Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Los Angeles, California: 10.2MB/s
    ----------------------------------------------
    Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Seattle, Washington: 3.94MB/s
    ----------------------------------------------
    Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Dallas, Texas: 3.91MB/s
    ----------------------------------------------
    Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Chicago, Illinois: 27.1MB/s
    ----------------------------------------------
    Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Atlanta, Georgia: 10.8MB/s
    ----------------------------------------------
    Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Miami, Florida: 14.9MB/s
    ----------------------------------------------
    Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, New York / New Jersey: 13.8MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Download Linode, Tokyo, JP: 2.24MB/s
    ----------------------------------------------
    Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Download Softlayer, Singapore: 4.14MB/s
    ----------------------------------------------
    Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Tokyo, Japan: 1.91MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Download Linode, London, UK: 3.11MB/s
    ----------------------------------------------
    Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Download OVH, Paris, France: 2.44MB/s
    ----------------------------------------------
    Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Download SmartDC, Rotterdam, Netherlands: 1.21MB/s
    ----------------------------------------------
    Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Amsterdam, Netherlands: 2.95MB/s
    ----------------------------------------------
    Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, London, UK: 3.12MB/s
    ----------------------------------------------
    Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Paris, France: 2.87MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Download Vultr, Sydney, Australia: 5.95MB/s
    
    Code:
    
    -------------------------------------------
    Running Axel multi-threaded bandwidth benchmark...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Cachefly (http://cachefly.cachefly.net/100mb.test)
    Axel Download Cachefly: 14.74MB/s
    
    -------------------------------------------
    USA bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Atlanta, GA, USA (http://speedtest.atlanta.linode.com/100MB-atlanta.bin)
    Axel Download Linode, Atlanta, GA, USA: 10.11MB/s
    ----------------------------------------------
    Axel Download from Linode, Dallas, TX, USA (http://speedtest.dallas.linode.com/100MB-dallas.bin)
    Axel Download Linode, Dallas, TX, USA: 13.30MB/s
    ----------------------------------------------
    Axel Download from Leaseweb, Manassas, VA, USA (http://mirror.us.leaseweb.net/speedtest/100mb.bin)
    Axel Download Leaseweb, Manassas, VA, USA: 18.44MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Seattle, WA, USA (http://speedtest.sea01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Seattle, WA, USA: 9.91MB/s
    ----------------------------------------------
    Axel Download from Softlayer, San Jose, CA, USA (http://speedtest.sjc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, San Jose, CA, USA: 10.52MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Washington, DC, USA (http://speedtest.wdc01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Washington, DC, USA: 36.50MB/s
    ----------------------------------------------
    Axel Download from VersaWeb, Las Vegas, Nevada (http://199.47.210.50/100mbtest.bin)
    Axel Download VersaWeb, Las Vegas, Nevada: 12.03MB/s
    ----------------------------------------------
    Axel Download from OVH, BHS, Canada (http://bhs.proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, BHS, Canada: 95.07MB/s
    ----------------------------------------------
    Axel Download from Vultr, Los Angeles, California (http://lax-ca-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Los Angeles, California: 9.63MB/s
    ----------------------------------------------
    Axel Download from Vultr, Seattle, Washington (http://wa-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Seattle, Washington: 7.77MB/s
    ----------------------------------------------
    Axel Download from Vultr, Dallas, Texas (http://tx-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Dallas, Texas: 6.51MB/s
    ----------------------------------------------
    Axel Download from Vultr, Chicago, Illinois (http://il-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Chicago, Illinois: 20.23MB/s
    ----------------------------------------------
    Axel Download from Vultr, Atlanta, Georgia (http://ga-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Atlanta, Georgia: 7.82MB/s
    ----------------------------------------------
    Axel Download from Vultr, Miami, Florida (http://fl-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Miami, Florida: 8.12MB/s
    ----------------------------------------------
    Axel Download from Vultr, New York / New Jersey (http://nj-us-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, New York / New Jersey: 31.31MB/s
    
    -------------------------------------------
    Asia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, Tokyo, JP (http://speedtest.tokyo.linode.com/100MB-tokyo.bin)
    Axel Download Linode, Tokyo, JP: 3.08MB/s
    ----------------------------------------------
    Axel Download from Softlayer, Singapore (http://speedtest.sng01.softlayer.com/downloads/test100.zip)
    Axel Download Softlayer, Singapore: 9.14MB/s
    ----------------------------------------------
    Axel Download from Vultr, Tokyo, Japan (http://hnd-jp-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Tokyo, Japan: 2.17MB/s
    
    -------------------------------------------
    Europe bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Linode, London, UK (http://speedtest.london.linode.com/100MB-london.bin)
    Axel Download Linode, London, UK: 5.60MB/s
    ----------------------------------------------
    Axel Download from OVH, Paris, France (http://proof.ovh.net/files/100Mio.dat)
    Axel Download OVH, Paris, France: 7.01MB/s
    ----------------------------------------------
    Axel Download from SmartDC, Rotterdam, Netherlands (http://mirror.i3d.net/100mb.bin)
    Axel Download SmartDC, Rotterdam, Netherlands: 4.76MB/s
    ----------------------------------------------
    Axel Download from Vultr, Amsterdam, Netherlands (http://ams-nl-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Amsterdam, Netherlands: 5.05MB/s
    ----------------------------------------------
    Axel Download from Vultr, London, UK (http://lon-gb-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, London, UK: 4.57MB/s
    ----------------------------------------------
    Axel Download from Vultr, Paris, France (http://par-fr-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Paris, France: 4.03MB/s
    
    -------------------------------------------
    Australia bandwidth tests...
    -------------------------------------------
    
    ----------------------------------------------
    Axel Download from Vultr, Sydney, Australia (http://syd-au-ping.vultr.com/vultr.com.100MB.bin)
    Axel Download Vultr, Sydney, Australia: 5.80MB/s
    
    Code:
    
    -------------------------------------------
    Running ping tests...
    -------------------------------------------
    
    ----------------------------------------------
    Pings (cachefly.cachefly.net):
    PING vip1.g.cachefly.net (205.234.175.175) 56(84) bytes of data.
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=1 ttl=54 time=94.0 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=2 ttl=54 time=94.0 ms
    64 bytes from vip1.G-anycast1.cachefly.net (205.234.175.175): icmp_seq=3 ttl=54 time=93.7 ms
    
    --- vip1.g.cachefly.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2095ms
    rtt min/avg/max/mdev = 93.715/93.912/94.015/0.139 ms
    
    ----------------------------------------------
    Pings (syd-au-ping.vultr.com):
    PING syd-au-ping.vultr.com (108.61.212.117) 56(84) bytes of data.
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=1 ttl=51 time=248 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=2 ttl=51 time=248 ms
    64 bytes from 108.61.212.117.vultr.com (108.61.212.117): icmp_seq=3 ttl=51 time=248 ms
    
    --- syd-au-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2251ms
    rtt min/avg/max/mdev = 248.889/248.915/248.941/0.407 ms
    
    ----------------------------------------------
    Pings (hnd-jp-ping.vultr.com):
    PING hnd-jp-ping.vultr.com (108.61.201.151) 56(84) bytes of data.
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=1 ttl=48 time=277 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=2 ttl=48 time=277 ms
    64 bytes from 108.61.201.151.vultr.com (108.61.201.151): icmp_seq=3 ttl=48 time=277 ms
    
    --- hnd-jp-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2277ms
    rtt min/avg/max/mdev = 277.003/277.039/277.060/0.430 ms
    
    ----------------------------------------------
    Pings (lax-ca-us-ping.vultr.com):
    PING lax-ca-us-ping.vultr.com (108.61.219.200) 56(84) bytes of data.
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=1 ttl=53 time=78.9 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=2 ttl=53 time=78.8 ms
    64 bytes from 108.61.219.200.vultr.com (108.61.219.200): icmp_seq=3 ttl=53 time=78.9 ms
    
    --- lax-ca-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2082ms
    rtt min/avg/max/mdev = 78.874/78.930/78.967/0.232 ms
    
    ----------------------------------------------
    Pings (wa-us-ping.vultr.com):
    PING wa-us-ping.vultr.com (108.61.194.105) 56(84) bytes of data.
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=1 ttl=50 time=78.4 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=2 ttl=50 time=78.4 ms
    64 bytes from 108.61.194.105.vultr.com (108.61.194.105): icmp_seq=3 ttl=50 time=78.4 ms
    
    --- wa-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2081ms
    rtt min/avg/max/mdev = 78.418/78.446/78.469/0.021 ms
    
    ----------------------------------------------
    Pings (tx-us-ping.vultr.com):
    PING tx-us-ping.vultr.com (108.61.224.175) 56(84) bytes of data.
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=1 ttl=51 time=123 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=2 ttl=51 time=123 ms
    64 bytes from 108.61.224.175.vultr.com (108.61.224.175): icmp_seq=3 ttl=51 time=123 ms
    
    --- tx-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2126ms
    rtt min/avg/max/mdev = 123.278/123.284/123.293/0.286 ms
    
    ----------------------------------------------
    Pings (il-us-ping.vultr.com):
    PING il-us-ping.vultr.com (107.191.51.12) 56(84) bytes of data.
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=1 ttl=54 time=18.5 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=2 ttl=54 time=18.4 ms
    64 bytes from 107.191.51.12.vultr.com (107.191.51.12): icmp_seq=3 ttl=54 time=18.5 ms
    
    --- il-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2021ms
    rtt min/avg/max/mdev = 18.482/18.503/18.514/0.112 ms
    
    ----------------------------------------------
    Pings (ga-us-ping.vultr.com):
    PING ga-us-ping.vultr.com (108.61.193.166) 56(84) bytes of data.
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=1 ttl=53 time=29.6 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=2 ttl=53 time=29.6 ms
    64 bytes from 108.61.193.166.vultr.com (108.61.193.166): icmp_seq=3 ttl=53 time=29.6 ms
    
    --- ga-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2033ms
    rtt min/avg/max/mdev = 29.615/29.637/29.662/0.019 ms
    
    ----------------------------------------------
    Pings (fl-us-ping.vultr.com):
    PING fl-us-ping.vultr.com (104.156.244.232) 56(84) bytes of data.
    64 bytes from 104.156.244.232: icmp_seq=1 ttl=53 time=42.5 ms
    64 bytes from 104.156.244.232: icmp_seq=2 ttl=53 time=42.5 ms
    64 bytes from 104.156.244.232: icmp_seq=3 ttl=53 time=42.5 ms
    
    --- fl-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2045ms
    rtt min/avg/max/mdev = 42.505/42.540/42.599/0.173 ms
    
    ----------------------------------------------
    Pings (nj-us-ping.vultr.com):
    PING nj-us-ping.vultr.com (108.61.149.182) 56(84) bytes of data.
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=1 ttl=58 time=10.0 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=2 ttl=58 time=10.0 ms
    64 bytes from 108.61.149.182.vultr.com (108.61.149.182): icmp_seq=3 ttl=58 time=10.0 ms
    
    --- nj-us-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2012ms
    rtt min/avg/max/mdev = 10.018/10.050/10.070/0.022 ms
    
    ----------------------------------------------
    Pings (fra-de-ping.vultr.com):
    PING fra-de-ping.vultr.com (108.61.210.117) 56(84) bytes of data.
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=1 ttl=54 time=93.1 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=2 ttl=54 time=93.1 ms
    64 bytes from 108.61.210.117.vultr.com (108.61.210.117): icmp_seq=3 ttl=54 time=93.1 ms
    
    --- fra-de-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2095ms
    rtt min/avg/max/mdev = 93.164/93.167/93.170/0.002 ms
    
    ----------------------------------------------
    Pings (ams-nl-ping.vultr.com):
    PING ams-nl-ping.vultr.com (108.61.198.102) 56(84) bytes of data.
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=1 ttl=49 time=95.2 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=2 ttl=49 time=95.2 ms
    64 bytes from 108.61.198.102.vultr.com (108.61.198.102): icmp_seq=3 ttl=49 time=95.3 ms
    
    --- ams-nl-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2097ms
    rtt min/avg/max/mdev = 95.246/95.279/95.308/0.357 ms
    
    ----------------------------------------------
    Pings (lon-gb-ping.vultr.com):
    PING lon-gb-ping.vultr.com (108.61.196.101) 56(84) bytes of data.
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=1 ttl=56 time=77.5 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=2 ttl=56 time=77.4 ms
    64 bytes from 108.61.196.101.vultr.com (108.61.196.101): icmp_seq=3 ttl=56 time=77.5 ms
    
    --- lon-gb-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2080ms
    rtt min/avg/max/mdev = 77.475/77.519/77.571/0.323 ms
    
    ----------------------------------------------
    Pings (par-fr-ping.vultr.com):
    PING par-fr-ping.vultr.com (108.61.209.127) 56(84) bytes of data.
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=1 ttl=52 time=88.3 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=2 ttl=52 time=88.2 ms
    64 bytes from 108.61.209.127.vultr.com (108.61.209.127): icmp_seq=3 ttl=52 time=88.3 ms
    
    --- par-fr-ping.vultr.com ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2090ms
    rtt min/avg/max/mdev = 88.293/88.310/88.325/0.343 ms
    
    ----------------------------------------------
    Pings (VersaWeb Las Vegas):
    PING 199.47.210.50 (199.47.210.50) 56(84) bytes of data.
    64 bytes from 199.47.210.50: icmp_seq=1 ttl=58 time=76.5 ms
    64 bytes from 199.47.210.50: icmp_seq=2 ttl=58 time=76.3 ms
    64 bytes from 199.47.210.50: icmp_seq=3 ttl=58 time=76.3 ms
    
    --- 199.47.210.50 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2079ms
    rtt min/avg/max/mdev = 76.313/76.407/76.568/0.114 ms
    
    ----------------------------------------------
    Pings (VersaWeb Seattle):
    PING 76.164.234.1 (76.164.234.1) 56(84) bytes of data.
    64 bytes from 76.164.234.1: icmp_seq=1 ttl=58 time=87.4 ms
    64 bytes from 76.164.234.1: icmp_seq=2 ttl=58 time=87.5 ms
    64 bytes from 76.164.234.1: icmp_seq=3 ttl=58 time=87.5 ms
    
    --- 76.164.234.1 ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2090ms
    rtt min/avg/max/mdev = 87.495/87.536/87.568/0.030 ms
    
    ----------------------------------------------
    Pings (OVH Canada):
    PING bhs.proof.ovh.net (192.99.19.165) 56(84) bytes of data.
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=1 ttl=62 time=0.268 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=2 ttl=62 time=0.300 ms
    64 bytes from ns238643.ip-192-99-19.net (192.99.19.165): icmp_seq=3 ttl=62 time=0.292 ms
    
    --- bhs.proof.ovh.net ping statistics ---
    3 packets transmitted, 3 received, 0% packet loss, time 2001ms
    rtt min/avg/max/mdev = 0.268/0.286/0.300/0.023 ms
    
    
    Code:
    
    -------------------------------------------
    Running mtr tests...
    -------------------------------------------
    
    ----------------------------------------------
    mtr --report --report-cycles=10 cachefly.cachefly.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10  128.6 119.0   0.5 370.0 127.6
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   0.9   0.7   1.1   0.1
      3. 198.27.73.206                90.0%    10    8.8   8.8   8.8   8.8   0.0
      4. 198.27.73.29                 80.0%    10   81.3  81.3  81.3  81.3   0.0
      5. vip1.G-anycast1.cachefly.net  0.0%    10   93.7  93.8  93.7  94.1   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.atlanta.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 50.0%    10    0.5  22.2   0.5 109.0  48.5
      2. 2607:5300::a5                 0.0%    10    0.9   0.9   0.7   1.0   0.1
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. nwk-1-6k.nj.us                0.0%    10    8.7   9.6   8.7  17.6   2.8
      5. vl-51.car2.Newark1.Level3.ne  0.0%    10    8.9   8.9   8.9   9.0   0.0
      6. vl-4063.edge2.Washington1.Le  0.0%    10   13.5  13.7  13.5  14.5   0.4
      7. vl-4040.car1.Atlanta2.Level3  0.0%    10   27.2  46.1  27.1 117.3  37.1
      8. vl-51.ear1.Atlanta2.Level3.n 10.0%    10  947.8 130.5  27.4 947.8 306.5
      9. GIGLINX-INC.edge4.Atlanta2.L  0.0%    10   27.6  27.6  27.5  27.6   0.0
    10. 2604:b900:1:1::2              0.0%    10   27.4  27.5  27.4  27.5   0.0
    11. speedtest.atlanta.linode.com  0.0%    10   27.3  27.2  27.2  27.3   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.dallas.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f  0.0%    10   15.7   5.6   0.5  34.7  11.2
      2. 2607:5300::a7                 0.0%    10    2.4   1.3   0.9   2.4   0.6
      3. 2607:5300::98                50.0%    10    1.8   4.1   1.8  12.9   4.9
      4. 2607:5300::dc                50.0%    10   17.8  17.8  17.8  17.8   0.0
      5. bbr01.eq01.chi01.networklaye  0.0%    10   25.4  25.4  25.4  25.4   0.0
      6. po3.bbr01.eq01.dal01.network  0.0%    10   37.6  37.7  37.6  37.8   0.1
      7. 2607.f0d0.0002.0002.0000.000  0.0%    10   38.0  38.0  37.9  38.1   0.0
      8. 2607.f0d0.0002.0004.0000.000  0.0%    10   38.0  38.2  37.9  38.6   0.2
      9. 2607.f0d0.0002.0004.0000.000  0.0%    10   37.8  43.4  37.7  68.8  12.0
    10. 2607.f0d0.0002.0004.0000.000  0.0%    10   38.2  38.3  38.1  38.9   0.2
    11. speedtest.dallas.linode.com   0.0%    10   37.9  38.0  37.9  38.2   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 mirror.us.leaseweb.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f  0.0%    10   13.2  21.0   0.4 114.7  40.9
      2. 2607:5300::a5                 0.0%    10    0.9   1.0   0.7   2.0   0.4
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. nwk-1-6k.nj.us                0.0%    10   15.0  13.5   8.7  23.4   5.6
      5. vl-52.car2.Newark1.Level3.ne  0.0%    10    9.1   9.0   8.9   9.2   0.1
      6. vl-4063.edge2.Washington1.Le  0.0%    10   13.6  13.5  13.5  13.6   0.0
      7. vl-4083.edge1.Washington1.Le  0.0%    10   22.5  18.6  13.6  53.9  12.7
      8. FIBERRING-B.edge1.Washington  0.0%    10   78.7  78.8  78.7  78.9   0.1
      9. 2604:9a00::48                 0.0%    10   81.2  80.8  78.1  87.9   3.8
    10. 2604:9a00:2010:a001:1:face:b  0.0%    10   78.2  78.2  78.2  78.3   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sea01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                20.0%    10  120.2  40.7   0.4 125.8  57.0
      2. bhs-g1-6k.qc.ca               0.0%    10    0.9   0.9   0.6   2.0   0.4
      3. mtl-2-6k.qc.ca               20.0%    10    1.6  10.7   1.6  74.3  25.7
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   17.7  17.8  17.7  18.0   0.1
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   18.0  18.4  17.9  22.9   1.5
      7. ae1.bbr02.wb01.sea02.network  0.0%    10   77.4  78.2  77.3  85.4   2.5
      8. ae1.dar01.sr01.sea01.network  0.0%    10   77.9  77.9  77.9  78.0   0.0
      9. po1.fcr01.sr01.sea01.network  0.0%    10   78.0  78.0  77.9  78.2   0.1
    10. speedtest.sea01.softlayer.co  0.0%    10   78.2  77.9  77.9  78.2   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sjc01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.5 473.2   0.4 2215. 805.8
      2. bhs-g2-6k.qc.ca               0.0%    10    2.1   1.3   0.8   2.3   0.6
      3. mtl-2-6k.qc.ca               20.0%    10    1.6   6.3   1.6  38.9  13.2
      4. 198.27.73.172                10.0%    10   17.8  22.6  17.8  60.7  14.3
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   17.8  17.8  17.7  17.8   0.0
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   18.0  18.1  18.0  19.0   0.3
      7. ae1.bbr02.cs01.den01.network  0.0%    10   47.2  47.3  47.2  47.9   0.2
      8. ae1.bbr01.eq01.sjc02.network  0.0%    10   67.6  68.1  67.6  73.1   1.7
      9. ae5.dar01.sr01.sjc01.network  0.0%    10   68.0  68.0  68.0  68.1   0.0
    10. po1.fcr01.sr01.sjc01.network  0.0%    10   68.1  69.0  68.1  75.1   2.2
    11. speedtest.sjc01.softlayer.co  0.0%    10   68.1  68.1  68.1  68.2   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.wdc01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10  368.2  65.8   0.4 368.2 137.5
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   0.9   0.7   1.1   0.1
      3. mtl-2-6k.qc.ca                0.0%    10    1.7   1.7   1.6   1.9   0.1
      4. 198.27.73.178                70.0%    10   17.7  17.8  17.7  17.8   0.0
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   17.8  18.2  17.8  19.0   0.4
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   18.0  18.0  18.0  18.4   0.1
      7. ae0.bbr02.eq01.wdc02.network  0.0%    10   25.4  25.4  25.4  25.5   0.0
      8. ae1.dar01.sr01.wdc01.network  0.0%    10   26.1  26.1  26.1  26.1   0.0
      9. po1.fcr01.sr01.wdc01.network  0.0%    10   26.6  29.8  26.6  43.2   6.6
    10. speedtest.wdc01.softlayer.co  0.0%    10   26.5  26.5  26.5  26.5   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.tokyo.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 20.0%    10    0.4   2.3   0.4  15.4   5.3
      2. 2607:5300::a5                 0.0%    10    0.9   1.1   0.7   2.5   0.6
      3. 2607:5300::f8                50.0%    10    8.8  21.7   8.8  73.1  28.8
      4. 2607:5300::d0                 0.0%    10   68.9  84.9  68.9 228.6  50.5
      5. 2607:5300::105                0.0%    10   68.9  68.9  68.8  69.4   0.2
      6. 6lajbb001.int-gw.kddi.ne.jp   0.0%    10   68.6  74.2  68.6 103.7  12.3
      7. 6otejbb205.int-gw.kddi.ne.jp  0.0%    10  167.5 167.5 167.5 167.5   0.0
      8. 6cm-fcu203.int-gw.kddi.ne.jp  0.0%    10  167.7 170.0 167.7 176.7   3.3
      9. 2001:268:f702:6c::2           0.0%    10  167.9 168.0 167.8 168.3   0.1
    10. speedtest.tokyo.linode.com   10.0%    10  167.4 167.4 167.4 167.5   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.sng01.softlayer.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4   5.4   0.3  44.5  14.7
      2. bhs-g1-6k.qc.ca               0.0%    10    0.8   0.8   0.7   0.9   0.1
      3. mtl-2-6k.qc.ca               50.0%    10    1.6  27.1   1.6  88.0  38.3
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. te1-7.bbr01.eq01.chi01.netwo  0.0%    10   17.8  17.8  17.7  17.8   0.0
      6. ae7.bbr02.eq01.chi01.network  0.0%    10   18.0  18.0  17.9  18.0   0.1
      7. ae1.bbr02.cs01.den01.network  0.0%    10   47.3  47.3  47.3  47.6   0.1
      8. ae1.bbr01.eq01.sjc02.network  0.0%    10   67.9  67.9  67.9  67.9   0.0
      9. ae7.bbr02.eq01.sjc02.network  0.0%    10   67.9  67.9  67.9  68.0   0.0
    10. ae0.bbr01.eq01.tok01.network  0.0%    10  176.3 176.3 176.2 176.7   0.1
    11. ae1.bbr01.eq01.sng02.network  0.0%    10  260.0 260.0 259.9 260.0   0.0
    12. ae5.dar01.sr03.sng01.network 10.0%    10  260.1 260.0 259.9 260.1   0.0
    13. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    14. speedtest.sng01.softlayer.co 10.0%    10  260.2 259.9 259.8 260.2   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 speedtest.london.linode.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 50.0%    10    0.5   0.5   0.4   0.5   0.0
      2. 2607:5300::a5                 0.0%    10    1.0   1.1   0.8   2.2   0.4
      3. 2607:5300::f8                70.0%    10   34.6  17.4   8.8  34.6  14.9
      4. nwk-1-6k.nj.us                0.0%    10    8.7   8.7   8.7   8.8   0.0
      5. vl-52.car1.Newark1.Level3.ne  0.0%    10   36.1  37.7   9.3 120.3  35.5
      6. 2001:1900:4:1::ce             0.0%    10    9.3  13.8   9.2  55.3  14.6
      7. vl-4080.car1.NewYork1.Level3  0.0%    10    9.3  16.7   9.2  64.7  17.9
      8. vl-4086.edge3.London1.Level3  0.0%    10  108.3  87.5  78.3 110.8  13.5
      9. REDBUS-INTE.edge3.London1.Le 50.0%    10   79.0  79.0  79.0  79.1   0.1
    10. 2001:4d78:fe01:2:2::c         0.0%    10   79.4  79.3  79.3  79.5   0.1
    11. speedtest.london.linode.com   0.0%    10   77.9  77.9  77.8  77.9   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 mirror.i3d.net
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f  0.0%    10   10.7  17.5   0.4 160.0  50.2
      2. 2607:5300::a7                 0.0%    10    1.0   1.3   0.9   2.5   0.5
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. 10ge.linx-jnpr.th-n.i3d.net   0.0%    10  100.2  98.7  77.5 107.1   9.9
      6. 20ge.cr1-lr0.smartdc.rtd.i3d  0.0%    10  111.8  91.0  82.8 117.3  12.7
      7. 80ge.br2-cr1.smartdc.rtd.i3d  0.0%    10   93.0  99.6  88.7 152.7  19.1
      8. 2a00:1630:1:13d::13d          0.0%    10   88.6  88.6  88.6  88.8   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 syd-au-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10    0.5   0.5   0.3   1.2   0.3
      2. bhs-g2-6k.qc.ca               0.0%    10    0.9   0.9   0.8   1.1   0.1
      3. mtl-2-6k.qc.ca                0.0%    10    1.6   1.7   1.6   2.4   0.2
      4. 198.27.73.180                40.0%    10   17.7  25.2  17.7  46.9  12.3
      5. 198.27.73.150                30.0%    10   66.7 123.8  65.4 251.1  76.9
      6. 198.27.73.248                 0.0%    10  264.0  87.2  66.1 264.0  62.3
      7. eqix.sv1.ppc1.com             0.0%    10  267.2 268.1 266.5 269.6   1.1
      8. 203-219-35-15.static.tpgi.co  0.0%    10  265.6 265.6 265.5 265.6   0.0
      9. 203-219-106-138.tpgi.com.au   0.0%    10  263.1 263.5 263.0 264.7   0.6
    10. lag41.sclarinte01.aapt.net.a 90.0%    10  275.9 275.9 275.9 275.9   0.0
    11. lag30.sglebinte01.aapt.net.a  0.0%    10  265.0 266.6 264.1 269.2   2.2
    12. 203-174-189-250.syd.static-i 10.0%    10  248.8 248.8 248.8 248.8   0.0
    13. 27.111.243.214               10.0%    10  249.4 249.3 249.3 249.4   0.0
    14. 108.61.212.117.vultr.com     10.0%    10  249.0 249.0 248.9 249.1   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 hnd-jp-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    1.0   4.8   0.3  32.8  10.7
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   0.8   0.7   2.0   0.4
      3. 198.27.73.204                90.0%    10    8.9   8.9   8.9   8.9   0.0
      4. nyk-1-6k.ny.us               30.0%    10    9.1   9.2   9.1   9.3   0.1
      5. eqix2-ny.pacnet.com           0.0%    10   86.2  86.2  86.1  86.4   0.1
      6. gi9-0-0.cr2.nrt1.asianetcom.  0.0%    10  188.5 188.5 188.5 188.6   0.0
      7. xe0-0-2.gw2.nrt4.asianetcom.  0.0%    10  188.6 188.7 188.6 190.0   0.4
      8. SRV-0001.asianetcom.net       0.0%    10  266.6 266.9 266.4 270.9   1.4
      9. 71.ae1.sw1.tko1.jp.scnet.net 10.0%    10  282.8 282.8 282.6 282.9   0.1
    10. unknown.servercentral.net    10.0%    10  271.3 269.2 268.2 271.8   1.5
    11. 108.61.201.151.vultr.com     10.0%    10  276.4 276.8 276.3 277.1   0.3
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lax-ca-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    0.4  29.5   0.3 188.3  59.7
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   0.9   0.7   0.9   0.1
      3. mtl-1-6k.qc.ca               60.0%    10    1.7   1.6   1.6   1.7   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ae-2-70.edge8.NewYork1.Level  0.0%    10   10.2  10.3  10.1  11.0   0.3
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%     7   10.2  10.2  10.2  10.2   0.0
    11. xe-10-2-1.lax20.ip4.gtt.net   0.0%     7   81.2  81.3  81.1  81.8   0.2
    12. gtt-gw-cr1.lax2.ip4.gtt.net   0.0%     7   78.2  78.1  78.1  78.2   0.0
    13. ae2-50g.ar1.lax2.us.as4436.g 28.6%     7   89.5  87.9  84.3  89.8   2.4
    14. as20473.xe-6-0-1.ar1.lax2.us  0.0%     7   78.6  78.7  78.6  78.8   0.1
    15. 108.61.219.200.vultr.com     14.3%     7   79.0  79.0  78.9  79.1   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 wa-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4  26.4   0.4 183.9  60.9
      2. bhs-g1-6k.qc.ca               0.0%    10    0.8   0.9   0.8   1.9   0.4
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ae-6-6.ebr2.Chicago2.Level3.  0.0%    10   79.0  78.9  78.7  79.3   0.1
    10. ???                           0.0%     0    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 tx-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    0.4 164.8   0.4 1085. 349.4
      2. bhs-g2-6k.qc.ca               0.0%    10    1.3   1.2   0.8   2.7   0.7
      3. mtl-1-6k.qc.ca               70.0%    10    1.6   1.7   1.6   2.0   0.2
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ae-3-80.edge8.NewYork1.Level  0.0%    10   10.1  10.1  10.1  10.2   0.0
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%     9   10.2  10.2  10.1  10.2   0.0
    11. xe-4-2-0.dal33.ip4.gtt.net    0.0%     9   54.0  56.2  53.9  74.7   6.9
    12. gtt-gw.ip4.gtt.net            0.0%     9  123.0 123.1 123.0 123.5   0.2
    13. as20473.xe-5-1-2.cr1.dfw1.us  0.0%     9  123.3 123.3 123.2 123.4   0.1
    14. 108.61.224.175.vultr.com     12.5%     8  123.3 123.2 123.2 123.3   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 il-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10   82.2  31.6   0.4 123.4  48.5
      2. bhs-g1-6k.qc.ca               0.0%    10    0.7   1.0   0.6   2.0   0.5
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. chi-1-6k.il.us                0.0%    10   17.8  31.9  17.7  78.7  21.7
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ae-0.gtt-offnet.chcgil09.us.  0.0%    10   19.6  18.0  17.8  19.6   0.6
      7. ae4.cr1.ord6.us.scnet.net     0.0%    10   18.5  18.7  18.4  21.0   0.8
      8. ae1.ar9.ord6.us.scnet.net     0.0%    10   18.5  19.2  18.4  21.7   1.3
      9. ethernet1-1-br1.chi2.choopa.  0.0%    10   26.2  22.6  18.5  28.8   4.5
    10. 107.191.51.12.vultr.com       0.0%    10   18.6  18.5  18.5  18.6   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ga-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    1.8   2.5   0.4  14.3   4.5
      2. bhs-g1-6k.qc.ca               0.0%    10    0.8   0.9   0.6   2.1   0.4
      3. 198.27.73.204                90.0%    10    8.7   8.7   8.7   8.7   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ae-72-72.csw2.NewYork1.Level  0.0%    10    9.1  10.5   9.1  19.8   3.4
      8. ae-2-70.edge8.NewYork1.Level  0.0%    10    9.2  10.4   9.2  15.1   2.1
      9. IntelQ-Tinet-level3-1ge.NewY  0.0%    10    9.2   9.2   9.2   9.3   0.0
    10. xe-11-3-0.atl11.ip4.gtt.net   0.0%    10   29.1  29.8  29.1  33.8   1.5
    11. ae4-150.cr1.atl1.ip4.gtt.net  0.0%    10   29.7  29.7  29.5  30.7   0.4
    12. ae1-40g.cr2.atl1.us.as4436.g  0.0%    10   29.7  34.8  29.6  75.1  14.2
    13. as20473.xe-1-3-1.cr2.atl1.us  0.0%    10   30.9  31.4  30.9  32.1   0.5
    14. 108.61.193.166.vultr.com      0.0%    10   29.9  29.9  29.5  30.8   0.4
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fl-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    0.4  14.5   0.3  79.5  29.8
      2. bhs-g2-6k.qc.ca               0.0%    10    1.0   1.1   0.8   2.2   0.4
      3. mtl-1-6k.qc.ca               60.0%    10    1.6   1.6   1.6   1.6   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level  0.0%    10   10.2  11.4  10.1  20.7   3.3
      9. ae-2-70.edge8.NewYork1.Level  0.0%    10   10.2  10.2  10.1  10.2   0.0
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%    10   10.2  10.2  10.1  10.2   0.0
    11. xe-0-1-2.mia12.ip4.gtt.net    0.0%    10   42.4  42.7  42.3  43.6   0.5
    12. gtt-gw-cr1.mia1.ip4.gtt.net   0.0%    10   59.0  44.7  42.6  59.0   5.0
    13. as20473.ae5-1914.cr1.mia1.us  0.0%    10   44.6  44.1  43.1  47.4   1.3
    14. 104.156.244.232               0.0%    10   42.6  43.1  42.6  43.9   0.6
    
    ----------------------------------------------
    mtr --report --report-cycles=10 nj-us-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    0.4   1.6   0.4   8.0   2.6
      2. bhs-g2-6k.qc.ca               0.0%    10    1.7   1.0   0.7   1.7   0.3
      3. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      4. nyk-5-6k.ny.us               10.0%    10    9.2  45.2   9.2 213.1  68.2
      5. nyiix.gi3-6.cr1.nyc1.choopa.  0.0%    10   11.8  15.0  10.1  20.3   3.4
      6. ethernet1-49-c11-8-c6-1.pnj1  0.0%    10   10.0  11.3  10.0  20.9   3.4
      7. 108.61.149.182.vultr.com      0.0%    10    9.9  10.0   9.9  10.1   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 fra-de-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                 0.0%    10    0.4 250.2   0.3 1402. 443.3
      2. bhs-g2-6k.qc.ca               0.0%    10    1.3   2.0   0.8   4.6   1.3
      3. mtl-1-6k.qc.ca               10.0%    10    1.6   1.7   1.6   1.8   0.1
      4. nwk-1-6k.nj.us               50.0%    10    9.6   9.6   9.6   9.7   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level  0.0%    10   10.0  10.1  10.0  10.3   0.1
      9. ae-2-70.edge8.NewYork1.Level  0.0%    10   10.0  10.1  10.0  10.2   0.1
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%    10   10.1  10.1  10.1  10.1   0.0
    11. xe-2-2-0.fra61.ip4.gtt.net    0.0%    10   91.2  91.2  91.2  91.3   0.0
    12. choopa-gw.ip4.gtt.net         0.0%    10   94.1  94.1  94.0  94.2   0.0
    13. 108.61.210.117.vultr.com     10.0%    10   91.4  91.3  91.2  91.4   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 ams-nl-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                20.0%    10    0.4   6.8   0.4  48.9  17.0
      2. bhs-g2-6k.qc.ca               0.0%    10    1.4   1.0   0.8   1.4   0.2
      3. mtl-1-6k.qc.ca               90.0%    10    1.7   1.7   1.7   1.7   0.0
      4. nwk-1-6k.nj.us               70.0%    10    9.7   9.6   9.6   9.7   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 lon-gb-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                30.0%    10    0.5   1.7   0.4   6.0   2.3
      2. bhs-g1-6k.qc.ca               0.0%    10    1.9   1.1   0.6   2.0   0.6
      3. 198.27.73.204                80.0%    10    8.8   8.7   8.7   8.8   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 par-fr-ping.vultr.com
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4   7.7   0.4  66.6  22.1
      2. bhs-g2-6k.qc.ca               0.0%    10    0.8   1.1   0.8   2.2   0.5
      3. mtl-1-6k.qc.ca               60.0%    10    1.6  64.4   1.6 167.6  79.6
      4. nwk-1-6k.nj.us               90.0%    10    9.7   9.7   9.7   9.7   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      9. ae-1-60.edge8.NewYork1.Level  0.0%    10   10.2  12.7  10.2  23.4   4.7
    10. IntelQ-Tinet-level3-1ge.NewY  0.0%     9   10.2  10.2  10.1  10.3   0.0
    11. xe-7-3-0.par90.ip4.gtt.net    0.0%     9   89.5  90.6  89.5  97.3   2.5
    12. choopa-gw.ip4.gtt.net         0.0%     9   89.1  88.8  88.6  89.5   0.3
    13. 108.61.209.127.vultr.com     11.1%     9   88.3  88.6  88.3  89.3   0.4
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Las Vegas
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                20.0%    10    0.4  20.2   0.4 154.9  54.4
      2. bhs-g1-6k.qc.ca               0.0%    10    0.9   0.9   0.7   2.2   0.4
      3. 198.27.73.204                80.0%    10  263.0 135.9   8.7 263.0 179.8
      4. 198.27.73.166                 0.0%    10   68.7  68.8  68.7  68.9   0.1
      5. 198.27.73.158                 0.0%    10   68.7  75.1  68.7 132.5  20.1
      6. any2ix.coresite.com           0.0%    10   82.2  80.0  76.1  85.0   4.1
      7. te3-4.core1.las1.fiberhub.ne  0.0%    10   76.1  76.2  76.1  76.6   0.1
      8. 199.47.210.50                 0.0%    10   76.4  76.4  76.3  76.6   0.1
    
    ----------------------------------------------
    mtr --report --report-cycles=10 VersaWeb Seattle
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 198.27.67.253                10.0%    10    0.4  31.7   0.3 210.2  71.0
      2. bhs-g2-6k.qc.ca               0.0%    10    0.9   1.0   0.7   2.3   0.5
      3. mtl-1-6k.qc.ca               50.0%    10    1.6   1.6   1.6   1.7   0.0
      4. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      5. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      6. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      7. ???                          100.0    10    0.0   0.0   0.0   0.0   0.0
      8. ae-72-72.csw2.NewYork1.Level  0.0%    10   11.3  10.2  10.1  11.3   0.4
      9. ae-2-70.edge2.NewYork1.Level  0.0%    10   10.2  10.2  10.2  10.6   0.1
    10. ae1.er4.lga5.us.above.net     0.0%    10   10.2  10.2  10.1  10.2   0.0
    11. ae3.cr2.lga5.us.above.net     0.0%    10   10.4  10.5  10.4  11.3   0.3
    12. ae1.cr1.lga5.us.above.net     0.0%    10   10.3  16.6  10.3  57.5  15.1
    13. ae6.cr1.ord2.us.above.net     0.0%    10   22.9  23.0  22.9  23.5   0.2
    14. ae16.mpr1.sea1.us.above.net   0.0%    10   73.5  75.2  73.4  88.2   4.7
    15. 208.185.185.146.IPYX-086691-  0.0%    10   87.2  90.8  87.1  95.9   3.5
    16. 76.164.234.1                 10.0%    10   87.7  87.6  87.6  87.7   0.0
    
    ----------------------------------------------
    mtr --report --report-cycles=10 OVH Canada
    HOST: hostname          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1. 2607:5300:60:1cff:ff:ff:ff:f 30.0%    10    0.8  61.3   0.5 228.9  87.6
      2. 2001:41d0::210c               0.0%    10    1.4   1.0   0.8   1.6   0.3
      3. 2607:5300:60:44a5::1          0.0%    10    0.3   0.3   0.3   0.4   0.0
    
    
    Code:
    -------------------------------------------
    OpenSSL System Benchmark
    -------------------------------------------
    
    OpenSSL 1.0.1e-fips 11 Feb 2013
    -------------------------------------------
    openssl speed rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc -multi 8
    ot: +H:16:64:256:1024:8192 from 6
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    md5             292778.22k   918415.17k  2228314.71k  3446773.76k  4012632.75k
    sha1            272897.94k   748789.85k  1571724.03k  2263533.57k  2675878.57k
    rc4            2487428.39k  3334552.48k  3860935.42k  4024176.98k  4074995.71k
    aes-128 cbc     527495.96k   573921.26k   609671.73k   613710.51k   612199.08k
    aes-256 cbc     383896.31k   411772.95k   433712.47k   433308.67k   433274.88k
    sha256          197435.66k   431772.97k   737767.00k   893062.49k   985178.00k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000300s 0.000009s   3332.0 116794.5
    rsa 4096 bits 0.001969s 0.000031s    507.9  32000.4
                                  sign    verify    sign/s verify/s
    256 bit ecdsa (nistp256)   0.0000s   0.0001s  44047.1  10498.9
    -------------------------------------------
    openssl speed -evp aes256 -multi 8
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp            2871925.34k  3536645.70k  3752368.21k  3810534.74k  3823140.86k
    -------------------------------------------
    openssl speed -evp aes128 -multi 8
    OpenSSL 1.0.1e-fips 11 Feb 2013
    built on: Wed Aug 13 19:13:02 UTC 2014
    options:bn(64,64) md2(int) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    compiler: gcc -fPIC -DOPENSSL_PIC -DZLIB -DOPENSSL_THREADS -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -DKRB5_MIT -m64 -DL_ENDIAN -DTERMIO -Wall -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wa,--noexecstack -DPURIFY -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM
    evp            3637128.49k  4786568.64k  5188603.05k  5300624.38k  5324865.54k
    
    -------------------------------------------
    Centmin Mod Nginx static OpenSSL Benchmark
    -------------------------------------------
    
    OpenSSL 1.0.1i 6 Aug 2014
    -------------------------------------------
    openssl speed rsa4096 rsa2048 ecdsap256 sha256 sha1 md5 rc4 aes-256-cbc aes-128-cbc -multi 8
    OpenSSL 1.0.1i 6 Aug 2014
    built on: Sat Sep 20 02:47:54 UTC 2014
    options:bn(64,64) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    md5             166201.78k   586003.33k  1660804.78k  3031444.48k  3945952.60k
    sha1            163717.96k   529617.34k  1288067.07k  2138262.87k  2633580.54k
    rc4            2433809.43k  3525088.09k  3873712.38k  4033402.54k  4082977.45k
    aes-128 cbc     543133.10k   593242.20k   611887.69k   614167.89k   614602.07k
    aes-256 cbc     396538.67k   417151.79k   433393.41k   434194.09k   435183.62k
    sha256          202482.57k   438163.41k   741165.57k   896281.26k   987149.65k
                      sign    verify    sign/s verify/s
    rsa 2048 bits 0.000300s 0.000008s   3330.2 119403.0
    rsa 4096 bits 0.001968s 0.000031s    508.1  31936.5
                                  sign    verify    sign/s verify/s
    256 bit ecdsa (nistp256)   0.0000s   0.0001s  42216.7  10532.1
    -------------------------------------------
    openssl speed -evp aes256 -multi 8
    OpenSSL 1.0.1i 6 Aug 2014
    built on: Sat Sep 20 02:47:54 UTC 2014
    options:bn(64,64) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    evp            3032919.33k  3596246.95k  3773547.29k  3814819.50k  3823580.50k
    -------------------------------------------
    openssl speed -evp aes128 -multi 8
    OpenSSL 1.0.1i 6 Aug 2014
    built on: Sat Sep 20 02:47:54 UTC 2014
    options:bn(64,64) rc4(16x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx)
    evp            3868245.66k  4886506.43k  5218001.66k  5308082.86k  5325286.06k
    
    Code:
    -------------------------------------------
    Running mysqlslap
    -------------------------------------------
    
    mysqlslap --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-secondary-indexes=5 --number-int-cols=5 --number-char-cols=5 --number-of-queries=25000 --auto-generate-sql-unique-query-number=40 --auto-generate-sql-unique-write-number=40 --auto-generate-sql-write-number=1000 --concurrency=64 --iterations=10 --engine=myisam
    Benchmark
            Running for engine myisam
            Average number of seconds to run all queries: 0.758 seconds
            Minimum number of seconds to run all queries: 0.744 seconds
            Maximum number of seconds to run all queries: 0.768 seconds
            Number of clients running queries: 64
            Average number of queries per client: 390
    
    Dropping the database is potentially a very bad thing to do.
    Any data stored in the database will be destroyed.
    
    Do you really want to drop the 'test' database [y/N] Database "test" dropped
    
    Code:
    -------------------------------------------
    System PHP Info
    -------------------------------------------
    
    CPU: 8 x Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz
                 total       used       free     shared    buffers     cached
    Mem:         32138       4394      27743          0        801       2904
    Low:         32138       4394      27743
    High:            0          0          0
    -/+ buffers/cache:        688      31450
    Swap:         6140          0       6140
    ----------------------------------------------
    PHP 5.4.33 (cli) (built: Sep 20 2014 02:51:10)
    Copyright (c) 1997-2014 The PHP Group
    Zend Engine v2.4.0, Copyright (c) 1998-2014 Zend Technologies
    ----------------------------------------------
    Configuration File (php.ini) Path: /usr/local/lib
    Loaded Configuration File:         /usr/local/lib/php.ini
    Scan for additional .ini files in: /etc/centminmod/php.d
    Additional .ini files parsed:      /etc/centminmod/php.d/apc.ini,
    /etc/centminmod/php.d/igbinary.ini,
    /etc/centminmod/php.d/imagick.ini,
    /etc/centminmod/php.d/memcache.ini,
    /etc/centminmod/php.d/memcached.ini
    
    ----------------------------------------------
    [PHP Modules]
    apc
    bcmath
    bz2
    calendar
    Core
    ctype
    curl
    date
    dom
    enchant
    ereg
    exif
    filter
    ftp
    gd
    gettext
    gmp
    hash
    iconv
    igbinary
    imagick
    imap
    intl
    json
    libxml
    mbstring
    mcrypt
    memcache
    memcached
    mhash
    mysql
    mysqli
    mysqlnd
    openssl
    pcntl
    pcre
    PDO
    pdo_mysql
    pdo_sqlite
    Phar
    posix
    pspell
    readline
    Reflection
    session
    shmop
    SimpleXML
    soap
    sockets
    SPL
    sqlite3
    standard
    sysvmsg
    sysvsem
    sysvshm
    tidy
    tokenizer
    xml
    xmlreader
    xmlrpc
    xmlwriter
    zip
    zlib
    
    [Zend Modules]
    
    ----------------------------------------------
    -------------------------------------------
    Run PHP test Zend/bench.php
    -------------------------------------------
    
    simple             0.099
    simplecall         0.109
    simpleucall        0.146
    simpleudcall       0.148
    mandel             0.230
    mandel2            0.268
    ackermann(7)       0.115
    ary(50000)         0.016
    ary2(50000)        0.015
    ary3(2000)         0.133
    fibo(30)           0.305
    hash1(50000)       0.027
    hash2(500)         0.033
    heapsort(20000)    0.068
    matrix(20)         0.072
    nestedloop(12)     0.164
    sieve(30)          0.075
    strcat(200000)     0.010
    ------------------------
    Total              2.034
    real: 2.05s user: 2.03s sys: 0.01s cpu: 99% maxmem: 124320 KB cswaits: 7
    
    simple             0.099
    simplecall         0.111
    simpleucall        0.146
    simpleudcall       0.147
    mandel             0.230
    mandel2            0.276
    ackermann(7)       0.114
    ary(50000)         0.016
    ary2(50000)        0.015
    ary3(2000)         0.133
    fibo(30)           0.308
    hash1(50000)       0.027
    hash2(500)         0.034
    heapsort(20000)    0.069
    matrix(20)         0.080
    nestedloop(12)     0.164
    sieve(30)          0.075
    strcat(200000)     0.010
    ------------------------
    Total              2.054
    real: 2.07s user: 2.05s sys: 0.01s cpu: 99% maxmem: 124320 KB cswaits: 1
    
    simple             0.099
    simplecall         0.109
    simpleucall        0.146
    simpleudcall       0.147
    mandel             0.230
    mandel2            0.268
    ackermann(7)       0.114
    ary(50000)         0.016
    ary2(50000)        0.015
    ary3(2000)         0.133
    fibo(30)           0.306
    hash1(50000)       0.028
    hash2(500)         0.033
    heapsort(20000)    0.067
    matrix(20)         0.072
    nestedloop(12)     0.164
    sieve(30)          0.075
    strcat(200000)     0.010
    ------------------------
    Total              2.032
    real: 2.05s user: 2.03s sys: 0.01s cpu: 99% maxmem: 124320 KB cswaits: 1
    
    bench.php results from 3 runs
    2.034
    2.054
    2.032
    
    bench.php avg: 2.0400
    Avg: real: 2.06s user: 2.04s sys: 0.01s cpu: 99.00% maxmem: 124320.00KB cswaits: 3.00
    created results log at /home/phpbench_logs/bench_200914-040455.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_200914-040455.log
    
    -------------------------------------------
    Run PHP test Zend/micro_bench.php
    -------------------------------------------
    
    empty_loop         0.099
    func()             0.280    0.182
    undef_func()       0.309    0.210
    int_func()         0.257    0.159
    $x = self::$x      0.213    0.114
    self::$x = 0       0.207    0.108
    isset(self::$x)    0.184    0.085
    empty(self::$x)    0.199    0.100
    $x = Foo::$x       0.193    0.094
    Foo::$x = 0        0.189    0.090
    isset(Foo::$x)     0.232    0.134
    empty(Foo::$x)     0.177    0.078
    self::f()          0.318    0.220
    Foo::f()           0.273    0.175
    $x = $this->x      0.194    0.095
    $this->x = 0       0.261    0.162
    $this->x += 2      0.193    0.095
    ++$this->x         0.174    0.075
    --$this->x         0.166    0.067
    $this->x++         0.198    0.099
    $this->x--         0.188    0.090
    isset($this->x)    0.178    0.079
    empty($this->x)    0.189    0.090
    $this->f()         0.313    0.214
    $x = Foo::TEST     0.179    0.080
    new Foo()          0.609    0.510
    $x = TEST          0.139    0.040
    $x = $_GET         0.299    0.201
    $x = $GLOBALS['v'] 0.483    0.384
    $x = $hash['v']    0.342    0.244
    $x = $str[0]       0.280    0.181
    $x = $a ?: null    0.189    0.090
    $x = $f ?: tmp     0.261    0.162
    $x = $f ? $f : $a  0.209    0.111
    $x = $f ? $f : tmp 0.265    0.166
    ------------------------
    Total              8.438
    real: 8.45s user: 8.44s sys: 0.00s cpu: 100% maxmem: 76176 KB cswaits: 1
    
    empty_loop         0.099
    func()             0.280    0.182
    undef_func()       0.303    0.204
    int_func()         0.257    0.158
    $x = self::$x      0.212    0.114
    self::$x = 0       0.201    0.103
    isset(self::$x)    0.186    0.088
    empty(self::$x)    0.199    0.101
    $x = Foo::$x       0.192    0.093
    Foo::$x = 0        0.179    0.080
    isset(Foo::$x)     0.239    0.140
    empty(Foo::$x)     0.177    0.078
    self::f()          0.310    0.212
    Foo::f()           0.273    0.175
    $x = $this->x      0.195    0.096
    $this->x = 0       0.252    0.153
    $this->x += 2      0.199    0.101
    ++$this->x         0.177    0.079
    --$this->x         0.164    0.066
    $this->x++         0.198    0.099
    $this->x--         0.189    0.090
    isset($this->x)    0.178    0.080
    empty($this->x)    0.203    0.105
    $this->f()         0.310    0.212
    $x = Foo::TEST     0.178    0.080
    new Foo()          0.610    0.512
    $x = TEST          0.139    0.041
    $x = $_GET         0.300    0.201
    $x = $GLOBALS['v'] 0.482    0.383
    $x = $hash['v']    0.330    0.231
    $x = $str[0]       0.281    0.183
    $x = $a ?: null    0.186    0.087
    $x = $f ?: tmp     0.256    0.157
    $x = $f ? $f : $a  0.206    0.107
    $x = $f ? $f : tmp 0.260    0.161
    ------------------------
    Total              8.400
    real: 8.41s user: 8.41s sys: 0.00s cpu: 100% maxmem: 76176 KB cswaits: 1
    
    empty_loop         0.098
    func()             0.281    0.182
    undef_func()       0.303    0.204
    int_func()         0.257    0.158
    $x = self::$x      0.214    0.116
    self::$x = 0       0.203    0.105
    isset(self::$x)    0.183    0.085
    empty(self::$x)    0.199    0.100
    $x = Foo::$x       0.193    0.095
    Foo::$x = 0        0.180    0.081
    isset(Foo::$x)     0.234    0.135
    empty(Foo::$x)     0.177    0.079
    self::f()          0.311    0.213
    Foo::f()           0.273    0.174
    $x = $this->x      0.196    0.097
    $this->x = 0       0.251    0.153
    $this->x += 2      0.192    0.094
    ++$this->x         0.173    0.075
    --$this->x         0.165    0.067
    $this->x++         0.198    0.100
    $this->x--         0.189    0.090
    isset($this->x)    0.178    0.079
    empty($this->x)    0.188    0.090
    $this->f()         0.310    0.211
    $x = Foo::TEST     0.178    0.080
    new Foo()          0.608    0.509
    $x = TEST          0.139    0.041
    $x = $_GET         0.300    0.201
    $x = $GLOBALS['v'] 0.493    0.395
    $x = $hash['v']    0.328    0.229
    $x = $str[0]       0.279    0.180
    $x = $a ?: null    0.185    0.087
    $x = $f ?: tmp     0.254    0.156
    $x = $f ? $f : $a  0.216    0.118
    $x = $f ? $f : tmp 0.259    0.160
    ------------------------
    Total              8.385
    real: 8.40s user: 8.40s sys: 0.00s cpu: 100% maxmem: 76192 KB cswaits: 1
    
    micro_bench.php results from 3 runs
    8.438
    8.400
    8.385
    
    micro_bench.php avg: 8.4077
    Avg: real: 8.42s user: 8.42s sys: 0.00s cpu: 100.00% maxmem: 76181.33KB cswaits: 1.00
    created results log at /home/phpbench_logs/bench_micro_200914-040455.log
    server PHP info log at /home/phpbench_logs/bench_phpinfo_200914-040455.log
    
    
    Code:
    -------------------------------------------
    centminmodbench.sh completed
    -------------------------------------------
    
    centminmodbench.sh Total Run Time: 1830.672431308 seconds
    
     
    Last edited: Sep 20, 2014
  5. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    UnixBench 5.1.3 - centminmodbench.sh Run



    Ran centminmodbench.sh UnixBench 5.13 only tests by editing script and disabling all tests except RUN_UNIXBENCH='y'

    Code:
    SEVERBEAR='n'
    OPENSSLBENCH='n'
    OPENSSL_NONSYSTEM='n'
    RUN_DISKDD='n'
    RUN_DISKIOPING='n'
    RUN_DISKFIO='n'
    RUN_AXELBENCH='n'
    RUN_BANDWIDTHBENCH='n'
    RUN_VULTRTESTS='y'
    EUROPE_BANDWIDTHTESTS='y'
    ASIA_BANDWIDTHTESTS='y'
    AUSTRALIA_BANDWIDTHTESTS='y'
    USA_BANDWIDTHTESTS='y'
    RUN_PINGTESTS='n'
    RUN_MYSQLSLAP='n'
    RUN_PHPTESTS='n'
    RUN_UNIXBENCH='y'
    RUN_MTRTESTS='n'
    MTR_PACKETS='10'
    UNIXBENCH_VER='5.1.3'
    
    UnixBench 5.1.3 result
    • single index = 1,691.6
    • multi-core index = 7,387.9
    Code:
    -------------------------------------------
    centminmodbench.sh 0.3
    http://bench.centminmod.com
    written by: George Liu (eva2000)
    http://centminmod.com
    -------------------------------------------
    
    -------------------------------------------
    System Information
    -------------------------------------------
    
    2.6.32-431.29.2.el6.x86_64
    
    CentOS release 6.5 (Final)
    
    Centmin Mod
    ----------------------------------------------
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                8
    On-line CPU(s) list:   0-7
    Thread(s) per core:    2
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 58
    Stepping:              9
    CPU MHz:               3392.335
    BogoMIPS:              6784.67
    Virtualization:        VT-x
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              256K
    L3 cache:              8192K
    NUMA node0 CPU(s):     0-7
    
    ----------------------------------------------
    CPU NODE SOCKET CORE L1d:L1i:L2:L3 ONLINE
    0   0    0      0    0:0:0:0       yes
    1   0    0      1    1:1:1:0       yes
    2   0    0      2    2:2:2:0       yes
    3   0    0      3    3:3:3:0       yes
    4   0    0      0    0:0:0:0       yes
    5   0    0      1    1:1:1:0       yes
    6   0    0      2    2:2:2:0       yes
    7   0    0      3    3:3:3:0       yes
    
    ----------------------------------------------
                 total       used       free     shared    buffers     cached
    Mem:         32138       4439      27699          0        802       2906
    Low:         32138       4439      27699
    High:            0          0          0
    -/+ buffers/cache:        730      31407
    Swap:         6140          0       6140
    
    ----------------------------------------------
    Filesystem      Size  Used Avail Use% Mounted on
    rootfs           77G  5.5G   68G   8% /
    devtmpfs         16G  212K   16G   1% /dev
    tmpfs            16G     0   16G   0% /dev/shm
    /dev/md1         77G  5.5G   68G   8% /
    /dev/md2         12G  1.2G   11G  11% /fastdrive
    tmpfs            16G  4.0K   16G   1% /tmp
    
    
    Code:
    -------------------------------------------
    Running UnixBench
    -------------------------------------------
    
    ========================================================================
       BYTE UNIX Benchmarks (Version 5.1.3)
    
       System: hostname: GNU/Linux
       OS: GNU/Linux -- 2.6.32-431.29.2.el6.x86_64 -- #1 SMP Tue Sep 9 21:36:05 UTC 2014
       Machine: x86_64 (x86_64)
       Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
       CPU 0: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       CPU 1: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       CPU 2: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       CPU 3: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       CPU 4: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       CPU 5: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       CPU 6: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       CPU 7: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz (6784.7 bogomips)
              Hyper-Threading, x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET, Intel virtualization
       05:12:37 up  5:45,  1 user,  load average: 0.00, 0.00, 0.18; runlevel 3
    
    Code:
    ------------------------------------------------------------------------
    Benchmark Run: Sat Sep 20 2014 05:12:37 - 05:36:38
    8 CPUs in system; running 1 parallel copy of tests
    
    Dhrystone 2 using register variables       38587748.8 lps   (10.0 s, 7 samples)
    Double-Precision Whetstone                     4126.9 MWIPS (9.9 s, 7 samples)
    Execl Throughput                               5256.7 lps   (30.0 s, 2 samples)
    Pipe Throughput                             2022266.7 lps   (10.0 s, 7 samples)
    Pipe-based Context Switching                 275997.3 lps   (10.0 s, 7 samples)
    Process Creation                              19083.8 lps   (30.0 s, 2 samples)
    Shell Scripts (1 concurrent)                   8551.5 lpm   (60.0 s, 2 samples)
    Shell Scripts (16 concurrent)                  2044.0 lpm   (60.0 s, 2 samples)
    Shell Scripts (8 concurrent)                   3640.9 lpm   (60.0 s, 2 samples)
    System Call Overhead                        2697263.6 lps   (10.0 s, 7 samples)
    
    System Benchmarks Partial Index              BASELINE       RESULT    INDEX
    Dhrystone 2 using register variables         116700.0   38587748.8   3306.6
    Double-Precision Whetstone                       55.0       4126.9    750.3
    Execl Throughput                                 43.0       5256.7   1222.5
    Pipe Throughput                               12440.0    2022266.7   1625.6
    Pipe-based Context Switching                   4000.0     275997.3    690.0
    Process Creation                                126.0      19083.8   1514.6
    Shell Scripts (1 concurrent)                     42.4       8551.5   2016.9
    Shell Scripts (16 concurrent)                     ---       2044.0      ---
    Shell Scripts (8 concurrent)                      6.0       3640.9   6068.1
    System Call Overhead                          15000.0    2697263.6   1798.2
                                                                       ========
    System Benchmarks Index Score (Partial Only)                         1691.6
    
    ------------------------------------------------------------------------
    Benchmark Run: Sat Sep 20 2014 05:36:38 - 06:00:42
    8 CPUs in system; running 8 parallel copies of tests
    
    Dhrystone 2 using register variables      172490035.3 lps   (10.0 s, 7 samples)
    Double-Precision Whetstone                    28167.5 MWIPS (10.0 s, 7 samples)
    Execl Throughput                              31565.9 lps   (29.9 s, 2 samples)
    Pipe Throughput                             9296358.3 lps   (10.0 s, 7 samples)
    Pipe-based Context Switching                2019184.4 lps   (10.0 s, 7 samples)
    Process Creation                              91929.7 lps   (30.0 s, 2 samples)
    Shell Scripts (1 concurrent)                  33749.0 lpm   (60.0 s, 2 samples)
    Shell Scripts (16 concurrent)                  2289.0 lpm   (60.1 s, 2 samples)
    Shell Scripts (8 concurrent)                   4563.9 lpm   (60.0 s, 2 samples)
    System Call Overhead                       10621734.7 lps   (10.0 s, 7 samples)
    
    System Benchmarks Partial Index              BASELINE       RESULT    INDEX
    Dhrystone 2 using register variables         116700.0  172490035.3  14780.6
    Double-Precision Whetstone                       55.0      28167.5   5121.4
    Execl Throughput                                 43.0      31565.9   7340.9
    Pipe Throughput                               12440.0    9296358.3   7473.0
    Pipe-based Context Switching                   4000.0    2019184.4   5048.0
    Process Creation                                126.0      91929.7   7296.0
    Shell Scripts (1 concurrent)                     42.4      33749.0   7959.7
    Shell Scripts (16 concurrent)                     ---       2289.0      ---
    Shell Scripts (8 concurrent)                      6.0       4563.9   7606.5
    System Call Overhead                          15000.0   10621734.7   7081.2
                                                                       ========
    System Benchmarks Index Score (Partial Only)                         7387.9
    
     
    Last edited: Sep 20, 2014
  6. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    Intel Xeon E3-1245v2 Ivy Bridge



    Let's check out the clock speeds for Intel Xeon E3-1245v2 Ivy Bridge.
    • First at near idle state base clocks = range between 1750Mhz to 2230Mhz with base speed of 3392Mhz.
    • Turbo Boost speed is around 36x multi for 4 core utilisation, 37x for 3 core ultisation, 38x for 2 and 1 core utilisation which is max speed of ~3.8Ghz
    • CPU core temps ~33-35C idle
    Code:
    True Frequency (without accounting Turbo) 3392 MHz                                                                                                            
      CPU Multiplier 34x || Bus clock frequency (BCLK) 99.76 MHz                                                                                                  
                                                                                                                                                                  
    Socket [0] - [physical cores=4, logical cores=8, max online cores ever=4]                                                                                     
      TURBO ENABLED on 4 Cores, Hyper Threading ON                                                                                                                
      Max Frequency without considering Turbo 3491.76 MHz (99.76 x [35])                                                                                          
      Max TURBO Multiplier (if Enabled) with 1/2/3/4 Cores is  38x/38x/37x/36x                                                                                    
      Real Current Frequency 2030.23 MHz [99.76 x 20.35] (Max of below)                                                                                           
            Core [core-id]  :Actual Freq (Mult.)      C0%   Halt(C1)%  C3 %   C6 %   C7 %  Temp                                                                   
            Core 1 [0]:       2030.23 (20.35x)         1    0.223      0    99.7       0    35                                                                    
            Core 2 [1]:       1756.41 (17.61x)         1    23.4       0    76.5       0    35                                                                    
            Core 3 [2]:       1791.01 (17.95x)         1    32.7       0    67.3       0    35                                                                    
            Core 4 [3]:       1747.36 (17.51x)         1    32.1       0    67.9       0    35                                                                    
    
    C0 = Processor running without halting                                                                                                                        
    C1 = Processor running with halts (States >C0 are power saver)                                                                                                
    C3 = Cores running with PLL turned off and core cache turned off                                                                                              
    C6 = Everything in C3 + core state saved to last level cache                                                                                                  
      Above values in table are in percentage over the last 1 sec 
     
  7. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    120GB Intel 320 SSD Disk Stats



    Using smartctl command.
    • power on hours = 13,043 - 13,182 that's like 543.5 - 549.25 days or upto 1.5 yrs - so definitely not a new drive heh
    • power cycle count 16 times for sda and sdb but 110 times for sdc
    • Media_Wearout_Indicator looks good if I am reading it right at 100% life still
    • Host Writes between 1.86GB - 2.34GB and Host Reads between 4.94GB - 6.97GB so far lightly used SSDs :D
    Code:
    smartctl -data -A /dev/sda
    smartctl 5.43 2012-06-30 r3573 [x86_64-linux-2.6.32-431.29.2.el6.x86_64] (local build)
    Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net
    
    === START OF READ SMART DATA SECTION ===
    SMART Attributes Data Structure revision number: 5
    Vendor Specific SMART Attributes with Thresholds:
    ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
      3 Spin_Up_Time            0x0020   100   100   000    Old_age   Offline      -       0
      4 Start_Stop_Count        0x0030   100   100   000    Old_age   Offline      -       0
      5 Reallocated_Sector_Ct   0x0032   100   100   000    Old_age   Always       -       0
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       13043
    12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       16
    170 Reserve_Block_Count     0x0033   100   100   010    Pre-fail  Always       -       0
    171 Program_Fail_Count      0x0032   100   100   000    Old_age   Always       -       0
    172 Erase_Fail_Count        0x0032   100   100   000    Old_age   Always       -       0
    183 Runtime_Bad_Block       0x0030   100   100   000    Old_age   Offline      -       6
    184 End-to-End_Error        0x0032   100   100   090    Old_age   Always       -       0
    187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
    192 Unsafe_Shutdown_Count   0x0032   100   100   000    Old_age   Always       -       16
    199 UDMA_CRC_Error_Count    0x0030   100   100   000    Old_age   Offline      -       1
    225 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       62009
    226 Workld_Media_Wear_Indic 0x0032   100   100   000    Old_age   Always       -       525
    227 Workld_Host_Reads_Perc  0x0032   100   100   000    Old_age   Always       -       72
    228 Workload_Minutes        0x0032   100   100   000    Old_age   Always       -       782581
    232 Available_Reservd_Space 0x0033   100   100   010    Pre-fail  Always       -       0
    233 Media_Wearout_Indicator 0x0032   100   100   000    Old_age   Always       -       0
    241 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       62009
    242 Host_Reads_32MiB        0x0032   100   100   000    Old_age   Always       -       163376
    
    
    
    Code:
    smartctl -data -A /dev/sdb
    smartctl 5.43 2012-06-30 r3573 [x86_64-linux-2.6.32-431.29.2.el6.x86_64] (local build)
    Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net
    
    === START OF READ SMART DATA SECTION ===
    SMART Attributes Data Structure revision number: 5
    Vendor Specific SMART Attributes with Thresholds:
    ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
      3 Spin_Up_Time            0x0020   100   100   000    Old_age   Offline      -       0
      4 Start_Stop_Count        0x0030   100   100   000    Old_age   Offline      -       0
      5 Reallocated_Sector_Ct   0x0032   100   100   000    Old_age   Always       -       0
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       13043
    12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       16
    170 Reserve_Block_Count     0x0033   100   100   010    Pre-fail  Always       -       0
    171 Program_Fail_Count      0x0032   100   100   000    Old_age   Always       -       0
    172 Erase_Fail_Count        0x0032   100   100   000    Old_age   Always       -       0
    183 Runtime_Bad_Block       0x0030   100   100   000    Old_age   Offline      -       6
    184 End-to-End_Error        0x0032   100   100   090    Old_age   Always       -       0
    187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
    192 Unsafe_Shutdown_Count   0x0032   100   100   000    Old_age   Always       -       15
    199 UDMA_CRC_Error_Count    0x0030   100   100   000    Old_age   Offline      -       0
    225 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       74272
    226 Workld_Media_Wear_Indic 0x0032   100   100   000    Old_age   Always       -       591
    227 Workld_Host_Reads_Perc  0x0032   100   100   000    Old_age   Always       -       67
    228 Workload_Minutes        0x0032   100   100   000    Old_age   Always       -       782581
    232 Available_Reservd_Space 0x0033   100   100   010    Pre-fail  Always       -       0
    233 Media_Wearout_Indicator 0x0032   100   100   000    Old_age   Always       -       0
    241 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       74272
    242 Host_Reads_32MiB        0x0032   100   100   000    Old_age   Always       -       157087
    
    
    
    Code:
    smartctl -data -A /dev/sdc
    smartctl 5.43 2012-06-30 r3573 [x86_64-linux-2.6.32-431.29.2.el6.x86_64] (local build)
    Copyright (C) 2002-12 by Bruce Allen, http://smartmontools.sourceforge.net
    
    === START OF READ SMART DATA SECTION ===
    SMART Attributes Data Structure revision number: 5
    Vendor Specific SMART Attributes with Thresholds:
    ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
      3 Spin_Up_Time            0x0020   100   100   000    Old_age   Offline      -       0
      4 Start_Stop_Count        0x0030   100   100   000    Old_age   Offline      -       0
      5 Reallocated_Sector_Ct   0x0032   100   100   000    Old_age   Always       -       0
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       13182
    12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       110
    170 Reserve_Block_Count     0x0033   100   100   010    Pre-fail  Always       -       0
    171 Program_Fail_Count      0x0032   100   100   000    Old_age   Always       -       0
    172 Erase_Fail_Count        0x0032   100   100   000    Old_age   Always       -       0
    183 Runtime_Bad_Block       0x0030   100   100   000    Old_age   Offline      -       14
    184 End-to-End_Error        0x0032   100   100   090    Old_age   Always       -       0
    187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
    192 Unsafe_Shutdown_Count   0x0032   100   100   000    Old_age   Always       -       109
    199 UDMA_CRC_Error_Count    0x0030   100   100   000    Old_age   Offline      -       2
    225 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       59159
    226 Workld_Media_Wear_Indic 0x0032   100   100   000    Old_age   Always       -       651
    227 Workld_Host_Reads_Perc  0x0032   100   100   000    Old_age   Always       -       78
    228 Workload_Minutes        0x0032   100   100   000    Old_age   Always       -       790922
    232 Available_Reservd_Space 0x0033   100   100   010    Pre-fail  Always       -       0
    233 Media_Wearout_Indicator 0x0032   100   100   000    Old_age   Always       -       0
    241 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       59159
    242 Host_Reads_32MiB        0x0032   100   100   000    Old_age   Always       -       221477
    
     
    Last edited: Sep 20, 2014
  8. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    Additional Notes



    TBA
     
  9. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    Node Query Stats



    nodequery_00.png

    Constellix Monitoring



    constellix_00.png
     
    Last edited: Sep 20, 2014
  10. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+

    SoYouStart Spam Blacklist Checks



    whatismyipaddresscom_check1.png
    sucurinet_blackliststatus.png
     
  11. Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    4:46 PM
    1.5.15
    MariaDB 10.2
    Just checked the wear indicator on mine

    Code:
    [root@host sbin]# smartctl -a /dev/sda | grep Media_Wearout_Indicator
    233 Media_Wearout_Indicator 0x0032   095   095   000    Old_age   Always       -       0
    [root@host sbin]# smartctl -a /dev/sdb | grep Media_Wearout_Indicator
    233 Media_Wearout_Indicator 0x0032   100   100   000    Old_age   Always       -       0
    [root@host sbin]# smartctl -a /dev/sdc | grep Media_Wearout_Indicator
    233 Media_Wearout_Indicator 0x0032   091   091   000    Old_age   Always       -       0
    [root@host sbin]# 
    But on my original SYS server
    Code:
    root@ns27404:/usr/sbin# smartctl -a /dev/sda | grep Media_Wearout_Indicator
    233 Media_Wearout_Indicator 0x0032   100   100   000    Old_age   Always       -       0
    root@ns27404:/usr/sbin# smartctl -a /dev/sdb | grep Media_Wearout_Indicator
    233 Media_Wearout_Indicator 0x0032   100   100   000    Old_age   Always       -       0
    root@ns27404:/usr/sbin# 

    New
    Code:
    [root@host sbin]# smartctl -a /dev/sda | grep Power_On_Hours
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       14110
    [root@host sbin]# smartctl -a /dev/sdb | grep Power_On_Hours
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       11305
    [root@host sbin]# smartctl -a /dev/sdc | grep Power_On_Hours
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       16978
    Original (209 days - how long I've had the server)
    Code:
    root@ns27404:/usr/sbin# smartctl -a /dev/sdb | grep Power_On_Hours
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       5021
    root@ns27404:/usr/sbin# smartctl -a /dev/sda | grep Power_On_Hours
      9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       5021
    root@ns27404:/usr/sbin# 
    So my original SYS server was brand new looking at the specs, and the "newer" one is old / recycled parts.
     
  12. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Yeah looks that way. Expected though considering the Intel 320 SSD series was released 3.5 yrs ago :)
     
  13. rdan

    rdan Well-Known Member

    5,439
    1,398
    113
    May 25, 2014
    Ratings:
    +2,187
    Local Time:
    11:46 PM
    Mainline
    10.2
    I don't know what improvement my network did this week.
    But from my location to SYS server which is in Canada.
    I got only got 250ms now
    Very good improvement
    And before I got 17 hops to reach SYS server now only 11 :)
    Very good Improvement (y)(y)(y)
     
  14. rdan

    rdan Well-Known Member

    5,439
    1,398
    113
    May 25, 2014
    Ratings:
    +2,187
    Local Time:
    11:46 PM
    Mainline
    10.2
    Not bad :)
    I LOVE SYS :)
    upload_2014-10-27_21-43-35.png
     
  15. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    looks like nice improvement for your route - got some improvement from OVH to Australia too

    my SoYouStart server
    before = 344ms
    now = 276ms

    my community.centminmod Linode Freemont, CA
    before = 170-180ms
    now = 165ms

    so could be general improvements across the pond ?
     
  16. rdan

    rdan Well-Known Member

    5,439
    1,398
    113
    May 25, 2014
    Ratings:
    +2,187
    Local Time:
    11:46 PM
    Mainline
    10.2
    Maybe hehe

    And also you got a lot of improvement to SYS server :)
    With the price and the hardware plus ddos protection, very much satisfied.
     
  17. eva2000

    eva2000 Administrator Staff Member

    53,251
    12,117
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,655
    Local Time:
    1:46 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    yup 260-276ms is quite ok for East coast USA :)
     
  18. Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    4:46 PM
    1.5.15
    MariaDB 10.2
    I'm getting 92ms pings to your server from the UK
     
  19. rdan

    rdan Well-Known Member

    5,439
    1,398
    113
    May 25, 2014
    Ratings:
    +2,187
    Local Time:
    11:46 PM
    Mainline
    10.2
    Seems SYS network improvement as it affect you Matt and Eva also :)
     
  20. Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    4:46 PM
    1.5.15
    MariaDB 10.2
    and I get 19ms to my SYS servers in France.