Join the community today
Become a Member

Docker Memcached CentOS 6.6 + Memcached 1.4.22 Docker Image

Discussion in 'Centmin Mod Docker Development' started by eva2000, Feb 21, 2015.

  1. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    My first succesful Docker image build that seems to work in communicating with the host system :)
    Grab the docker image from my repository

    Code:
    docker pull centminmod/docker-centos66-memcached
    Run docker container specifying a name e.g. memc1 mapping local:docker ports to 11211

    Code:
    docker run --name memc1 -d -p 11211:11211 -t centminmod/docker-centos66-memcached
    If you run Centmin Mod's Memcached server on host system, you'd need to stop that Memcached server instance or bind local port to something other than 11211 e.g. 33211:11211.

    Code:
    docker run --name memc1 -d -p 33211:11211 -t centminmod/docker-centos66-memcached
    Checking to see the process running in docker container named memc1


    Code:
    docker top memc1
    UID                 PID                 PPID                C                   STIME               TTY                 TIME                CMD
    saslauth            26562               24667               0                   14:11               pts/1               00:00:00            /usr/bin/memcached -m 64 -p 11211 -c 4096 -b 4096 -t 2 -R 200 -n 72 -f 1.25 -u memcached -o slab_reassign slab_automove
    On the host system

    Code:
    root     26556  0.0  0.0 276064  6576 ?        Sl   14:11   0:00 docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 11211 -container-ip 172.17.0.146 -container-port 11211
    saslauth 26562  0.0  0.0 206532  1472 pts/1    Ssl+ 14:11   0:00 /usr/bin/memcached -m 64 -p 11211 -c 4096 -b 4096 -t 2 -R 200 -n 72 -f 1.25 -u memcached -o slab_reassign slab_automove
    Testing host system connection to Memcached docker container on port 11211 and server's ip address (not localhost nor 127.0.0.1).

    Code:
    memcached-tool serveripaddress:11211 stats
    #serveripaddress:11211 Field       Value
             accepting_conns           1
                   auth_cmds           0
                 auth_errors           0
                       bytes           0
                  bytes_read           7
               bytes_written           0
                  cas_badval           0
                    cas_hits           0
                  cas_misses           0
                   cmd_flush           0
                     cmd_get           0
                     cmd_set           0
                   cmd_touch           0
                 conn_yields           0
       connection_structures           7
           crawler_reclaimed           0
            curr_connections           6
                  curr_items           0
                   decr_hits           0
                 decr_misses           0
                 delete_hits           0
               delete_misses           0
           evicted_unfetched           0
                   evictions           0
           expired_unfetched           0
                    get_hits           0
                  get_misses           0
                  hash_bytes      524288
           hash_is_expanding           0
            hash_power_level          16
                   incr_hits           0
                 incr_misses           0
                    libevent 2.0.21-stable
              limit_maxbytes    67108864
         listen_disabled_num           0
           lrutail_reflocked           0
                malloc_fails           0
                         pid           1
                pointer_size          64
                   reclaimed           0
                reserved_fds          10
               rusage_system    0.014997
                 rusage_user    0.011998
       slab_reassign_running           0
                 slabs_moved           0
                     threads           2
                        time  1424470901
           total_connections           7
                 total_items           0
                  touch_hits           0
                touch_misses           0
                      uptime         626
                     version      1.4.22
    Can find my other Docker images using docker search

    Code:
    docker search centminmod
    NAME                            DESCRIPTION                                     STARS     OFFICIAL   AUTOMATED
    centminmod/oraclelinux65base    Oracle Linux 6.5 base 1.57GB image              1            
    centminmod/centos66mariadb10    CentOS 6.6 + MariaDB 10 + centminmod.com        0            
    centminmod/centos66epel         CentOS 6.6 + EPEL + centminmod.com              0            
    centminmod/centos7epel          CentOS 7 + EPEL + centminmod.com                0            
    centminmod/centos65base         CentOS 6.5 base image for CentminMod projects   0            
    centminmod/centos66-memcached   Memcached 1.4.22 + CentOS 6.6 + centminmod...   0 
     
    Last edited: Feb 23, 2015
  2. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  3. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Run some Twitter Twemperf aka mcperf memcached server benchmarks with 5000 connections and 20k connection rate. As expected host built via Centmin Mod LEMP stack's Memcached server performs better than Docker container based Memcached server. Centmin Mod LEMP's Memcached version is sourced compiled with igbinary support as well while docker version is just a YUM installed version via Remi repository.

    Code:
    Twemperf Docker Memcached
    Connection rate: 9817.9 conn/s
    Connection time [ms]: avg 341.1 min 73.7 max 396.2 stddev 52.11
    Connect time [ms]: avg 55.0 min 1.1 max 103.1 stddev 28.14
    Request rate: 83942.7 req/s (0.0 ms/req)
    Request size [B]: avg 129.0 min 129.0 max 129.0 stddev 0.00
    Response rate: 83942.7 rsp/s (0.0 ms/rsp)
    Response size [B]: avg 8.0 min 8.0 max 8.0 stddev 0.00
    Response time [ms]: avg 28.6 min 1.2 max 65.0 stddev 0.01
    Response time [ms]: p25 24.0 p50 27.0 p75 29.0
    Response time [ms]: p95 58.0 p99 62.0 p999 65.0
    
    Twemperf Centmin Mod Memcached
    Connection rate: 11419.3 conn/s
    Connection time [ms]: avg 200.5 min 0.6 max 263.2 stddev 73.85
    Connect time [ms]: avg 26.2 min 0.0 max 53.5 stddev 14.59
    Request rate: 114192.6 req/s (0.0 ms/req)
    Request size [B]: avg 129.0 min 129.0 max 129.0 stddev 0.00
    Response rate: 114192.6 rsp/s (0.0 ms/rsp)
    Response size [B]: avg 8.0 min 8.0 max 8.0 stddev 0.00
    Response time [ms]: avg 17.4 min 0.0 max 28.8 stddev 0.01
    Response time [ms]: p25 12.0 p50 20.0 p75 23.0
    Response time [ms]: p95 28.0 p99 28.0 p999 29.0
    Twemperf against Docker built Memcached server

    Code:
    mcperf -s serveripaddress -p 11211 --num-conns=5000 --conn-rate=20000 --sizes=0.01 --num-calls=10; echo; echo stats | nc serveripaddress 11211; echo
    
    Total: connections 5000 requests 42750 responses 42750 test-duration 0.509 s
    
    Connection rate: 9817.9 conn/s (0.1 ms/conn <= 4015 concurrent connections)
    Connection time [ms]: avg 341.1 min 73.7 max 396.2 stddev 52.11
    Connect time [ms]: avg 55.0 min 1.1 max 103.1 stddev 28.14
    
    Request rate: 83942.7 req/s (0.0 ms/req)
    Request size [B]: avg 129.0 min 129.0 max 129.0 stddev 0.00
    
    Response rate: 83942.7 rsp/s (0.0 ms/rsp)
    Response size [B]: avg 8.0 min 8.0 max 8.0 stddev 0.00
    Response time [ms]: avg 28.6 min 1.2 max 65.0 stddev 0.01
    Response time [ms]: p25 24.0 p50 27.0 p75 29.0
    Response time [ms]: p95 58.0 p99 62.0 p999 65.0
    Response type: stored 42750 not_stored 0 exists 0 not_found 0
    Response type: num 0 deleted 0 end 0 value 0
    Response type: error 0 client_error 0 server_error 0
    
    Errors: total 725 client-timo 0 socket-timo 0 connrefused 0 connreset 725
    Errors: fd-unavail 0 ftab-full 0 addrunavail 0 other 0
    
    CPU time [s]: user 0.06 system 0.45 (user 11.4% system 88.2% total 99.5%)
    Net I/O: bytes 5.6 MB rate 11230.6 KB/s (92.0*10^6 bps)
    
    
    STAT pid 1
    STAT uptime 31
    STAT time 1424474729
    STAT version 1.4.22
    STAT libevent 2.0.21-stable
    STAT pointer_size 64
    STAT rusage_user 0.108983
    STAT rusage_system 0.657899
    STAT curr_connections 6
    STAT total_connections 4282
    STAT connection_structures 4080
    STAT reserved_fds 10
    STAT cmd_get 0
    STAT cmd_set 42750
    STAT cmd_flush 0
    STAT cmd_touch 0
    STAT get_hits 0
    STAT get_misses 0
    STAT delete_misses 0
    STAT delete_hits 0
    STAT incr_misses 0
    STAT incr_hits 0
    STAT decr_misses 0
    STAT decr_hits 0
    STAT cas_misses 0
    STAT cas_hits 0
    STAT cas_badval 0
    STAT touch_hits 0
    STAT touch_misses 0
    STAT auth_cmds 0
    STAT auth_errors 0
    STAT bytes_read 5514756
    STAT bytes_written 342000
    STAT limit_maxbytes 67108864
    STAT accepting_conns 1
    STAT listen_disabled_num 2
    STAT threads 2
    STAT conn_yields 0
    STAT hash_power_level 16
    STAT hash_bytes 524288
    STAT hash_is_expanding 0
    STAT slab_reassign_running 0
    STAT slabs_moved 0
    STAT malloc_fails 0
    STAT bytes 7652250
    STAT curr_items 42750
    STAT total_items 42750
    STAT expired_unfetched 0
    STAT evicted_unfetched 0
    STAT evictions 0
    STAT reclaimed 0
    STAT crawler_reclaimed 0
    STAT lrutail_reflocked 0
    END
    
    Twemperf against Centmin Mod LEMP default source compiled Memcached server also 1.4.22 and using same settings.

    Code:
    mcperf -s 127.0.0.1 -p 11211 --num-conns=5000 --conn-rate=20000 --sizes=0.01 --num-calls=10; echo; echo stats | nc 127.0.0.1 11211; echo
    
    Total: connections 5000 requests 50000 responses 50000 test-duration 0.438 s
    
    Connection rate: 11419.3 conn/s (0.1 ms/conn <= 3861 concurrent connections)
    Connection time [ms]: avg 200.5 min 0.6 max 263.2 stddev 73.85
    Connect time [ms]: avg 26.2 min 0.0 max 53.5 stddev 14.59
    
    Request rate: 114192.6 req/s (0.0 ms/req)
    Request size [B]: avg 129.0 min 129.0 max 129.0 stddev 0.00
    
    Response rate: 114192.6 rsp/s (0.0 ms/rsp)
    Response size [B]: avg 8.0 min 8.0 max 8.0 stddev 0.00
    Response time [ms]: avg 17.4 min 0.0 max 28.8 stddev 0.01
    Response time [ms]: p25 12.0 p50 20.0 p75 23.0
    Response time [ms]: p95 28.0 p99 28.0 p999 29.0
    Response type: stored 50000 not_stored 0 exists 0 not_found 0
    Response type: num 0 deleted 0 end 0 value 0
    Response type: error 0 client_error 0 server_error 0
    
    Errors: total 0 client-timo 0 socket-timo 0 connrefused 0 connreset 0
    Errors: fd-unavail 0 ftab-full 0 addrunavail 0 other 0
    
    CPU time [s]: user 0.06 system 0.38 (user 13.5% system 85.9% total 99.3%)
    Net I/O: bytes 6.5 MB rate 15277.7 KB/s (125.2*10^6 bps)
    
    
    STAT pid 13478
    STAT uptime 17
    STAT time 1424474973
    STAT version 1.4.22
    STAT libevent 2.0.21-stable
    STAT pointer_size 64
    STAT rusage_user 0.144977
    STAT rusage_system 0.388940
    STAT curr_connections 3
    STAT total_connections 5005
    STAT connection_structures 4004
    STAT reserved_fds 10
    STAT cmd_get 0
    STAT cmd_set 50000
    STAT cmd_flush 0
    STAT cmd_touch 0
    STAT get_hits 0
    STAT get_misses 0
    STAT delete_misses 0
    STAT delete_hits 0
    STAT incr_misses 0
    STAT incr_hits 0
    STAT decr_misses 0
    STAT decr_hits 0
    STAT cas_misses 0
    STAT cas_hits 0
    STAT cas_badval 0
    STAT touch_hits 0
    STAT touch_misses 0
    STAT auth_cmds 0
    STAT auth_errors 0
    STAT bytes_read 6450013
    STAT bytes_written 401144
    STAT limit_maxbytes 67108864
    STAT accepting_conns 1
    STAT listen_disabled_num 0
    STAT threads 2
    STAT conn_yields 0
    STAT hash_power_level 16
    STAT hash_bytes 524288
    STAT hash_is_expanding 0
    STAT slab_reassign_running 0
    STAT slabs_moved 0
    STAT malloc_fails 0
    STAT bytes 8950000
    STAT curr_items 50000
    STAT total_items 50000
    STAT expired_unfetched 0
    STAT evicted_unfetched 0
    STAT evictions 0
    STAT reclaimed 0
    STAT crawler_reclaimed 0
    STAT lrutail_reflocked 0
    END
     
    Last edited: Feb 21, 2015
  4. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Run some memtier_benchmarks against both Docker built Memcached server and Centmin Mod LEMP default Memcached servers again same 1.4.22 and settings.

    Much larger performance lead goes to Centmin Mod's Memcached instance 66% faster than Docker built instance !

    Code:
    memtier_benchmark docker Memcached
    4         Threads
    50        Connections per thread
    10000     Requests per thread
    Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
    ------------------------------------------------------------------------
    Sets       16821.99          ---          ---      1.12600      2271.79
    Gets      168035.07    159636.00      8399.07      1.12000     23884.00
    Totals    184857.06    159636.00      8399.07      1.12100     26155.79
    
    memtier_benchmark Centmin Mod Memcached
    4         Threads
    50        Connections per thread
    10000     Requests per thread
    Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
    ------------------------------------------------------------------------
    Sets       28468.13          ---          ---      0.62300      3844.59
    Gets      284368.51    266547.14     17821.36      0.62200     39964.31
    Totals    312836.64    266547.14     17821.36      0.62200     43808.90
    
    memtier_benchmark against Docker Memcached 1.4.22

    Code:
    c=50; time memtier_benchmark -P memcache_text -s serveripaddress -p 11211 -c $c --random-data --data-size-range=4-204 --data-size-pattern=S --key-minimum=200 --key-maximum=400 --key-pattern=G:G --key-stddev=10 --key-median=300 2>&1 > memtier_benchmark.${c}.log; head -8 memtier_benchmark.${c}.log; echo; echo stats | nc serveripaddress 11211
    
    [RUN #1] Preparing benchmark client...
    [RUN #1] Launching threads now...
    [RUN #1 100%,  11 secs]  0 threads:     2000000 ops,  161222 (avg:  169707) ops/sec, 22.99MB/sec (avg: 23.45MB/sec),  1.21 (avg:  1.12) msec latency
    
    
    real    0m13.016s
    user    0m9.342s
    sys     0m19.056s
    4         Threads
    50        Connections per thread
    10000     Requests per thread
    Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
    ------------------------------------------------------------------------
    Sets       16821.99          ---          ---      1.12600      2271.79
    Gets      168035.07    159636.00      8399.07      1.12000     23884.00
    Totals    184857.06    159636.00      8399.07      1.12100     26155.79
    
    STAT pid 1
    STAT uptime 21
    STAT time 1424475453
    STAT version 1.4.22
    STAT libevent 2.0.21-stable
    STAT pointer_size 64
    STAT rusage_user 1.994696
    STAT rusage_system 22.024651
    STAT curr_connections 6
    STAT total_connections 207
    STAT connection_structures 206
    STAT reserved_fds 10
    STAT cmd_get 1818000
    STAT cmd_set 182000
    STAT cmd_flush 0
    STAT cmd_touch 0
    STAT get_hits 1727129
    STAT get_misses 90871
    STAT delete_misses 0
    STAT delete_hits 0
    STAT incr_misses 0
    STAT incr_hits 0
    STAT decr_misses 0
    STAT decr_hits 0
    STAT cas_misses 0
    STAT cas_hits 0
    STAT cas_badval 0
    STAT touch_hits 0
    STAT touch_misses 0
    STAT auth_cmds 0
    STAT auth_errors 0
    STAT bytes_read 54618806
    STAT bytes_written 235156777
    STAT limit_maxbytes 67108864
    STAT accepting_conns 1
    STAT listen_disabled_num 0
    STAT threads 2
    STAT conn_yields 0
    STAT hash_power_level 16
    STAT hash_bytes 524288
    STAT hash_is_expanding 0
    STAT slab_reassign_running 0
    STAT slabs_moved 0
    STAT malloc_fails 0
    STAT bytes 9982
    STAT curr_items 55
    STAT total_items 182000
    STAT expired_unfetched 0
    STAT evicted_unfetched 0
    STAT evictions 0
    STAT reclaimed 0
    STAT crawler_reclaimed 0
    STAT lrutail_reflocked 1128
    END
    memtier_benchmark against Centmin Mod LEMP source compiled Memcached 1.4.2.2

    Code:
    c=50; time memtier_benchmark -P memcache_text -s 127.0.0.1 -p 11211 -c $c --random-data --data-size-range=4-204 --data-size-pattern=S --key-minimum=200 --key-maximum=400 --key-pattern=G:G --key-stddev=10 --key-median=300 2>&1 > memtier_benchmark.${c}.log; head -8 memtier_benchmark.${c}.log; echo; echo stats | nc 127.0.0.1 11211
    
    [RUN #1] Preparing benchmark client...
    [RUN #1] Launching threads now...
    [RUN #1 100%,   6 secs]  0 threads:     2000000 ops,  310104 (avg:  310463) ops/sec, 44.19MB/sec (avg: 42.46MB/sec),  0.64 (avg:  0.62) msec latency
    
    
    real    0m7.014s
    user    0m8.086s
    sys     0m15.464s
    4         Threads
    50        Connections per thread
    10000     Requests per thread
    Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
    ------------------------------------------------------------------------
    Sets       28468.13          ---          ---      0.62300      3844.59
    Gets      284368.51    266547.14     17821.36      0.62200     39964.31
    Totals    312836.64    266547.14     17821.36      0.62200     43808.90
    
    STAT pid 14928
    STAT uptime 48
    STAT time 1424475363
    STAT version 1.4.22
    STAT libevent 2.0.21-stable
    STAT pointer_size 64
    STAT rusage_user 1.963701
    STAT rusage_system 10.079467
    STAT curr_connections 3
    STAT total_connections 206
    STAT connection_structures 203
    STAT reserved_fds 10
    STAT cmd_get 1818000
    STAT cmd_set 182000
    STAT cmd_flush 0
    STAT cmd_touch 0
    STAT get_hits 1704066
    STAT get_misses 113934
    STAT delete_misses 0
    STAT delete_hits 0
    STAT incr_misses 0
    STAT incr_hits 0
    STAT decr_misses 0
    STAT decr_hits 0
    STAT cas_misses 0
    STAT cas_hits 0
    STAT cas_badval 0
    STAT touch_hits 0
    STAT touch_misses 0
    STAT auth_cmds 0
    STAT auth_errors 0
    STAT bytes_read 54618820
    STAT bytes_written 232180524
    STAT limit_maxbytes 67108864
    STAT accepting_conns 1
    STAT listen_disabled_num 0
    STAT threads 2
    STAT conn_yields 0
    STAT hash_power_level 16
    STAT hash_bytes 524288
    STAT hash_is_expanding 0
    STAT slab_reassign_running 0
    STAT slabs_moved 0
    STAT malloc_fails 0
    STAT bytes 9982
    STAT curr_items 55
    STAT total_items 182000
    STAT expired_unfetched 0
    STAT evicted_unfetched 0
    STAT evictions 0
    STAT reclaimed 0
    STAT crawler_reclaimed 0
    STAT lrutail_reflocked 739
    END
     
    Last edited: Feb 21, 2015
  5. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Try launching 3x Memcached server docker containers named, memc1, memc2 and memc3 for some load balanced auto cache sharding Memcached pool benchmarks. Of course expected it won't scale much seeing as all Memcached instances are coming from same local network as opposed to remote Memcached server instances.

    Launching the 3x Memcached docker container instances mapping local ports 33210, 33211, 33212 against docker 11211.

    Code:
    docker run --name memc1 -d -p 33210:11211 -t centminmod/centos66-memcached
    docker run --name memc2 -d -p 33211:11211 -t centminmod/centos66-memcached
    docker run --name memc3 -d -p 33212:11211 -t centminmod/centos66-memcached
    docker ps

    Code:
    CONTAINER ID        IMAGE                                  COMMAND                CREATED              STATUS              PORTS                      NAMES
    f6491xxx        centminmod/centos66-memcached:latest   "/bin/sh -c '/usr/bi   3 seconds ago        Up 2 seconds        0.0.0.0:33210->11211/tcp   memc1     
    ad431xxx        centminmod/centos66-memcached:latest   "/bin/sh -c '/usr/bi   About a minute ago   Up About a minute   0.0.0.0:33212->11211/tcp   memc3     
    3c7ffxxx        centminmod/centos66-memcached:latest   "/bin/sh -c '/usr/bi   About a minute ago   Up About a minute   0.0.0.0:33211->11211/tcp   memc2
    
    system process listing

    Code:
    root     18590  0.0  0.0 210400  6632 ?        Sl   15:48   0:00  \_ docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 33211 -container-ip 172.17.0.151 -container-port 11211
    saslauth 18596  0.0  0.0 206532  1412 pts/1    Ssl+ 15:48   0:00  \_ /usr/bin/memcached -m 64 -p 11211 -c 4096 -b 4096 -t 2 -R 200 -n 72 -f 1.25 -u memcached -o slab_reassign slab_automove
    root     18707  0.0  0.0 210400  6648 ?        Sl   15:48   0:00  \_ docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 33212 -container-ip 172.17.0.152 -container-port 11211
    saslauth 18713  0.0  0.0 206532  1408 pts/4    Ssl+ 15:48   0:00  \_ /usr/bin/memcached -m 64 -p 11211 -c 4096 -b 4096 -t 2 -R 200 -n 72 -f 1.25 -u memcached -o slab_reassign slab_automove
    root     18999  0.0  0.0 210400  8644 ?        Sl   15:50   0:00  \_ docker-proxy -proto tcp -host-ip 0.0.0.0 -host-port 33210 -container-ip 172.17.0.154 -container-port 11211
    saslauth 19005  0.0  0.0 206532  1412 pts/5    Ssl+ 15:50   0:00  \_ /usr/bin/memcached -m 64 -p 11211 -c 4096 -b 4096 -t 2 -R 200 -n 72 -f 1.25 -u memcached -o slab_reassign slab_automove
    
    Twemperf memcached benchmarks against load balanced 3xMemcached server pools listening on port 44123.

    Look at the total memcached connection stats for the Memcached pool compared to stand alone Memcached on non-docker and docker instances and you can see why my custom auto shared Memcached pooling tests can scale much higher for high concurrent connection based Memcached traffic. Some I reserve for my paid private consulting clients if they need such :D

    Also notice total items in Memcached pools for each server is roughly shared and divided amongst all 3x Memcached docker instances :)

    Connection rate and request and response rate slightly better than single Memcached docker instance. However, nice boost for 3x Memcached docker pool in terms of connection time (avg 271.1ms vs 341.1ms), connect time (avg 3.6ms vs 55ms), and response time @99.9 percentile (47ms vs 65ms).

    Code:
    ###########################################
    1x Memcached docker instance
    ###########################################
    Connection rate: 9817.9 conn/s
    Connection time [ms]: avg 341.1 min 73.7 max 396.2 stddev 52.11
    Connect time [ms]: avg 55.0 min 1.1 max 103.1 stddev 28.14
    Request rate: 83942.7 req/s (0.0 ms/req)
    Request size [B]: avg 129.0 min 129.0 max 129.0 stddev 0.00
    Response rate: 83942.7 rsp/s (0.0 ms/rsp)
    Response size [B]: avg 8.0 min 8.0 max 8.0 stddev 0.00
    Response time [ms]: avg 28.6 min 1.2 max 65.0 stddev 0.01
    Response time [ms]: p25 24.0 p50 27.0 p75 29.0
    Response time [ms]: p95 58.0 p99 62.0 p999 65.0
    
    ###########################################
    3x Memcached docker instances auto shared pool
    ###########################################
    Connection rate: 8912.3 conn/s
    Connection time [ms]: avg 271.1 min 1.2 max 368.8 stddev 104.03
    Connect time [ms]: avg 3.6 min 0.0 max 9.9 stddev 2.62
    Request rate: 89123.1 req/s (0.0 ms/req)
    Request size [B]: avg 129.0 min 129.0 max 129.0 stddev 0.00
    Response rate: 89123.1 rsp/s (0.0 ms/rsp)
    Response size [B]: avg 8.0 min 8.0 max 8.0 stddev 0.00
    Response time [ms]: avg 26.7 min 0.0 max 46.6 stddev 0.01
    Response time [ms]: p25 17.0 p50 29.0 p75 37.0
    Response time [ms]: p95 42.0 p99 45.0 p999 47.0
    
    Code:
    mcperf -s serveripaddress -p 44123 --num-conns=5000 --conn-rate=20000 --sizes=0.01 --num-calls=10; echo; echo stats | nc serveripaddress 33210;  echo; echo stats | nc serveripaddress 33211;  echo; echo stats | nc serveripaddress 33212; echo
    
    Total: connections 5000 requests 50000 responses 50000 test-duration 0.561 s
    
    Connection rate: 8912.3 conn/s (0.1 ms/conn <= 3861 concurrent connections)
    Connection time [ms]: avg 271.1 min 1.2 max 368.8 stddev 104.03
    Connect time [ms]: avg 3.6 min 0.0 max 9.9 stddev 2.62
    
    Request rate: 89123.1 req/s (0.0 ms/req)
    Request size [B]: avg 129.0 min 129.0 max 129.0 stddev 0.00
    
    Response rate: 89123.1 rsp/s (0.0 ms/rsp)
    Response size [B]: avg 8.0 min 8.0 max 8.0 stddev 0.00
    Response time [ms]: avg 26.7 min 0.0 max 46.6 stddev 0.01
    Response time [ms]: p25 17.0 p50 29.0 p75 37.0
    Response time [ms]: p95 42.0 p99 45.0 p999 47.0
    Response type: stored 50000 not_stored 0 exists 0 not_found 0
    Response type: num 0 deleted 0 end 0 value 0
    Response type: error 0 client_error 0 server_error 0
    
    Errors: total 0 client-timo 0 socket-timo 0 connrefused 0 connreset 0
    Errors: fd-unavail 0 ftab-full 0 addrunavail 0 other 0
    
    CPU time [s]: user 0.12 system 0.44 (user 20.9% system 78.8% total 99.6%)
    Net I/O: bytes 6.5 MB rate 11923.7 KB/s (97.7*10^6 bps)
    
    
    STAT pid 1
    STAT uptime 351
    STAT time 1424476549
    STAT version 1.4.22
    STAT libevent 2.0.21-stable
    STAT pointer_size 64
    STAT rusage_user 0.025996
    STAT rusage_system 0.045993
    STAT curr_connections 7
    STAT total_connections 9
    STAT connection_structures 8
    STAT reserved_fds 10
    STAT cmd_get 0
    STAT cmd_set 15792
    STAT cmd_flush 0
    STAT cmd_touch 0
    STAT get_hits 0
    STAT get_misses 0
    STAT delete_misses 0
    STAT delete_hits 0
    STAT incr_misses 0
    STAT incr_hits 0
    STAT decr_misses 0
    STAT decr_hits 0
    STAT cas_misses 0
    STAT cas_hits 0
    STAT cas_badval 0
    STAT touch_hits 0
    STAT touch_misses 0
    STAT auth_cmds 0
    STAT auth_errors 0
    STAT bytes_read 2037174
    STAT bytes_written 126336
    STAT limit_maxbytes 67108864
    STAT accepting_conns 1
    STAT listen_disabled_num 0
    STAT threads 2
    STAT conn_yields 27
    STAT hash_power_level 16
    STAT hash_bytes 524288
    STAT hash_is_expanding 0
    STAT slab_reassign_running 0
    STAT slabs_moved 0
    STAT malloc_fails 0
    STAT bytes 2826768
    STAT curr_items 15792
    STAT total_items 15792
    STAT expired_unfetched 0
    STAT evicted_unfetched 0
    STAT evictions 0
    STAT reclaimed 0
    STAT crawler_reclaimed 0
    STAT lrutail_reflocked 0
    END
    
    STAT pid 1
    STAT uptime 444
    STAT time 1424476549
    STAT version 1.4.22
    STAT libevent 2.0.21-stable
    STAT pointer_size 64
    STAT rusage_user 0.037994
    STAT rusage_system 0.057991
    STAT curr_connections 7
    STAT total_connections 9
    STAT connection_structures 8
    STAT reserved_fds 10
    STAT cmd_get 0
    STAT cmd_set 17823
    STAT cmd_flush 0
    STAT cmd_touch 0
    STAT get_hits 0
    STAT get_misses 0
    STAT delete_misses 0
    STAT delete_hits 0
    STAT incr_misses 0
    STAT incr_hits 0
    STAT decr_misses 0
    STAT decr_hits 0
    STAT cas_misses 0
    STAT cas_hits 0
    STAT cas_badval 0
    STAT touch_hits 0
    STAT touch_misses 0
    STAT auth_cmds 0
    STAT auth_errors 0
    STAT bytes_read 2299173
    STAT bytes_written 142584
    STAT limit_maxbytes 67108864
    STAT accepting_conns 1
    STAT listen_disabled_num 0
    STAT threads 2
    STAT conn_yields 21
    STAT hash_power_level 16
    STAT hash_bytes 524288
    STAT hash_is_expanding 0
    STAT slab_reassign_running 0
    STAT slabs_moved 0
    STAT malloc_fails 0
    STAT bytes 3190317
    STAT curr_items 17823
    STAT total_items 17823
    STAT expired_unfetched 0
    STAT evicted_unfetched 0
    STAT evictions 0
    STAT reclaimed 0
    STAT crawler_reclaimed 0
    STAT lrutail_reflocked 0
    END
    
    STAT pid 1
    STAT uptime 438
    STAT time 1424476549
    STAT version 1.4.22
    STAT libevent 2.0.21-stable
    STAT pointer_size 64
    STAT rusage_user 0.026995
    STAT rusage_system 0.055991
    STAT curr_connections 7
    STAT total_connections 9
    STAT connection_structures 8
    STAT reserved_fds 10
    STAT cmd_get 0
    STAT cmd_set 16385
    STAT cmd_flush 0
    STAT cmd_touch 0
    STAT get_hits 0
    STAT get_misses 0
    STAT delete_misses 0
    STAT delete_hits 0
    STAT incr_misses 0
    STAT incr_hits 0
    STAT decr_misses 0
    STAT decr_hits 0
    STAT cas_misses 0
    STAT cas_hits 0
    STAT cas_badval 0
    STAT touch_hits 0
    STAT touch_misses 0
    STAT auth_cmds 0
    STAT auth_errors 0
    STAT bytes_read 2113671
    STAT bytes_written 131080
    STAT limit_maxbytes 67108864
    STAT accepting_conns 1
    STAT listen_disabled_num 0
    STAT threads 2
    STAT conn_yields 22
    STAT hash_power_level 16
    STAT hash_bytes 524288
    STAT hash_is_expanding 0
    STAT slab_reassign_running 0
    STAT slabs_moved 0
    STAT malloc_fails 0
    STAT bytes 2932915
    STAT curr_items 16385
    STAT total_items 16385
    STAT expired_unfetched 0
    STAT evicted_unfetched 0
    STAT evictions 0
    STAT reclaimed 0
    STAT crawler_reclaimed 0
    STAT lrutail_reflocked 0
    END
    
     
    Last edited: Feb 21, 2015
  6. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM
    I believe these are automated build repositories. All my images on Docker Hub are automated builds and all have the Dockerfile. You can connect your Docker Hub profile to your accounts on GitHub and Bitbucket. Then, when creating a new repository, choose 'Automated Build'.
     
  7. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Webhooks and services on Github repos ?
     
  8. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM
    Amazing @eva2000 !

    I've never touched the Memcached realm on Docker, sounds too complicated, but I'll try to connect to it using one of my images, let's see. Maybe I can use an Memcached container and link it to WP-Stack to cache WordPress hits. Will let you know when it happens...
     
  9. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM
    I created all on GitHub first, then, when it's ready (or almost), I create a new repo on Docker Hub using the automated build option and it will pull the repo from GitHub. When I git push updates to GitHub, the Docker Hub will fetch the changes and build another image.
     
  10. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Yeah I figured Memcached would be the easier to make a docker image on and would be most used. That and Redis - will be doing a Redis Docker image just to see as I have been benchmarking Memcached and Redis servers in standalone and auto shard cached multiple server pool configs :D
     
  11. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Cool, got to look into this.. as I did Github and Docker Hub repos manually for both heh

    found it :)

    github_adddocker_service00.png

    docker_automated_builds.png

    hmm do automatic builds override manually pushed builds with and without tags ? or is automated builds tagged with latest only tag ?
     
    Last edited: Feb 21, 2015
  12. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  13. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM
  14. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM
    By the way, Quay.io (by CoreOS) offers free private Docker repositories.
    Going to sleep, have a good night!
    Cheers
     
  15. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Thanks for the heads up will check that out. Docker is fun.. shame performance can be slower. But I guess you need to benchmark Docker containers to make sure they perform reasonably in real world use :)
     
  16. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  17. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM
  18. eva2000

    eva2000 Administrator Staff Member

    55,197
    12,251
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,829
    Local Time:
    6:50 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  19. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM
  20. Guilherme Jaccoud

    Guilherme Jaccoud Member

    63
    30
    18
    May 29, 2014
    Ratings:
    +30
    Local Time:
    5:50 AM