Welcome to Centmin Mod Community
Become a Member

Beta Branch Centmin Mod .09 beta branch Testing

Discussion in 'Beta release code' started by eva2000, Aug 12, 2015.

Tags:
  1. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5

    Add tools/setio.sh Script



    Update: Feb 6th, 2016. Just added to Centmin Mod 123.09beta01 branch the new tools/setio.sh standalone tool which can set your MySQL server's /etc/my.cnf innodb_io_capacity variable optimally based on your server's measured disk write I/O performance numbers. This is based on the tests and feedback provided by other Centmin Mod users at Beta Branch - Help test innodbio.sh for MySQL Tuning | Centmin Mod Community

    Will be integrated into 123.09beta01's initial installation setup routine so innodb_io_capacity variable is set optimally for the user's server. You can also re-run tools/setio.sh manually to re-adjust the innodb_io_capacity variable value whenever you need to do it i.e. after upgrading disk configurations or expanding disk configuration which change the underlying disk write I/O performance.

    To run setio.sh it's as easy as running this command and it will update /etc/my.cnf innodb_io_capacity variable with the new measured value and on the fly - dynamically set globally the value on the running MariaDB MySQL server. No need to restart MySQL for the setting to register :)

    SSH command after you update to latest Centmin Mod 123.09beta01 code
    Code:
    /usr/local/src/centminmod/tools/setio.sh set
    If on Centmin Mod 123.08stable or lower, you can just grab the tools/setio.sh file itself and download to tools directory to run it as well
    Code:
    wget -O /usr/local/src/centminmod/tools/setio.sh https://github.com/centminmod/centminmod/raw/123.09beta01/tools/setio.sh
    chmod +x /usr/local/src/centminmod/tools/setio.sh
    /usr/local/src/centminmod/tools/setio.sh set
    Commit add tools/setio.sh · centminmod/centminmod@0bbc9be · GitHub
     
    • Like Like x 2
  2. RoldanLT

    RoldanLT Well-Known Member

    3,875
    946
    113
    May 25, 2014
    Phillipines
    Ratings:
    +1,290
    Local Time:
    5:42 PM
    1.11
    10.2
    Doesn't matter if it's live server with live websites hosted?
     
  3. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    not really :D
     
    • Like Like x 1
  4. ModeltogTossen

    ModeltogTossen I wish I could??

    313
    97
    28
    Dec 20, 2015
    Denmark
    Ratings:
    +143
    Local Time:
    11:42 AM
    1.9.12
    10.0.23
    Did update and run it - got this:

    Code:
    [root@sarah ~]# /usr/local/src/centminmod/tools/setio.sh set
    Full Reads: 731
    Full Writes: 193
    innodb_io_capacity = 100
    
    /etc/my.cnf adjustment
    existing value: innodb_io_capacity = 200
    +--------------------+-------+
    | Variable_name      | Value |
    +--------------------+-------+
    | innodb_io_capacity | 200   |
    +--------------------+-------+
    new value: innodb_io_capacity = 100
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 100   |
    | innodb_io_capacity_max | 2000  |
    +------------------------+-------+
    
     
    • Informative Informative x 1
  5. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    looks like low disk write I/O downgraded your variable's value :)
     
  6. ModeltogTossen

    ModeltogTossen I wish I could??

    313
    97
    28
    Dec 20, 2015
    Denmark
    Ratings:
    +143
    Local Time:
    11:42 AM
    1.9.12
    10.0.23
    Yeah - no big deal - its still on the beta server where I live test 09beta1 and other stuff .. That is a 'older' Ovh dedi.. But your script works and I did looked at the my.cnf - and the value was altered in file..
     
    • Like Like x 1
  7. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    Thanks for the confirmation :D
     
  8. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    @ModeltogTossen better for your low IOPs server. Just updated tools/setio.sh to specifically set innodb_io_capacity_max variable as well to 2x innodb_io_capacity derived value
    Code:
    Full Reads: 3144
    Full Writes: 117928
    innodb_io_capacity = 4700
    
    /etc/my.cnf adjustment
    existing value: innodb_io_capacity = 4600
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 4600  |
    | innodb_io_capacity_max | 9000  |
    +------------------------+-------+
    new value: innodb_io_capacity = 4700
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 4700  |
    | innodb_io_capacity_max | 9400  |
    +------------------------+-------+
     
  9. ModeltogTossen

    ModeltogTossen I wish I could??

    313
    97
    28
    Dec 20, 2015
    Denmark
    Ratings:
    +143
    Local Time:
    11:42 AM
    1.9.12
    10.0.23
    Updated CMM - and run it again - gave me this:

    Code:
    [root@sarah ~]# /usr/local/src/centminmod/tools/setio.sh set
    Full Reads: 233
    Full Writes: 184
    innodb_io_capacity = 100
    
    /etc/my.cnf adjustment
    existing value: innodb_io_capacity = 100
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 100   |
    | innodb_io_capacity_max | 2000  |
    +------------------------+-------+
    new value: innodb_io_capacity = 100
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 100   |
    | innodb_io_capacity_max | 200   |
    +------------------------+-------+
    
    I'm not sure if I understand it correctly - Should I have seen other values this time?
     
  10. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    the innodb_io_capacity_max value was adjusted from 2000 to 200 which is the aim

    made one more update as i forgot to edit /etc/my.cnf on only did global on the fly change heh update /etc/my.cnf templates & tools/setio.sh · centminmod/centminmod@8ae42c3 · GitHub

    might need to adjust it some more for situations like yours where you have 183 iops writes available but max is set at 200 heh
     
  11. ModeltogTossen

    ModeltogTossen I wish I could??

    313
    97
    28
    Dec 20, 2015
    Denmark
    Ratings:
    +143
    Local Time:
    11:42 AM
    1.9.12
    10.0.23
    Oh sorry :oops: - I'm blind - was so focused on the new value line ..
     
  12. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    updated again to clear up formatting and wording to not confuse folks :D
    Code:
    Full Reads: 3478
    Full Writes: 116267
    innodb_io_capacity = 4600
    
    /etc/my.cnf adjustment
    existing value:
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 4600  |
    | innodb_io_capacity_max | 9200  |
    +------------------------+-------+
    new value:
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 4600  |
    | innodb_io_capacity_max | 9200  |
    +------------------------+-------+
    run on my SoYouStart server has 3x 120GB Intel 320 SSD, old and slower heh
    Code:
    Full Reads: 34565
    Full Writes: 7543
    innodb_io_capacity = 900
    
    /etc/my.cnf adjustment
    existing value:
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 200   |
    | innodb_io_capacity_max | 2000  |
    +------------------------+-------+
    new value:
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 900   |
    | innodb_io_capacity_max | 1800  |
    +------------------------+-------+
     
    • Friendly Friendly x 1
  13. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    Curious if folks have any objections of tools/setio.sh being ran everytime you you update nginx or php via centmin.sh menu options 4 and 5 ? Disk I/O performance isn't set in stone and changes over time, so the innodb_io_capacity values need adjusting over time as well. Doing the adjustment when you run centmin.sh menu option 4 or 5 for nginx and php upgrades would satisfy this requirement :)
     
  14. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    Updated tools/setio.sh for io threads adjustment and prompt to restart mysql server for changes
    Code:
    Full Reads: 3533
    Full Writes: 116267
    innodb_io_capacity = 4600
    
    +------------------------+-------+
    /etc/my.cnf adjustment
    +------------------------+-------+
    existing value:
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 4600  |
    | innodb_io_capacity_max | 9200  |
    +------------------------+-------+
    new value:
    +------------------------+-------+
    | Variable_name          | Value |
    +------------------------+-------+
    | innodb_io_capacity     | 4600  |
    | innodb_io_capacity_max | 9200  |
    +------------------------+-------+
    
    +------------------------+-------+
    innodb io threads adjustment
    +------------------------+-------+
    existing value:
    +------------------------+-------+
    innodb_read_io_threads = 2
    innodb_write_io_threads = 2
    +------------------------+-------+
    new value:
    +------------------------+-------+
    innodb_read_io_threads = 2
    innodb_write_io_threads = 2
    +------------------------+-------+
    
    Restart MySQL server for io thread changes
     
    • Like Like x 1
  15. Ahmad

    Ahmad Active Member

    209
    80
    28
    Apr 13, 2015
    Ratings:
    +150
    Local Time:
    11:42 AM
    1.9.9
    10.1.10
    Nope, but I guess could be an option for folks who have objections.
     
    • Agree Agree x 1
  16. pamamolf

    pamamolf Well-Known Member

    2,670
    240
    63
    May 31, 2014
    Ratings:
    +425
    Local Time:
    12:42 PM
    Nginx-1.13.x
    MariaDB 10.1.x
    Not needed i think....maybe an option?
     
  17. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5
    but not many folks would use or know to use it heh ?
     
    Last edited: Feb 6, 2016
  18. pamamolf

    pamamolf Well-Known Member

    2,670
    240
    63
    May 31, 2014
    Ratings:
    +425
    Local Time:
    12:42 PM
    Nginx-1.13.x
    MariaDB 10.1.x
    Maybe to add a related note at the end of new install like a reminder?

    Don't know...
     
  19. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5

    ngx_pagespeed 1.9.32.13-beta security update



    Updated both Centmin Mod 123.08stable and 123.09beta01 builds to default to ngx_pagespeed 1.9.32.13-beta for security update. You can update Centmin Mod code via centmin.sh menu option 23 submenu option 1 and then 2 and then recompile Nginx via centmin.sh menu option 4 as outlined above.

    Discussion thread at Nginx PageSpeed - ngx_pagespeed 1.9.32.13 beta security update ! | Centmin Mod Community

    To update your Centmin Mod builds follow instructions at centminmod.com/upgrade.html and respective version threads below:

    Disable ngx_pagespeed integration



    If you do not use ngx_pagespeed and have not enabled it as per instructions outlined at centminmod.com/nginx_ngx_pagespeed.html, you can in fact totally remove ngx_pagespeed integration from Nginx server using steps outlined on official site Nginx PageSpeed - CentminMod.com LEMP Nginx web stack for CentOS and below:

    The best way is to use persistent config file created or appended to at /etc/centminmod/custom_config.inc and add setting:
    Code:
    NGINX_PAGESPEED=n
    Then run centmin.sh menu option 4 to recompile Nginx without ngx_pagespeed module integration.
     
    Last edited: Feb 7, 2016
  20. eva2000

    eva2000 Administrator Staff Member

    29,720
    6,711
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,015
    Local Time:
    7:42 PM
    Nginx 1.13.x
    MariaDB 5.5

    AUTO_GITUPDATE variable support



    Added new variable for AUTO_GITUPDATE which is disabled by default, AUTO_GITUPDATE='n' https://community.centminmod.com/posts/25912/

    With AUTO_GITUPDATE='y' if centmin mod code install directory has been setup with git environment via centmin.sh menu option 23 submenu option 1, then allow centmin.sh to auto update the centmin mod code at /usr/local/src/centminmod silently in background

    if you want to retain local centmin mod code changes made to files in /usr/local/src/centminmod for variables in centmin.sh, use persistent config file you create or append to at /etc/centminmod/custom_config.inc as outlined on official site at Upgrade Centmin Mod - CentminMod.com LEMP Nginx web stack for CentOS

    Of course AUTO_GITUPDATE='y' should be set in persistent config file at /etc/centminmod/custom_config.inc to survive auto updates :D
     
    • Like Like x 1