Learn about Centmin Mod LEMP Stack today
Become a Member

Beta Branch revise centmin.sh menu option 21 in 123.09beta01

Discussion in 'Centmin Mod Github Commits' started by eva2000, Nov 2, 2019.

  1. eva2000

    eva2000 Administrator Staff Member

    50,869
    11,786
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,239
    Local Time:
    1:48 PM
    Nginx 1.25.x
    MariaDB 10.x
    revise centmin.sh menu option 21 in 123.09beta01

    Remove existing centmin.sh menu option 21 for nginx + php-fpm + siege compiles and repurpose it for use for future Centmin Mod to Centmin Mod data transfer routine allowing you to migrate data to a new Centmin Mod server. Data transfer routines have been in private development for ages and starting to take shape. Centmin Mod forum's Premium members Premium User Membership Explained will be the first to preview and test out data transfer routines when they're ready for public use later on.
    Code (Text):
    --------------------------------------------------------
         Centmin Mod Menu 123.09beta01 centminmod.com     
    --------------------------------------------------------
    1).  Centmin Install
    2).  Add Nginx vhost domain
    3).  NSD setup domain name DNS
    4).  Nginx Upgrade / Downgrade
    5).  PHP Upgrade / Downgrade
    6).  XCache Re-install
    7).  APC Cache Re-install
    8).  XCache Install
    9).  APC Cache Install
    10). Memcached Server Re-install
    11). MariaDB MySQL Upgrade & Management
    12). Zend OpCache Install/Re-install
    13). Install/Reinstall Redis PHP Extension
    14). SELinux disable
    15). Install/Reinstall ImagicK PHP Extension
    16). Change SSHD Port Number
    17). Multi-thread compression: zstd,pigz,pbzip2,lbzip2
    18). Suhosin PHP Extension install
    19). Install FFMPEG and FFMPEG PHP Extension
    20). NSD Install/Re-Install
    21). Data Transfer (TBA)
    22). Add Wordpress Nginx vhost + Cache Plugin
    23). Update Centmin Mod Code Base
    24). Exit
    --------------------------------------------------------
    Enter option [ 1 - 24 ]
    



    Continue reading...

    123.09beta01 branch
     
  2. eva2000

    eva2000 Administrator Staff Member

    50,869
    11,786
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,239
    Local Time:
    1:48 PM
    Nginx 1.25.x
    MariaDB 10.x
    Data transfer routines will have ultra optimized tar compression and rsync SSL cipher configurations to ensure fast data transfer between Centmin Mod to Centmin Mod servers and have optional support for both xxHash and md5 checksums for data integrity to ensure what data is backed up on one server makes it 100% on the destination server :)

    xxHash check sums will be the default, but you can choose between xxHash and md5 hashes. FYI xxHash hash checksums are between >2-20x times faster than md5 hashes so if you have alot of data, it will be much faster.

    Example xxHash here took 0.02 seconds versus md5 hashes taking 0.10 seconds :)
    Code (Text):
    xxhsum -H2 /home/simplebackup/centminmod-backup.tar.gz /home/simplebackup/centminlogs-011119-154533.tar.gz > /home/simplebackup/checksums.xxh128
    [real:0.02s user:0.00s sys:0.01s cpu: 95% maxmem: 672 KB cswaits: 0] 
    xxhsum -c /home/simplebackup/checksums.xxh128
    b208a063385d45942230cf05cd992b05  /home/simplebackup/centminmod-backup.tar.gz
    16e7cf7dae3762e8089afd4212e521e1  /home/simplebackup/centminlogs-011119-154533.tar.gz
    /home/simplebackup/centminmod-backup.tar.gz: OK
    /home/simplebackup/centminlogs-011119-154533.tar.gz: OK
    

    Code (Text):
    md5sum /home/simplebackup/centminmod-backup.tar.gz /home/simplebackup/centminlogs-011119-154533.tar.gz > /home/simplebackup/checksums.md5
    [real:0.10s user:0.08s sys:0.01s cpu: 97% maxmem: 712 KB cswaits: 1]
    md5sum -c /home/simplebackup/checksums.md5
    9b97e7935768ae9bdf5237f7f915ced1  /home/simplebackup/centminmod-backup.tar.gz
    21a2f0baf7329476aa23517ef9ed6a53  /home/simplebackup/centminlogs-011119-154533.tar.gz
    /home/simplebackup/centminmod-backup.tar.gz: OK
    /home/simplebackup/centminlogs-011119-154533.tar.gz: OK
    
     
  3. EckyBrazzz

    EckyBrazzz Active Member

    915
    189
    43
    Mar 28, 2018
    >>>>Click here<<<< i'm nearby......
    Ratings:
    +362
    Local Time:
    12:48 AM
    Latest
    Latest
    @eva2000 Wanted to give a rating "Winner" or "Like" but gave "Informative". Can speed up mine cluster project. To bad, I could not give all tree ratings:D
     
  4. eva2000

    eva2000 Administrator Staff Member

    50,869
    11,786
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,239
    Local Time:
    1:48 PM
    Nginx 1.25.x
    MariaDB 10.x
    Yeah 1 rating only :)

    Right now it will be a full system nginx, php-fpm, mariadb mysql, site files, databases, database users and optionally if detected redis and elasticsearch data directories too backup to a single tar.gz compressed file which is transferred to the new Centmin Mod server and restored in place = will by default overwrite whatever is on the new Centmin Mod server with the backed up files. With option to have some selective files not overwritten i.e. php.conf/php-fpm.conf can choose to overwrite (use old server config) or not (use new server config). It's intended for full server migrations.

    No ETA as yet. But the first folks to get access will be Centmin Mod Premium users via the private Centmin Mod Premium user forum when it does become publicly available ready for public testing.
     
  5. negative

    negative Active Member

    415
    50
    28
    Apr 11, 2015
    Ratings:
    +98
    Local Time:
    5:48 AM
    1.9.10
    10.1.11
    So new menu (21) does snapshot of server almost right ?

    It is perfect for that If we have seriously problem or fault on current centminmod installed server, then we can restore the all files including configurations to fresh installed another new centminmod server right ?

    What comes with backup & restore ? And what are the important points like should be php, nginx, mariadb versions are same ? or what about csf firewall or other configurations.

    Can you explain the procedure for clone/move running centminmod server to new one ? What are the important points? @eva2000
     
  6. diy

    diy Member

    50
    32
    18
    Jan 14, 2019
    USA
    Ratings:
    +48
    Local Time:
    10:48 PM
    nginx 1.19.x
    MariaDB 10.4.x
    This is really, really big news...! I am pretty excited about this announcement!
     
  7. eva2000

    eva2000 Administrator Staff Member

    50,869
    11,786
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,239
    Local Time:
    1:48 PM
    Nginx 1.25.x
    MariaDB 10.x
    software versions aren't transferred over only data and config files for some of the following
    • /root/tools, /root/.wp-cli, /root/wpcli directory, persistent config file /etc/centminmod/custom_config.inc (if detected)
    • acme.sh letsencrypt /root/.acme.sh (if detected)
    • nginx server, nginx letsencrypt ssl certs, vhost config files/nginx vhost data files
    • php-fpm config files (optionally)
    • mariadb mysql data + mysql users
    • redis server data directory (if detected)
    • elasticsearch server data directory (if detected)
    • pure-ftpd virtual ftp user database
    CSF Firewall I haven't decided on the specifics, probably just migrate over /etc/csf/csf.allow, /etc/csf/csf.deny /etc/csf/csf.ignore, /etc/csf/csf.pignore, /etc/csf/csf.dyndns, /etc/csf/csf.redirect, /etc/csf/regex.custom.pm, /etc/csf/csfpre.sh (if exists) as CSF has conditional support for IPSET and destination server might not have IPSET enabled/supported so /etc/csf/csf.conf straight copy over might not be ideal or have some logic to only transfer port listing etc. Like
    Code (Text):
    egrep '^TCP_|^TCP6_|^UDP_|^UDP6' /etc/csf/csf.conf
    TCP_IN = "20,21,22,25,53,80,110,143,161,443,465,587,993,995,1110,1186,1194,81,9418,30001:50011"
    TCP_OUT = "8080,2525,465,1110,1194,9418,20,21,22,25,53,80,110,113,443,587,993,995"
    UDP_IN = "67,68,1110,33434:33534,20,21,53"
    UDP_OUT = "67,68,1110,33434:33534,20,21,53,113,123"
    TCP6_IN = "20,21,22,25,53,80,110,143,161,443,465,587,993,995,1110,1186,1194,81,9418,30001:50011"
    TCP6_OUT = "8080,2525,465,20,21,22,25,53,80,110,113,443,587,993,995"
    UDP6_IN = "20,21,53"
    UDP6_OUT = "20,21,53,113,123"
    

    I posted an early example of a verbose look at what gets backed up at centmin.sh menu option 21 data transfer's backup routine verbose example output demo so you get an idea. If there's directories or files you think should or shouldn't be backed up, please let me know.
     
    Last edited: Nov 2, 2019