Learn about Centmin Mod LEMP Stack today
Become a Member

Sysadmin Best choices to host backup servers

Discussion in 'System Administration' started by Andy, Jan 24, 2018.

  1. Andy

    Andy Premium Member Premium Member

    419
    60
    28
    Aug 6, 2014
    Ratings:
    +83
    Local Time:
    1:33 AM
    I have to make a choice between these options and want to see what is the best choice
    • Getting the FTP backup server from my host (reliablesite)
    100 GB FTP Backup Space $3.75 / month
    300 GB FTP Backup Space $10.50 / month
    500 GB FTP Backup Space $15.00 / month
    750 GB FTP Backup Space $22.50 / month
    1000 GB FTP Backup Space $28.50 / month
    1500 GB FTP Backup Space $37.50 / month
    2000 GB FTP Backup Space $45.00 / month

    Backup spaces include unlimited transfer and are stored on a different physical server with Hardware RAID6 redundancy.
    • Backupsy server
    500GB for $20. Essentially $10 for each 250GB. It does not have CentOS 7 but the hardware is RAID 50.
    • Some other cheap VPS servers
     
  2. rdan

    rdan Premium Member Premium Member

    4,255
    1,034
    113
    May 25, 2014
    Ratings:
    +1,486
    Local Time:
    1:33 PM
    Mainline
    10.2
  3. Andy

    Andy Premium Member Premium Member

    419
    60
    28
    Aug 6, 2014
    Ratings:
    +83
    Local Time:
    1:33 AM
  4. rdan

    rdan Premium Member Premium Member

    4,255
    1,034
    113
    May 25, 2014
    Ratings:
    +1,486
    Local Time:
    1:33 PM
    Mainline
    10.2
    • 1TB NVMe SSD Disk
    • 1 cpu core
    • 512mb RAM VPS
    paying $84 per year.

    700-800gb as of the moment.

    Rsync full files+DB.
    Retain separate/duplicates on the Backup server every 5 days.
     
  5. eva2000

    eva2000 Administrator Staff Member

    36,020
    7,901
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,183
    Local Time:
    3:33 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    These days I mainly use Amazon S3 with custom backup scripts last I checked storing around ~2.5 TB (2500 GB) of backups at ~US$24/month with Amazon S3 high availability and redundancy :)
     
    • Like Like x 1
    • Informative Informative x 1
  6. Andy

    Andy Premium Member Premium Member

    419
    60
    28
    Aug 6, 2014
    Ratings:
    +83
    Local Time:
    1:33 AM
    Thanks for the suggestions. Since I already have S3, may as well use it.
    I started reading on a few guides on making script to backup to S3. They are very basic so I wonder if you have any specific things that we do backing up from a centminmod server. Understand if you can't share details of your custom scripts, hihihi.

    Also, do you zip the sql database and files before sending to S3?
     
  7. wmtech

    wmtech Member

    67
    17
    8
    Jul 22, 2017
    Ratings:
    +41
    Local Time:
    7:33 AM
    You can get the backup script for free as a premium member. ;)
     
    • Like Like x 2
  8. Andy

    Andy Premium Member Premium Member

    419
    60
    28
    Aug 6, 2014
    Ratings:
    +83
    Local Time:
    1:33 AM
    May as well do it to support @eva2000 :)
     
    • Like Like x 1
  9. eva2000

    eva2000 Administrator Staff Member

    36,020
    7,901
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,183
    Local Time:
    3:33 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Cheers thanks for the support :D

    Scripts are similar to dbbackup.sh MariaDB - dbbackup.sh - quick mysql database backups for Centmin Mod stack

    Always compress backups using multi-thread compression tools - hence my constant testing Sysadmin - Compression Comparison Benchmarks: zstd vs brotli vs pigz vs bzip2 vs xz etc :D
     
  10. pamamolf

    pamamolf Well-Known Member

    3,113
    295
    83
    May 31, 2014
    Ratings:
    +530
    Local Time:
    8:33 AM
    Nginx-1.13.x
    MariaDB 10.1.x
    It will be good to have an alternative script for bigger databases than using mysqldump :)
     
  11. Andy

    Andy Premium Member Premium Member

    419
    60
    28
    Aug 6, 2014
    Ratings:
    +83
    Local Time:
    1:33 AM
    I read that whole thread and since last update was in 2016, I'd like to see if it's applicable to my use case.

    my main server is running latest centminmod and the largest with about 50GB home directory and 250MB database.

    There are several servers that i manage and do not have centminmod installed which i like to backup as well.

    How will this script work in my case?
     
  12. eva2000

    eva2000 Administrator Staff Member

    36,020
    7,901
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,183
    Local Time:
    3:33 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    it's just that good that it works without needing updates usually as alot of work goes into my custom backup scripts - can equal amount of detail and thought as centmin mod itself!

    dbbackup.sh has a threshold of days (DEL_THRESHOLD=31 saves 31 days of backups by default) to save how many compressed copies of your mysql databases so you'd have to and adjust DEL_THRESHOLD variable and work out how many copies you can save as the database backups are saved to /home/nginx/domains/yourdomain.com/backup directory so will need to ensure /home has enough free disk space

    you can control compression method used as well - looks like dbbackup.sh update required now as centos 7 has pxz available too now via EPEL yum repo
    Code (Text):
    COMPRESS='y'                # gzip compress sql backups using pigz
    COMPRESS_METHOD='pigz'      # pigz, pbzip2, lbzip2 or CentOS 6 only available pxz default is pigz
    

    dbbackup.sh is only for centminmod based servers so non-centmin mod servers wouldn't work with
     
  13. eva2000

    eva2000 Administrator Staff Member

    36,020
    7,901
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,183
    Local Time:
    3:33 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    FYI, Centmin Mod Premium members have a dedicated private Premium member forums with stickied dbbackup.sh thread with more up to date change log i.e.

    last few updates
     
  14. Andy

    Andy Premium Member Premium Member

    419
    60
    28
    Aug 6, 2014
    Ratings:
    +83
    Local Time:
    1:33 AM
    I read that it has remote mysql backup so I was thinking of running the script on my main server and still get DB backups of other remote servers?
     
  15. eva2000

    eva2000 Administrator Staff Member

    36,020
    7,901
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +12,183
    Local Time:
    3:33 PM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Yes in theory you should be able to do that. Though requirements are server running dbbackup.sh need to have centmin mod installed and site vhost setup on it for /home/nginx/domains/yourdomain.com/backup/mysql saved backups.
     
..