/ Register

Get the most out of your Centmin Mod LEMP stack
Become a Member

Sysadmin Best choices to host backup servers

Discussion in 'System Administration' started by Andy, Jan 24, 2018.

Previous Thread Next Thread
Loading...
  1. Jan 24, 2018 #1
    Andy

    Andy Active Member

    546
    90
    28
    Aug 6, 2014
    Ratings:
    +134
    Local Time:
    8:15 PM
    I have to make a choice between these options and want to see what is the best choice
    • Getting the FTP backup server from my host (reliablesite)
    100 GB FTP Backup Space $3.75 / month
    300 GB FTP Backup Space $10.50 / month
    500 GB FTP Backup Space $15.00 / month
    750 GB FTP Backup Space $22.50 / month
    1000 GB FTP Backup Space $28.50 / month
    1500 GB FTP Backup Space $37.50 / month
    2000 GB FTP Backup Space $45.00 / month

    Backup spaces include unlimited transfer and are stored on a different physical server with Hardware RAID6 redundancy.
    • Backupsy server
    500GB for $20. Essentially $10 for each 250GB. It does not have CentOS 7 but the hardware is RAID 50.
    • Some other cheap VPS servers
     
  2. Jan 24, 2018 #2
    rdan

    rdan Well-Known Member

    5,452
    1,418
    113
    May 25, 2014
    Ratings:
    +2,212
    Local Time:
    9:15 AM
    Mainline
    10.2
  3. Jan 24, 2018 #3
    Andy

    Andy Active Member

    546
    90
    28
    Aug 6, 2014
    Ratings:
    +134
    Local Time:
    8:15 PM
  4. Jan 24, 2018 #4
    rdan

    rdan Well-Known Member

    5,452
    1,418
    113
    May 25, 2014
    Ratings:
    +2,212
    Local Time:
    9:15 AM
    Mainline
    10.2
    • 1TB NVMe SSD Disk
    • 1 cpu core
    • 512mb RAM VPS
    paying $84 per year.

    700-800gb as of the moment.

    Rsync full files+DB.
    Retain separate/duplicates on the Backup server every 5 days.
     
  5. Jan 24, 2018 #5
    eva2000

    eva2000 Administrator Staff Member

    58,905
    12,490
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +19,122
    Local Time:
    11:15 AM
    Nginx 1.31.x
    MariaDB 10.x/11.4+/12.3+
    These days I mainly use Amazon S3 with custom backup scripts last I checked storing around ~2.5 TB (2500 GB) of backups at ~US$24/month with Amazon S3 high availability and redundancy :)
     
  6. Jan 25, 2018 #6
    Andy

    Andy Active Member

    546
    90
    28
    Aug 6, 2014
    Ratings:
    +134
    Local Time:
    8:15 PM
    Thanks for the suggestions. Since I already have S3, may as well use it.
    I started reading on a few guides on making script to backup to S3. They are very basic so I wonder if you have any specific things that we do backing up from a centminmod server. Understand if you can't share details of your custom scripts, hihihi.

    Also, do you zip the sql database and files before sending to S3?
     
  7. Jan 25, 2018 #7
    wmtech

    wmtech Active Member

    187
    44
    28
    Jul 22, 2017
    Ratings:
    +139
    Local Time:
    3:15 AM
    You can get the backup script for free as a premium member. ;)
     
  8. Jan 25, 2018 #8
    Andy

    Andy Active Member

    546
    90
    28
    Aug 6, 2014
    Ratings:
    +134
    Local Time:
    8:15 PM
    May as well do it to support @eva2000 :)
     
  9. Jan 25, 2018 #9
    eva2000

    eva2000 Administrator Staff Member

    58,905
    12,490
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +19,122
    Local Time:
    11:15 AM
    Nginx 1.31.x
    MariaDB 10.x/11.4+/12.3+
    Cheers thanks for the support :D

    Scripts are similar to dbbackup.sh MariaDB - dbbackup.sh - quick mysql database backups for Centmin Mod stack

    Always compress backups using multi-thread compression tools - hence my constant testing Sysadmin - Compression Comparison Benchmarks: zstd vs brotli vs pigz vs bzip2 vs xz etc :D
     
  10. Jan 25, 2018 #10
    pamamolf

    pamamolf Well-Known Member

    4,125
    429
    83
    May 31, 2014
    Ratings:
    +841
    Local Time:
    4:15 AM
    Nginx-1.29.x
    MariaDB 10.6.x
    It will be good to have an alternative script for bigger databases than using mysqldump :)
     
  11. Jan 25, 2018 #11
    Andy

    Andy Active Member

    546
    90
    28
    Aug 6, 2014
    Ratings:
    +134
    Local Time:
    8:15 PM
    I read that whole thread and since last update was in 2016, I'd like to see if it's applicable to my use case.

    my main server is running latest centminmod and the largest with about 50GB home directory and 250MB database.

    There are several servers that i manage and do not have centminmod installed which i like to backup as well.

    How will this script work in my case?
     
  12. Jan 25, 2018 #12
    eva2000

    eva2000 Administrator Staff Member

    58,905
    12,490
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +19,122
    Local Time:
    11:15 AM
    Nginx 1.31.x
    MariaDB 10.x/11.4+/12.3+
    it's just that good that it works without needing updates usually as alot of work goes into my custom backup scripts - can equal amount of detail and thought as centmin mod itself!

    dbbackup.sh has a threshold of days (DEL_THRESHOLD=31 saves 31 days of backups by default) to save how many compressed copies of your mysql databases so you'd have to and adjust DEL_THRESHOLD variable and work out how many copies you can save as the database backups are saved to /home/nginx/domains/yourdomain.com/backup directory so will need to ensure /home has enough free disk space

    you can control compression method used as well - looks like dbbackup.sh update required now as centos 7 has pxz available too now via EPEL yum repo
    Code (Text):
    COMPRESS='y'                # gzip compress sql backups using pigz
COMPRESS_METHOD='pigz'      # pigz, pbzip2, lbzip2 or CentOS 6 only available pxz default is pigz

    dbbackup.sh is only for centminmod based servers so non-centmin mod servers wouldn't work with
     
  13. Jan 25, 2018 #13
    eva2000

    eva2000 Administrator Staff Member

    58,905
    12,490
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +19,122
    Local Time:
    11:15 AM
    Nginx 1.31.x
    MariaDB 10.x/11.4+/12.3+
    FYI, Centmin Mod Premium members have a dedicated private Premium member forums with stickied dbbackup.sh thread with more up to date change log i.e.

    last few updates
     
  14. Jan 25, 2018 #14
    Andy

    Andy Active Member

    546
    90
    28
    Aug 6, 2014
    Ratings:
    +134
    Local Time:
    8:15 PM
    I read that it has remote mysql backup so I was thinking of running the script on my main server and still get DB backups of other remote servers?
     
  15. Jan 25, 2018 #15
    eva2000

    eva2000 Administrator Staff Member

    58,905
    12,490
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +19,122
    Local Time:
    11:15 AM
    Nginx 1.31.x
    MariaDB 10.x/11.4+/12.3+
    Yes in theory you should be able to do that. Though requirements are server running dbbackup.sh need to have centmin mod installed and site vhost setup on it for /home/nginx/domains/yourdomain.com/backup/mysql saved backups.
     
Previous Thread Next Thread
Loading...

.