Get the most out of your Centmin Mod LEMP stack
Become a Member

DigitalOcean DigitalOcean Introduces Block Storage Support

Discussion in 'Virtual Private Server (VPS) hosting' started by eva2000, Jul 14, 2016.

  1. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    DigitalOcean has announced a new offering for Block Storage to add more space to additional VPS droplets Block Storage: More Space to Scale | DigitalOcean
     
  2. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
  3. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
    Nice, nice FRA1 is next with block storage available.
    I will buy extra space but I am not sure how to integrate it with my existing droplet.
    I read tutorial linked in previous post, but I am not able to understand will new data (attachments) from my forum automatically save to that new mounted space after main disk is get full?
     
  4. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    No it won't automatically save your existing forum files at all as xenforo wouldn't see the new mounted block storage. You need to format the mounted new block storage device How To Partition and Format DigitalOcean Block Storage Volumes in Linux | DigitalOcean and do what you will with it - like mount to path of attachment directory or mount bind or symlink methods etc.

    though seeing as block storage is new, i'd probably testing it out and wait and see how stable it is before doing something as important as using it for forum attachments
     
    • Like Like x 1
  5. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
    When add that new hard space to my droplet, just want newer attachments save on that hard, but old one stay on original hard disk.
    Do not know is that possible, or all attachments have to be on one disk drive?
     
  6. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    forum attachments would need to be within one directory not both (old and new)
     
  7. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
    So I am stuck :cry:
     
  8. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
    Sulution is to move all internal_data and data folder to new disk and change paths for them in config.php

    reading this:
    leading to this:

    I am not sure for all of this, to many configuration in creating/adding/mounting new disk into server
     
    • Informative Informative x 1
  9. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    yeah best to ask on xenforo forum to be 100% sure of config.php changes needed
     
    • Agree Agree x 1
  10. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
  11. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    • Agree Agree x 1
  12. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24

    Just want to confirm that above procedure is valid.
    I have bought 100GB volume on Digital Ocean, mounted on my server and move internal_data folder and data folder to that new volume.
    Symlinks working OK, Xenforo working OK, attachments are working OK.
     
  13. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    looks ok.. but back up ! back up ! and back up !
     
    • Friendly Friendly x 1
  14. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
    I do backup with rsnapshot to another server (Ramnode) every day (keep last 5 of them).
    Just a question @eva2000, if I told to backup one folder (and every file and folder inside), would it backup symlinks folders too, or I have to rsync absolute path?
     
  15. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    see rsync help docs
    Code (Text):
    rsync -h
    rsync  version 3.0.9  protocol version 30
    Copyright (C) 1996-2011 by Andrew Tridgell, Wayne Davison, and others.
    Web site: http://rsync.samba.org/
    Capabilities:
        64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
        socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
        append, ACLs, xattrs, iconv, symtimes
    
    rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
    are welcome to redistribute it under certain conditions.  See the GNU
    General Public Licence for details.
    
    rsync is a file transfer program capable of efficient remote update
    via a fast differencing algorithm.
    
    Usage: rsync [OPTION]... SRC [SRC]... DEST
      or   rsync [OPTION]... SRC [SRC]... [USER@]HOST:DEST
      or   rsync [OPTION]... SRC [SRC]... [USER@]HOST::DEST
      or   rsync [OPTION]... SRC [SRC]... rsync://[USER@]HOST[:PORT]/DEST
      or   rsync [OPTION]... [USER@]HOST:SRC [DEST]
      or   rsync [OPTION]... [USER@]HOST::SRC [DEST]
      or   rsync [OPTION]... rsync://[USER@]HOST[:PORT]/SRC [DEST]
    The ':' usages connect via remote shell, while '::' & 'rsync://' usages connect
    to an rsync daemon, and require SRC or DEST to start with a module name.
    
    Options
     -v, --verbose               increase verbosity
     -q, --quiet                 suppress non-error messages
         --no-motd               suppress daemon-mode MOTD (see manpage caveat)
     -c, --checksum              skip based on checksum, not mod-time & size
     -a, --archive               archive mode; equals -rlptgoD (no -H,-A,-X)
         --no-OPTION             turn off an implied OPTION (e.g. --no-D)
     -r, --recursive             recurse into directories
     -R, --relative              use relative path names
         --no-implied-dirs       don't send implied dirs with --relative
     -b, --backup                make backups (see --suffix & --backup-dir)
         --backup-dir=DIR        make backups into hierarchy based in DIR
         --suffix=SUFFIX         set backup suffix (default ~ w/o --backup-dir)
     -u, --update                skip files that are newer on the receiver
         --inplace               update destination files in-place (SEE MAN PAGE)
         --append                append data onto shorter files
         --append-verify         like --append, but with old data in file checksum
     -d, --dirs                  transfer directories without recursing
     -l, --links                 copy symlinks as symlinks
     -L, --copy-links            transform symlink into referent file/dir
         --copy-unsafe-links     only "unsafe" symlinks are transformed
         --safe-links            ignore symlinks that point outside the source tree
     -k, --copy-dirlinks         transform symlink to a dir into referent dir
     -K, --keep-dirlinks         treat symlinked dir on receiver as dir
     -H, --hard-links            preserve hard links
     -p, --perms                 preserve permissions
     -E, --executability         preserve the file's executability
         --chmod=CHMOD           affect file and/or directory permissions
     -A, --acls                  preserve ACLs (implies --perms)
     -X, --xattrs                preserve extended attributes
     -o, --owner                 preserve owner (super-user only)
     -g, --group                 preserve group
         --devices               preserve device files (super-user only)
         --copy-devices          copy device contents as regular file
         --specials              preserve special files
     -D                          same as --devices --specials
     -t, --times                 preserve modification times
     -O, --omit-dir-times        omit directories from --times
         --super                 receiver attempts super-user activities
         --fake-super            store/recover privileged attrs using xattrs
     -S, --sparse                handle sparse files efficiently
     -n, --dry-run               perform a trial run with no changes made
     -W, --whole-file            copy files whole (without delta-xfer algorithm)
     -x, --one-file-system       don't cross filesystem boundaries
     -B, --block-size=SIZE       force a fixed checksum block-size
     -e, --rsh=COMMAND           specify the remote shell to use
         --rsync-path=PROGRAM    specify the rsync to run on the remote machine
         --existing              skip creating new files on receiver
         --ignore-existing       skip updating files that already exist on receiver
         --remove-source-files   sender removes synchronized files (non-dirs)
         --del                   an alias for --delete-during
         --delete                delete extraneous files from destination dirs
         --delete-before         receiver deletes before transfer, not during
         --delete-during         receiver deletes during the transfer
         --delete-delay          find deletions during, delete after
         --delete-after          receiver deletes after transfer, not during
         --delete-excluded       also delete excluded files from destination dirs
         --ignore-errors         delete even if there are I/O errors
         --force                 force deletion of directories even if not empty
         --max-delete=NUM        don't delete more than NUM files
         --max-size=SIZE         don't transfer any file larger than SIZE
         --min-size=SIZE         don't transfer any file smaller than SIZE
         --partial               keep partially transferred files
         --partial-dir=DIR       put a partially transferred file into DIR
         --delay-updates         put all updated files into place at transfer's end
     -m, --prune-empty-dirs      prune empty directory chains from the file-list
         --numeric-ids           don't map uid/gid values by user/group name
         --timeout=SECONDS       set I/O timeout in seconds
         --contimeout=SECONDS    set daemon connection timeout in seconds
     -I, --ignore-times          don't skip files that match in size and mod-time
         --size-only             skip files that match in size
         --modify-window=NUM     compare mod-times with reduced accuracy
     -T, --temp-dir=DIR          create temporary files in directory DIR
     -y, --fuzzy                 find similar file for basis if no dest file
         --compare-dest=DIR      also compare destination files relative to DIR
         --copy-dest=DIR         ... and include copies of unchanged files
         --link-dest=DIR         hardlink to files in DIR when unchanged
     -z, --compress              compress file data during the transfer
         --compress-level=NUM    explicitly set compression level
         --skip-compress=LIST    skip compressing files with a suffix in LIST
     -C, --cvs-exclude           auto-ignore files the same way CVS does
     -f, --filter=RULE           add a file-filtering RULE
     -F                          same as --filter='dir-merge /.rsync-filter'
                                 repeated: --filter='- .rsync-filter'
         --exclude=PATTERN       exclude files matching PATTERN
         --exclude-from=FILE     read exclude patterns from FILE
         --include=PATTERN       don't exclude files matching PATTERN
         --include-from=FILE     read include patterns from FILE
         --files-from=FILE       read list of source-file names from FILE
     -0, --from0                 all *-from/filter files are delimited by 0s
     -s, --protect-args          no space-splitting; only wildcard special-chars
         --address=ADDRESS       bind address for outgoing socket to daemon
         --port=PORT             specify double-colon alternate port number
         --sockopts=OPTIONS      specify custom TCP options
         --blocking-io           use blocking I/O for the remote shell
         --stats                 give some file-transfer stats
     -8, --8-bit-output          leave high-bit chars unescaped in output
     -h, --human-readable        output numbers in a human-readable format
         --progress              show progress during transfer
     -P                          same as --partial --progress
     -i, --itemize-changes       output a change-summary for all updates
         --out-format=FORMAT     output updates using the specified FORMAT
         --log-file=FILE         log what we're doing to the specified FILE
         --log-file-format=FMT   log updates using the specified FMT
         --password-file=FILE    read daemon-access password from FILE
         --list-only             list the files instead of copying them
         --bwlimit=KBPS          limit I/O bandwidth; KBytes per second
         --write-batch=FILE      write a batched update to FILE
         --only-write-batch=FILE like --write-batch but w/o updating destination
         --read-batch=FILE       read a batched update from FILE
         --protocol=NUM          force an older protocol version to be used
         --iconv=CONVERT_SPEC    request charset conversion of filenames
         --checksum-seed=NUM     set block/file checksum seed (advanced)
     -4, --ipv4                  prefer IPv4
     -6, --ipv6                  prefer IPv6
         --version               print version number
    (-h) --help                  show this help (-h is --help only if used alone)
    
    Use "rsync --daemon --help" to see the daemon-mode command-line options.
    Please see the rsync(1) and rsyncd.conf(5) man pages for full documentation.
    See http://rsync.samba.org/ for updates, bug reports, and answers
    
     
  16. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
    Yep, I add L to rsnapshot.conf in rsync_short_args

    From old
    Code:
    rsync_short_args    -arpoz
    to
    Code:
    rsync_short_args    -arpozL
    I will see in morning after cron is ran, will the symlink folder will be backuped also
     
  17. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
  18. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    actually had it other way round for source to target -L
     
  19. Sunka

    Sunka Active Member

    932
    242
    43
    Oct 31, 2015
    Rijeka, Croatia
    Ratings:
    +392
    Local Time:
    4:09 PM
    Nginx 1.13.3
    MariaDB 10.1.24
    So it is L?
     
  20. eva2000

    eva2000 Administrator Staff Member

    30,945
    6,914
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,411
    Local Time:
    1:09 AM
    Nginx 1.13.x
    MariaDB 5.5
    just test with rsync dry run and see