/ Register

Welcome to Centmin Mod Community
Register Now

Beta Branch addons/rclone.sh discussion thread

Discussion in 'Beta release code' started by eva2000, Oct 28, 2016.

Tags:
Previous Thread Next Thread
Loading...
Page 2 of 2
  1. Oct 30, 2016 #21
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    copied the 2 posts to rclone backup scripts | Centmin Mod Community leaving the originals here for reference :)

    this thread is for addons/rclone.sh usage itself i.e. setup of rclone and sync/opt options in rclone.sh :)
     
  2. Oct 30, 2016 #22
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    Just realised acmetool.sh integration Letsencrypt - Official acmetool.sh testing thread for Centmin Mod 123.09beta01 | Centmin Mod Community could utilise rclone.sh for syncing letsencrypt ssl certs for multiple server clusters !

    It also syncs/copies them via rclone.sh copy and sync options as letsencrypts ssl certs are within /usr/local/nginx/conf/ssl :D

    Edit: made a separate rclone.sh copyssl and syncssl option just for /usr/local/nginx/conf/ssl Beta Branch - addons/rclone.sh separate copyssl and syncssl options added | Centmin Mod Community :)
     
    Last edited: Oct 31, 2016
  3. Apr 13, 2017 #23
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
  4. Apr 13, 2017 #24
    Sunka

    Sunka Well-Known Member

    1,148
    319
    83
    Oct 31, 2015
    Pula, Croatia
    Ratings:
    +517
    Local Time:
    10:07 PM
    Nginx 1.17.9
    MariaDB 10.3.22
    everyday I use rclone for moving downloaded videos from server to gdrive.
    I copy 20GB files from server to gdrive in couple of minutes
     
  5. Apr 13, 2017 #25
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    sweet very nice :)

    Do you know the average speed of transfers you're getting ?
     
  6. Apr 13, 2017 #26
    Sunka

    Sunka Well-Known Member

    1,148
    319
    83
    Oct 31, 2015
    Pula, Croatia
    Ratings:
    +517
    Local Time:
    10:07 PM
    Nginx 1.17.9
    MariaDB 10.3.22
    About 5gb in minute I think, maybe faster.
    But key is not in number of files, but in how big files are (I think).
    You will be faster transfer 10 files each 500 MB than 500 files, each 1 mb
     
  7. Apr 13, 2017 #27
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    ~85MB/s nice and decent :)

    Might need to test Google Drive via rclone more myself to see :D
     
  8. Apr 13, 2017 #28
    apidevlab

    apidevlab Member

    91
    33
    18
    Mar 22, 2016
    /dev/null
    Ratings:
    +58
    Local Time:
    9:07 PM
    1.11.1
    5.2.14-122
    I got the email before and have been having a play all be it basic for the past few hours. I have been using B2 (which gives 10GB FREE) and so far have had good results. 1 disadvantage (compared to dropbox/google) is there is no way to view logs on line via B2 just file names)

    What sort of feedback are you seeking at this point?

    It's a big leap but adding the ability to install, setup, test and configure (setup sync cronjobs) would be a great addition for the future (via the centminmod menu)

    Indeed the way addons etc are progressing you may need to start looking at sub menus :)
     
    Last edited: Apr 13, 2017
  9. Apr 13, 2017 #29
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    feedback in terms of if it's working or issues they run into for setup or usage :)

    yeah the menu system in future needs a revamp - already have plans for that :D
     
  10. Apr 14, 2017 #30
    apidevlab

    apidevlab Member

    91
    33
    18
    Mar 22, 2016
    /dev/null
    Ratings:
    +58
    Local Time:
    9:07 PM
    1.11.1
    5.2.14-122
    I have to say I have been really impressed. It's super easy to use and I managed to backup 6/7 vps to B2 with no issues at all. Indeed I have now moved further down the thread to the ssl certs etc. Possibilities are infinite.

    Slightly off topic but wonder if you have had a play around with minio?

    Worth a look Minio

    also Load Balancing Distributed Cloud Storage with Minio and NGINX Plus
     
  11. Apr 14, 2017 #31
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    Great to hear and thanks for testing and feedback. Indeed the possibilities are infinite with rclone - just so many cloud storage providers to test out :)

    not yet, something for the ever growing to-do list :)
     
  12. May 19, 2017 #32
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    Looks like Amazon CloudDrive might have banned rclone usage Nick Craig-Wood on Twitter
     
  13. May 25, 2017 #33
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    rclone ban by Amazon makes the news rounds Amazon Drive bans rclone storage client

    sounds problematic
    forums https://forum.rclone.org/t/rclone-has-been-banned-from-amazon-drive/2314
     
    Last edited: May 25, 2017
  14. Jun 4, 2017 #34
    Sunka

    Sunka Well-Known Member

    1,148
    319
    83
    Oct 31, 2015
    Pula, Croatia
    Ratings:
    +517
    Local Time:
    10:07 PM
    Nginx 1.17.9
    MariaDB 10.3.22
    Last 2 days I have problem with uploading files to Google drive with Rcone.
    55 MB was a speed before, now it is about 200 KB per second

    Any thoughts?
    Also, how to update Rclone to newest version?
     
  15. Jun 4, 2017 #35
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    Code (Text):
    addons/rclone.sh update

    as to speed no idea could be your server end or Google
     
  16. Oct 18, 2018 #36
    Mrbo

    Mrbo Member

    113
    7
    18
    Jun 17, 2018
    Ratings:
    +7
    Local Time:
    4:07 AM
    Whats the difference between this method and rsnapshot + backupsy? Which method should I choose if I want to do easy backups / restore similar to linode and vultr?
     
  17. Oct 19, 2018 #37
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    different clients and rsnapshot is a pull based client while rclone is push based so depends on which server initiates backups - source or destination
     
  18. Oct 19, 2018 #38
    Mrbo

    Mrbo Member

    113
    7
    18
    Jun 17, 2018
    Ratings:
    +7
    Local Time:
    4:07 AM
    Ok, I looked into them and I think I will go with rclone atm since it seems more noob friendly and since it seems cheaper with Google Drive offering 1TB for $10 compared to backupsy $40.

    What I dont really understand is how is the backup process working? In your example you backed up log files, but if I want to backup the whole server do I have to add every folder, or is there a way to pack and compress the server or how does it work?
     
  19. Oct 27, 2018 #39
    Mrbo

    Mrbo Member

    113
    7
    18
    Jun 17, 2018
    Ratings:
    +7
    Local Time:
    4:07 AM
    Any suggestions for which folders to include? Or can I do a complete backup of everything like Linode or Vultr?
     
  20. Oct 27, 2018 #40
    eva2000

    eva2000 Administrator Staff Member

    47,851
    10,920
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,961
    Local Time:
    7:07 AM
    Nginx 1.21.x
    MariaDB 10.x
    Check out migration guides for general gist of what needs backing up. For moving site data there's 2 general guides where the principles & steps of backing up and moving data is the same just slightly different for
    1. Moving Centmin Mod site data to another Centmin Mod server
    2. Moving cPanel/WHM site data to Centmin Mod server
    Those guides move alot more than just the site(s) in question but config files etc. You can use your own best judgement as to the config files and whether you want to move them or just use the fresh server setup Centmin Mod config files as they get auto optimised for the server Centmin Mod initially installed on.

    If your old site isn't centmin mod or cpanel/whm based, then those guides won't be 100% applicable. But the general overview of what needs moving and where everything is structured in Centmin Mod LEMP environment is worth reading up on.

    Also official site configuration files page explains the Centmin Mod structure of where the important files are so you can decide on what to backup.
     
Previous Thread Next Thread
Loading...
Page 2 of 2

.