Discover Centmin Mod today
Register Now

juicefs metadata backup

Discussion in 'Add Ons' started by dcg, Mar 18, 2024.

  1. dcg

    dcg Member

    67
    24
    8
    Oct 17, 2015
    Florida, USA
    Ratings:
    +49
    Local Time:
    1:57 AM
    1.21.x
    10.3.x
    Question on the GitHub - centminmod/centminmod-juicefs: JuiceFS file system for S3 mount storage

    Juicefs does not do automatic metadata backup on Cloudflare R2. In your setup you show a backup script to run hourly. However, you suggest putting it into the R2 object store using the juicefs mount. In this case wouldn't the ability to access the metadata be dependent upon the metadata? Thus if you have a glitch with metadata you would be unable to reconstruct the metadata backup.

    If you're doing backup outside of the automatic I feel like you would need a direct right to object store via aws-cli: something like
    aws s3 cp source s3://$cfbackupbucket --profile r2 --endpoint-url=$cfurl


    Thus you will actually have access to backup if things go wrong. Please let me know if this seems correct.
    -David
     
  2. eva2000

    eva2000 Administrator Staff Member

    54,547
    12,221
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,790
    Local Time:
    4:57 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Yeah ideally you want to put JuiceFS metadata backups outside of the Cloudflare R2 JuiceFS mount i.e. a separate Cloudflare R2 storage bucket or other S3 storage.