Beta Branch Centmin Mod Backups - Attic Deduplication Backups

Looking for some help to install it and test it as it seems the debian instructions for dependencies are not the same as on Centos 64Bit :

for example:

Code:

[[email protected] ~]# yum install libacl1 liblz4-1
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: ftp.plusline.de
* extras: ftp.plusline.de
* updates: mirror.imt-systems.com
No package libacl1 available.
No package liblz4-1 available.
Error: Nothing to do

 

Attic causes data corruption on large repositories

Comparison of Attic vs Bup vs Obnam

 

For the borg install you give this your post:

After running the pip install virtualenv I got this:

Code:

You are using pip version 7.1.2, however version 8.0.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

I'm not a programmer - so can I just executed that statement before I go on with the rest of those pip install commands?

 

It was - thanks:

Code:

[[email protected] tools]# pip install --upgrade pip
Collecting pip
  Downloading pip-8.0.2-py2.py3-none-any.whl (1.2MB)
    100% |████████████████████████████████| 1.2MB 515kB/s
Installing collected packages: pip
  Found existing installation: pip 7.1.2
    Uninstalling pip-7.1.2:
      Successfully uninstalled pip-7.1.2
Successfully installed pip-8.0.2

 

So - after install of newer python on 09beta1 - I use the @eva2000 borg guide for install.. After that I created a new virtual disk for storing of local backup while testing it. The goal is for sure - remote storage like nfs or perhaps something like sshfs. Got the disk mounted - execute borg backup on my XF install.. Added -v --stats as parameters and got this for you:

Code:

[[email protected] tools]# borg-env/bin/borg create -v --stats --compression lz4 /backupstore/borgstorage::mt-backup-`date +%Y-%m-%d` /home/nginx/domains/yourdomin/public
Using a pure-python msgpack! This will result in lower performance.
reading files cache
processing files
------------------------------------------------------------------------------
Archive name: mt-backup-2016-01-25
Archive fingerprint: 80e9a4ae743057277901e21465a0c756df7c446594f4102603ff66a07dcf12bc
Start time: Mon Jan 25 21:35:16 2016
End time: Mon Jan 25 21:36:14 2016
Duration: 57.93 seconds
Number of files: 8622
------------------------------------------------------------------------------
                       Original size      Compressed size    Deduplicated size
This archive:                1.87 GB              1.83 GB              1.82 GB
All archives:                1.87 GB              1.83 GB              1.82 GB

                       Unique chunks         Total chunks
Chunk index:                   34640                35879
------------------------------------------------------------------------------

So all is fine for now.. So @eva2000 - again, thanks for your guide, that got me started..

 

I'm playing with Attic mount and I got this

fuse: device not found, try 'modprobe fuse' first
attic: Exiting with failure status due to previous errors

I tried modprobe fuse but still gets the same error when mounting

 

The last update from me about this borg backup. I got fuse-sshfs installed - make a share on another server - did sshfs to that and mounted it 'here' on this server.. Same files, same server but remote storages by sshfs:

Code:

[[email protected] tools]# borg-env/bin/borg create -v --stats --compression lz4 /backupstore/borgremote/borgstorage::mt-backup-`date +%Y-%m-%d` /home/nginx/domains/yourdomain/public
Using a pure-python msgpack! This will result in lower performance.
reading files cache
processing files
------------------------------------------------------------------------------
Archive name: mt-backup-2016-01-25
Archive fingerprint: 394d878ceeeb20556c329e8f690622a679801f6edd854eed31a6d885e81c584d
Start time: Mon Jan 25 21:59:56 2016
End time: Mon Jan 25 22:01:05 2016
Duration: 1 minutes 9.14 seconds
Number of files: 8622
------------------------------------------------------------------------------
                       Original size      Compressed size    Deduplicated size
This archive:                1.87 GB              1.83 GB              1.82 GB
All archives:                1.87 GB              1.83 GB              1.82 GB

                       Unique chunks         Total chunks
Chunk index:                   34640                35879
------------------------------------------------------------------------------

So the local storages duration against remote storage duration is:

Local -Duration: 57.93 seconds
Remote - Duration: 1 minutes 9.14 seconds

Not much lost in time - allright - its only 2 GB and without DB. So now comes a cron with mysqldump first and then backup of files.

 

Yes OpenVZ. Oh snap.

 

Once again, I want to plug Obnam as its simple install on Centos and very reliable history on repo data... its production ready (not a beta quality software)... Dev used to work at Canonical... Obnam - backup program

Would love to see this integrated with C.M.M. Some discussion here: https://community.centminmod.com/threads/anyone-tried-rsnapshot-alternative-obnam.5688

Easy install..

Code:

yum install obnam fuse python-fuse

 

this is offtopic since this is an attic thread but the feedback that I've seen regarding Obnam is that it's too slow in creating and restoring. Take this for example

obnam forget being really slow (4 hours to delete a single generation)

@ethanpil

 

So does Attic create corrupted backups on huge files or not?

 

I don't think you can get the right answer to that in here .. Maybe take a look on the maillist archive - [attic] archives