Page 1 of 2 12 LastLast
Results 1 to 10 of 18

Thread: Looking for a backup soultion

  1. #1
    Join Date
    Dec 2008
    Location
    Montana, USA
    Posts
    669

    Default Looking for a backup soultion

    In the 15.3 repositories, there are quite a few backup options, but I can't decide on one. I used Duplicity for a while but it filled the drive with incremental files that required the original or full backup to be there. Which means I would have to clear the whole mess and start over every so often. I'm looking at storebackup but I'm afraid that it will disappear in the future as their web site is missing.

    I have four computers to backup and have a Synology NAS to use. Synology claims their backup system supports linux, but by linux they mean ubuntu (which is not linux in my book). They do have a rpm file but zypper, yast, nor rpm will acknolodge it so it's not a solution.

    SUSE must have something they use. I wonder what it is?

    So. I'm looking for recommendations.


    Bart

  2. #2
    Join Date
    Jun 2008
    Location
    Auckland, NZ
    Posts
    23,531
    Blog Entries
    1

    Default Re: Looking for a backup soultion

    Grsync (with SSH connectivity) might work for you. See this thread (post #13 onwards)...
    https://forums.opensuse.org/showthre...69#post3065169
    openSUSE Leap 15.3; KDE Plasma 5

  3. #3
    Join Date
    Jun 2008
    Location
    Netherlands
    Posts
    29,500

    Default Re: Looking for a backup soultion

    Looking at your space problem (which I do not understand complete), I use a method based on the fact that every backup taken, those files that are still the same are hard links to the same file in the other backup instances.

    I, e.g. make up to 10 different backups. When a File is changed between everyone of them taken, there are 10 different versions of them (of course), but when a file didn't change, there is only one version and it has 10 hard links, thus saving a lot of space.

    Based on cp -al and rsync.

    A ready made product is at https://rsnapshot.org, and can be installed from the standard OSS repo.

    It is written in bash, thus easy to adapt when you want that (that is what I did), but ready for use.

    Of course, the first backup made will take some time because each and every file must be copied. The next backup will first copy the directory tree, then make all the hard links, after hat rsync will copy only those files changed or new (and delete files that do not exist anymore, but remark, those file will still be on the older backup) and thus normally much quicker.
    Henk van Velden

  4. #4
    Join Date
    Feb 2010
    Location
    Germany
    Posts
    4,466

    Question Re: Looking for a backup soultion

    Quote Originally Posted by montana_suse_user View Post
    I have four computers to backup and have a Synology NAS to use. Synology claims their backup system supports linux, but by linux they mean ubuntu.
    Synology, QNAP, & Co. tend to use a customized Linux on their boxes – which supports NFS.
    • You don't mention which OS is running on the 4 boxes you want to backup – can you please indicate which OS(s) these boxes are running?

    For the Redmond stuff, they have a Samba server in their boxes – for Apple, they have something else as a solution.

    Back to Linux and, NFS …
    • What I tend to do is, to create a new directory tree in the NAS box, parallel to any user directories added by an administrator on the box.
    • A useable name for this new directory is “NFS” – owned by the NAS box's administrator user – usually “admin” even though, that user is often disabled for security reasons.
    • The “NFS” directory on the NAS is added to the box's NFS exports list – preferably as the one and only NFS export. It usually a good idea to setup the NAS box's NFS Server to support all known NFS versions – makes the openSUSE auto-mounter behave properly during the handshaking when the NFS clients auto-mount the NAS box's export.

    I use this with a QNAP NAS and, the openSUSE auto-mounter usually negotiates an NFS v4 mount …

    • I then create per Linux user a directory for each user below the NAS NFS directory – disable root_squash in the NAS box's “exports” file temporarily to allow root access from one of the NFS clients. Using root from one of the NFS clients, change the ownership, group and protections of the per user directories in the NAS box's NFS export directory – the NAS box doesn't need to know about these users – it simply accepts the UID and GID of the NFS clients – you just need to make sure that none of the NAS box's users (needed for the Samba world) have a UID and/or GID which conflicts with the Linux NFS client's users …
    • The NFS export of the NAS box should never be accessible by the Redmond/Samba world.

    Once the NAS box's NFS exports have been setup, simply NFS auto-mount from the Linux boxes to the NAS.
    • The Linux users can then simply copy their files to be backed up to the NAS box or, use rsync to automate the backups.

    The rsync commands I use from a batch file tend to look like this:
    Code:
    #!/bin/bash
    
    systemHostName=$(hostname --short)
    effectiveUserID=$(whoami)
    
    #
    # Cannot use -a --archive: both imply -rlptgoD
    # -g --group "preserve group" is possibly not supported by a QNAP TS-131P.
    #
    
    if [[ -d /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName ]]
    then
    
      echo "** .config/:"
      /usr/bin/rsync -rlpto --specials --backup --update --8-bit-output --omit-dir-times --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.config/ /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/dot.config
    
      echo "** .local/share/:"
      /usr/bin/rsync -rlpto --specials --backup --update --exclude=gegl-0.?/*** --exclude=gvfs-metadata/*** --exclude=flatpak/*** --8-bit-output --omit-dir-times --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.local/share/ /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/dot.localShare
    
      echo "** .mozilla/:"
      /usr/bin/rsync -rlpto --specials --backup --update --8-bit-output --omit-dir-times --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.mozilla/ /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/dot.mozilla
    
      echo "** User Files:"
      /usr/bin/rsync -rlpto --specials --backup --update --exclude=.* --exclude=.*/*** --exclude=public_html --8-bit-output --cvs-exclude --omit-dir-times --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/ /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/home
    
      echo "** User .* Files:"
      /usr/bin/rsync -lpto --specials --backup --update --8-bit-output --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.bashrc /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/home
      /usr/bin/rsync -lpto --specials --backup --update --8-bit-output --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.profile /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/home
      /usr/bin/rsync -lpto --specials --backup --update --8-bit-output --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.signature /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/home
      /usr/bin/rsync -lpto --specials --backup --update --8-bit-output --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.emacs /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/home
      /usr/bin/rsync -lpto --specials --backup --update --8-bit-output --omit-link-times --one-file-system --whole-file --progress --stats --human-readable /home/$effectiveUserID/.vimrc /mnt/NAS-001/NFS/$effectiveUserID/$systemHostName/home
      echo ""
    
    fi
    If you really want to, you can also explicitly backup Vim's backup and undo files – I usually place them in ‘~/.vim/tmp/’ …

    For Digital Camera files (only need one copy per camera per NAS) I tend use an rsync command like this –
    Code:
      echo "** Photos:"
      rsync -rlpto --specials --exclude=*.db --exclude=.directory --exclude=.dtrash/ --8-bit-output --cvs-exclude --omit-dir-times --omit-link-times --one-file-system --whole-file --progress --stats --human-readable --ignore-existing /home/$effectiveUserID/Bilder/ /mnt/NAS-001/NFS/$effectiveUserID/Photos
    Having written all that, especially for the case of photos, I'm tending to head off in the direction of large USB drives connected only when backing up …
    • I've never, ever, backed up sensitive files – such as KWallet files or, Home Banking files – on a NAS …

  5. #5
    Join Date
    Jun 2008
    Location
    Podunk
    Posts
    32,136
    Blog Entries
    15

    Default Re: Looking for a backup soultion

    Hi
    Have you investigated running a docker container on the NAS?
    Cheers Malcolm °¿° SUSE Knowledge Partner (Linux Counter #276890)
    SUSE SLE, openSUSE Leap/Tumbleweed (x86_64) | GNOME DE
    If you find this post helpful and are logged into the web interface,
    please show your appreciation and click on the star below... Thanks!

  6. #6
    Join Date
    Dec 2008
    Location
    Montana, USA
    Posts
    669

    Default Re: Looking for a backup soultion

    WOW! So much to absorb! Thank you all!

    @Malcomlewis: I had not thought about that! I could run a copy of ubuntu and load Synology's ap but that would require me to SSH into each of my computers and then store the files on the NAS, right?. Never messed with Docker. I should.

    @dcurtisfra: Now, this looks interesting! Written in bash, completely customizable, can set it up with cron so I don't forget to backup. You brought up a point I had not considered though, not backing up the keepass files and banking stuff. Both of those would be super important to have. Can I not include encryption in the backups? I am looking at having the backups to my NAS backed up to Synology's C2 cloud, encrypted of course.

    Oh! All my computers are running openSUSE Leap 15.3 of course! (BIG grin)

    Bart

  7. #7
    Join Date
    Jun 2008
    Location
    Podunk
    Posts
    32,136
    Blog Entries
    15

    Default Re: Looking for a backup soultion

    Quote Originally Posted by montana_suse_user View Post
    WOW! So much to absorb! Thank you all!

    @Malcomlewis: I had not thought about that! I could run a copy of ubuntu and load Synology's ap but that would require me to SSH into each of my computers and then store the files on the NAS, right?. Never messed with Docker. I should.

    @dcurtisfra: Now, this looks interesting! Written in bash, completely customizable, can set it up with cron so I don't forget to backup. You brought up a point I had not considered though, not backing up the keepass files and banking stuff. Both of those would be super important to have. Can I not include encryption in the backups? I am looking at having the backups to my NAS backed up to Synology's C2 cloud, encrypted of course.

    Oh! All my computers are running openSUSE Leap 15.3 of course! (BIG grin)

    Bart
    Hi
    Well the tools you have used in the past have ssh capabilities, so could trigger with a systemd service/timer? Have a look at minio, it can encrypt etc? I'm currently working with it for kubernetes backups, if I could just get my self signed certificates to work (grrr).

    Locally I use cronopete on my desktop to backup direct to a USB device at present, I will probably just connect my StarTech NAS via USB, but that's down the track with things to do
    Cheers Malcolm °¿° SUSE Knowledge Partner (Linux Counter #276890)
    SUSE SLE, openSUSE Leap/Tumbleweed (x86_64) | GNOME DE
    If you find this post helpful and are logged into the web interface,
    please show your appreciation and click on the star below... Thanks!

  8. #8
    Join Date
    Jun 2008
    Location
    West Yorkshire, UK
    Posts
    3,608

    Default Re: Looking for a backup soultion

    Might be worth checking out rsnapshot considering the setup you have.

  9. #9
    Join Date
    Jun 2011
    Location
    Germany
    Posts
    519

    Default Re: Looking for a backup soultion

    I'm using unison for many years and I'm quite fond of it. It's not under active maintenance anymore but rockstable, got a GUI but is much faster in "batch mode".

  10. #10
    Join Date
    Nov 2013
    Location
    Kamloops, BC, Canada
    Posts
    4,029

    Default Re: Looking for a backup soultion

    Quote Originally Posted by kasi042 View Post
    I'm using unison for many years and I'm quite fond of it. It's not under active maintenance anymore but rockstable, got a GUI but is much faster in "batch mode".
    I have been using Unison for many, many years, backing up across the networks (if both machines have Unison, f.e., it is faster because the Unison Server on both ends runs at the same time probing each disk individually, then compares the two db files). Unison works using SSH. I just open Unison, click on the profile for the other machine, and let it do its thing. I presume you could also cron it.

    Unison has NEVER failed me in all these years, and sure has been a "Wheww! It's there!" source for when my fingers or system slips.
    "Take a Walk on a Sunny Day, Greet everyone along the way, and Make Somebody Smile, Today"
    Gerry Jack Macks"Walk On A Sunny Day" GerryJackMacks.net

Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •