Re: Git for backup storage

From	Stefan Monnier <monnier@iro.umontreal.ca>
Newsgroups	linux.debian.user
Subject	Re: Git for backup storage
Date	2023-10-06 17:10 +0200
Message-ID	<HlUCJ-dXGv-3@gated-at.bofh.it> (permalink)
References	(2 earlier) <HlRbP-dVzO-9@gated-at.bofh.it> <HlRvb-dVG5-3@gated-at.bofh.it> <HlSrf-dWed-1@gated-at.bofh.it> <HlT3Y-dWGE-17@gated-at.bofh.it> <HlTdD-dWJA-1@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Show all headers | View raw

>> `git gc` does delete the old data (if it's not reachable any more).
> And it is very expensive.  My point exactly.

It's fairly expensive indeed, but it's usually an operation that is not
very time-sensitive: it can usually be delayed to a convenient time, and
you can run it infrequently and as a low-priority background task.

A good reason why you usually don't want to run it frequently, is that
due to the sharing ("deduplication"), there's usually not that much
garbage to collect.

[ IOW, often a thousand backups (of the same machine) don't take up
  much more space than a single backup.  ]

>> BTW, if you want to (ab)use a Git repository to do backups, you should
>> definitely look at `bup`.
> Thanks, it might be exactly what I am looking for.

Bup uses the same format as Git, but has its own implementation for most
operations because the performance of Git is tuned for a very different
use-case.  With Bup it's common to have a repository that is much larger
than 100GB, whereas Git very rarely manages repositories of such size.


        Stefan

Thread

Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 11:20 +0200
  Re: Git for backup storage Max Nikulin <manikulin@gmail.com> - 2023-10-06 12:00 +0200
    Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 13:30 +0200
  Re: Git for backup storage john doe <johndoe65534@mail.com> - 2023-10-06 13:00 +0200
    Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 13:30 +0200
      Re: Git for backup storage john doe <johndoe65534@mail.com> - 2023-10-06 13:50 +0200
        Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 14:50 +0200
          Re: Git for backup storage Stefan Monnier <monnier@iro.umontreal.ca> - 2023-10-06 15:30 +0200
            Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 15:40 +0200
              Re: Git for backup storage Stefan Monnier <monnier@iro.umontreal.ca> - 2023-10-06 17:10 +0200
  Re: Git for backup storage Mike Castle <dalgoda+debian@gmail.com> - 2023-10-06 22:50 +0200
    Re: Git for backup storage <tomas@tuxteam.de> - 2023-10-07 08:00 +0200
      Re: Git for backup storage gene heskett <gheskett@shentel.net> - 2023-10-07 13:30 +0200

csiph-web