Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #262185

Git for backup storage

Show all headers | View raw

Hi.

There is a project I have that requires some scripting, but I am
wondering if somebody already did something similar and there is a
package that I can just apt-get install.

The idea is to use Git to store backups of text files that change rather
rarely or not a lot, because Git is very efficient at compressing very
similar files in time sequences. That would be used for dumps of SQL
databases for example, or for records of hashes of all the files on a
system.

Unfortunately, Git is very bad at removing old data, that makes a
problem for rotating / decimating the oldest backups. To work around
this, I am considering using several Git repositories with a spillover
system:

- The files are committed into a monthly repository, each repository
  being created on the fly for the first commit on the month.

- Old monthly repositories can be deleted.

- But before they are deleted, one commit each five days can be
  extracted and committed into a yearly repository.

- And similarly, one commit per month can be committed into a decennial
  repository before old yearly repositories are removed.

Of course the month / year / five days parameters can be tweaked.

So, does anybody know of existing packages in Debian that could make my
work easier?

Thanks in advance.

-- 
  Nicolas George

Back to linux.debian.user | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 11:20 +0200
  Re: Git for backup storage Max Nikulin <manikulin@gmail.com> - 2023-10-06 12:00 +0200
    Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 13:30 +0200
  Re: Git for backup storage john doe <johndoe65534@mail.com> - 2023-10-06 13:00 +0200
    Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 13:30 +0200
      Re: Git for backup storage john doe <johndoe65534@mail.com> - 2023-10-06 13:50 +0200
        Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 14:50 +0200
          Re: Git for backup storage Stefan Monnier <monnier@iro.umontreal.ca> - 2023-10-06 15:30 +0200
            Re: Git for backup storage Nicolas George <george@nsup.org> - 2023-10-06 15:40 +0200
              Re: Git for backup storage Stefan Monnier <monnier@iro.umontreal.ca> - 2023-10-06 17:10 +0200
  Re: Git for backup storage Mike Castle <dalgoda+debian@gmail.com> - 2023-10-06 22:50 +0200
    Re: Git for backup storage <tomas@tuxteam.de> - 2023-10-07 08:00 +0200
      Re: Git for backup storage gene heskett <gheskett@shentel.net> - 2023-10-07 13:30 +0200

csiph-web