Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #173439

Re: Recommendation: Backup system

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

On 07/10/16 23:19, Jonathan Dowland wrote:
> I don't know whether dirvish does something to improve matters, but with
> hard link trees, if you have lots of little files (such as Maildir archives
> of busy mailing lists like LKML), the amount of space consumed by the file
> system metadata to represent the trees is very high, getting towards the
> size used for the files themselves. This is compounded on some filesystems
> (the ext family amongst them) that only ever increase the amount of space
> for storing dirent metadata, never decrease it, so if you have a Maildir
> which has high churn, and you move from having a large amount of mail to
> a small amount, the storage allocated for metadata for the directory will
> remain large.

The metadata you're talking about is merely the directory entries,
right? I'm still searching, but haven't yet found info on how much space
a directory entry takes up. Any pointers would be most welcome :-)

I'm on xfs, btw.

Regardless, in the trivial case where nothing has changed between
backups, the directories in the new backup must take up exactly the same
space as the ones in the old backup, where both point to the same files.
So whether there's one set of links or several, it's still the case that
for small files, the directory entries will take proportionately more
space relative to the file - that's inevitable.

I think I'm right in saying that in the dirvish (or similar) use case,
the number of directory entries in a given directory will never decrease
anyway - except in the odd case where I discover I've backed up
something I shouldn't have (eg a huge or confidential file), and gone
through purging it from all the backups.

Richard

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 11:40 +0200
  Re: Recommendation: Backup system Mark Fletcher <mark27q1@gmail.com> - 2016-10-01 14:50 +0200
    Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 15:10 +0200
    Re: Recommendation: Backup system Gene Heskett <gheskett@shentel.net> - 2016-10-01 18:30 +0200
      Re: Recommendation: Backup system Clive Menzies <clive@clivemenzies.co.uk> - 2016-10-01 18:50 +0200
        Re: Recommendation: Backup system Gene Heskett <gheskett@shentel.net> - 2016-10-01 19:50 +0200
          Re: Recommendation: Backup system Clive Menzies <clive@clivemenzies.co.uk> - 2016-10-01 20:00 +0200
            Re: Recommendation: Backup system Glenn English <ghe2001@gmail.com> - 2016-10-01 22:10 +0200
            Re: Recommendation: Backup system Gene Heskett <gheskett@shentel.net> - 2016-10-02 06:20 +0200
      Re: Recommendation: Backup system Glenn English <ghe2001@gmail.com> - 2016-10-01 22:00 +0200
        Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 22:50 +0200
      Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 22:40 +0200
  Re: Recommendation: Backup system Bob Weber <bobrweber@gmail.com> - 2016-10-01 16:50 +0200
    Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 17:10 +0200
    Re: Recommendation: Backup system Mark Fletcher <mark27q1@gmail.com> - 2016-10-01 17:40 +0200
  Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 17:20 +0200
  Re: Recommendation: Backup system Dan Purgert <dan@djph.net> - 2016-10-01 19:10 +0200
    Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 22:50 +0200
  Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-01 22:50 +0200
    Re: Recommendation: Backup system Bob Weber <bobrweber@gmail.com> - 2016-10-01 23:10 +0200
      Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-02 10:50 +0200
        Re: Recommendation: Backup system rhkramer@gmail.com - 2016-10-02 15:00 +0200
          Re: Recommendation: Backup system Bob Weber <bobrweber@gmail.com> - 2016-10-03 01:20 +0200
    Re: Recommendation: Backup system Dan Purgert <dan@djph.net> - 2016-10-02 03:00 +0200
      Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-02 11:00 +0200
        Re: Recommendation: Backup system Dan Purgert <dan@djph.net> - 2016-10-02 13:10 +0200
          Re: Recommendation: Backup system mo <mo777@gmx.net> - 2016-10-02 14:40 +0200
  Re: Recommendation: Backup system Jonathan Dowland <jmtd@debian.org> - 2016-10-03 11:50 +0200
    Re: Recommendation: Backup system Teemu Likonen <tlikonen@iki.fi> - 2016-10-03 14:40 +0200
      Re: Recommendation: Backup system Markus Grunwald <markus@the-grue.de> - 2016-10-03 14:50 +0200
        Re: Recommendation: Backup system Richard Hector <richard@walnut.gen.nz> - 2016-10-05 04:10 +0200
          Re: Recommendation: Backup system Daniel Bareiro <daniel-listas@gmx.net> - 2016-10-05 05:10 +0200
            Re: Recommendation: Backup system Richard Hector <richard@walnut.gen.nz> - 2016-10-05 23:40 +0200
          Re: Recommendation: Backup system Jonathan Dowland <jmtd@debian.org> - 2016-10-07 12:20 +0200
            Re: Recommendation: Backup system Richard Hector <richard@walnut.gen.nz> - 2016-10-12 12:10 +0200
      Re: Recommendation: Backup system Jonathan Dowland <jmtd@debian.org> - 2016-10-03 17:10 +0200
    Re: Recommendation: Backup system Celejar <celejar@gmail.com> - 2016-10-10 19:30 +0200
      Re: Recommendation: Backup system Jonathan Dowland <jmtd@debian.org> - 2016-10-11 00:00 +0200
        Re: Recommendation: Backup system Dave Thayer <debian1628420.dmthayer@recursor.net> - 2016-10-11 05:40 +0200
  Re: Recommendation: Backup system Jarle Aase <jgaa@jgaa.com> - 2016-10-04 20:50 +0200

csiph-web