Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #159547

Re: Backup solutions without reinventig the wheel these days

Show all headers | View raw

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 10/20/2015 12:57 PM, Ondřej Grover wrote:
> Hello,
> 
> I'm looking for recommendations for backup solutions that don't reinvent
> the wheel and are reliable and used. I want to backup two servers to a
> backup server. The main data content is several hundred GB in many very
> small files.
> 
> [...]
> 
> I've also looked at the new kids on the block like obnam, attick and
> borgbackup. They look interesting, but I prefer time-tested SW for backups.
> After realizing that these new backup programs pretty much try to
> replicate features of btrfs or ZFS (incremental snapshots, block-level
> compression and deduplication) I started thinking that I could perhaps
> just send the data to the backup server via rsync and save them to a
> btrfs or ZFS (but the backup server may not have enough RAM for ZFS) and
> create daily snaphosts on the server. If memory will permit (if I
> optimize it), I'd go with ZFS as it should be more reliable. Does
> anybody use such a solution?

Yes, we do use pretty much the setup you describe, i.e. rsync push to
backup server, btrfs volume with daily snapshot subvolumes on the
server. This particular setup has been in use for more than two years by
now, and is working well with 8-10 servers (totals for all backed-up
filesystems is about 1.2TiB/2.5M files of varying size; transferred
daily delta is of course just a fraction of this). The backup server is
a rather modest self-built Mini-ITX Core i5 with 8GiB RAM and 6TiB
hardware (3ware) RAID-10 storage volume.

Using btrfs volume in btrfs-raid configuration (raid-1 for data and
metadata) would provide protection against data bit-rot. We use several
such volumes on some of our severs, though not in combination with btrfs
snapshot subvolumes.

- -- 
Sarunas Burdulis
http://math.dartmouth.edu/~sarunas
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBCAAGBQJWJollAAoJEAcPjabqyGA9iD4H/2Hxa4IqYxRRLi55kg8c/tOS
UafxgMMnUB498HHVGMldDZdjqmzBd4djHuVOeJPguu7RaSVKOIBBdpmZdI44LXoj
y3P0m7Ig1cg3kGB7tZTgG6mzsgZQln6F8uW/lNox9EikmWUQ2eQZYIDVbLTEOLXt
pMKVTKQeR1Jdl9HvbIqlPBpniqHn+JvesWUeTDdo47i45jcfRonYfPay0/ua7ql0
n80ObcOLlYSCw/rKZbkspHz7k9PMEEdeosbkvUkw2ZiGq13E1j6DFwSUTxcrMPhR
Ffd+bL5c0CtKOTVrvtZdahJZ5U/Kl/QG1c78TsJagCN7YTSXRWnDSn6acdDRPmM=
=Edp3
-----END PGP SIGNATURE-----

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Backup solutions without reinventig the wheel these days Ondřej Grover <ondrej.grover@gmail.com> - 2015-10-20 19:00 +0200
  Re: Backup solutions without reinventig the wheel these days Mario Castelán Castro  <marioxcc.MT@yandex.com> - 2015-10-20 19:50 +0200
    Re: Backup solutions without reinventig the wheel these days Teemu Likonen <tlikonen@iki.fi> - 2015-10-20 20:20 +0200
      Re: Backup solutions without reinventig the wheel these days Jonathan Dowland <jmtd@debian.org> - 2015-10-27 12:40 +0100
        Re: Backup solutions without reinventig the wheel these days Teemu Likonen <tlikonen@iki.fi> - 2015-10-27 16:40 +0100
  Re: Backup solutions without reinventig the wheel these days Sarunas Burdulis <sarunas@math.dartmouth.edu> - 2015-10-20 21:10 +0200
    Re: Backup solutions without reinventig the wheel these days Ondřej Grover <ondrej.grover@gmail.com> - 2015-10-21 11:40 +0200
      Re: Backup solutions without reinventig the wheel these days mourik jan heupink <heupink@merit.unu.edu> - 2015-10-21 13:30 +0200
        Re: Backup solutions without reinventig the wheel these days mourik jan heupink <heupink@merit.unu.edu> - 2015-10-21 13:40 +0200
      Re: Backup solutions without reinventig the wheel these days Eduardo M KALINOWSKI <eduardo@kalinowski.com.br> - 2015-10-21 13:30 +0200
      Re: Backup solutions without reinventig the wheel these days Dan Ritter <dsr@randomstring.org> - 2015-10-21 16:10 +0200
      Re: Backup solutions without reinventig the wheel these days Sarunas Burdulis <sarunas@math.dartmouth.edu> - 2015-10-21 16:30 +0200
        Re: Backup solutions without reinventig the wheel these days Ondřej Grover <ondrej.grover@gmail.com> - 2015-10-21 16:50 +0200
          Re: Backup solutions without reinventig the wheel these days Sarunas Burdulis <sarunas@math.dartmouth.edu> - 2015-10-21 17:10 +0200
            Re: Backup solutions without reinventig the wheel these days Ondřej Grover <ondrej.grover@gmail.com> - 2015-10-22 08:50 +0200
              Re: Backup solutions without reinventig the wheel these days Sarunas Burdulis <sarunas@math.dartmouth.edu> - 2015-10-22 16:10 +0200
  Re: Backup solutions without reinventig the wheel these days Glenn English <ghe@slsware.net> - 2015-10-22 18:30 +0200

csiph-web