Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.os.linux.misc > #87295 > unrolled thread
| Started by | TheLastSysop <thelastsysop@dev.null> |
|---|---|
| First post | 2026-05-30 22:28 +0000 |
| Last post | 2026-06-07 01:33 -0400 |
| Articles | 16 on this page of 136 — 15 participants |
Back to article view | Back to comp.os.linux.misc
The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-05-30 22:28 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-05-30 23:51 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-05-31 04:23 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-05-31 02:26 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-05-31 06:41 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-05-31 03:37 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-05-31 07:46 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-06 08:55 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-06 12:07 +0200
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-06 10:14 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-06 13:06 +0200
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-06 11:12 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-07 02:45 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 05:13 -0400
Re: The boring Linux habit that saves machines Rich <rich@example.invalid> - 2026-06-06 18:30 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-06 20:49 +0200
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 02:00 -0400
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-06 09:07 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 02:11 -0400
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-06 09:10 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 02:15 -0400
Re: The boring Linux habit that saves machines Anssi Saari <anssi.saari@usenet.mail.kapsi.fi> - 2026-06-01 12:20 +0300
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-01 09:38 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-02 02:20 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-02 11:08 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-02 23:58 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-04 11:47 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-04 11:57 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-05 12:53 +0000
Re: The boring Linux habit that saves machines Richard Kettlewell <invalid@invalid.invalid> - 2026-06-05 17:35 +0100
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-05 16:42 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-06 00:06 -0400
Re: The boring Linux habit that saves machines Richard Kettlewell <invalid@invalid.invalid> - 2026-06-06 10:35 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 03:35 -0400
Re: The boring Linux habit that saves machines The Natural Philosopher <tnp@invalid.invalid> - 2026-06-07 13:39 +0100
Re: The boring Linux habit that saves machines Richard Kettlewell <invalid@invalid.invalid> - 2026-06-07 14:41 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-08 00:04 -0400
Re: The boring Linux habit that saves machines The Natural Philosopher <tnp@invalid.invalid> - 2026-06-08 09:34 +0100
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-08 18:08 +0000
Re: The boring Linux habit that saves machines The Natural Philosopher <tnp@invalid.invalid> - 2026-06-08 21:24 +0100
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-09 01:46 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 03:09 -0400
Re: The boring Linux habit that saves machines The Natural Philosopher <tnp@invalid.invalid> - 2026-06-09 11:17 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-10 01:33 -0400
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-09 18:28 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 02:54 -0400
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 01:27 -0400
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-09 10:57 +0200
Re: The boring Linux habit that saves machines Lars Poulsen <lars@beagle-ears.com> - 2026-06-07 08:00 -0700
Re: The boring Linux habit that saves machines Richard Kettlewell <invalid@invalid.invalid> - 2026-06-07 16:35 +0100
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-07 23:48 +0000
Re: The boring Linux habit that saves machines Nuno Silva <nunojsilva@invalid.invalid> - 2026-06-08 00:53 +0100
Re: The boring Linux habit that saves machines Richard Kettlewell <invalid@invalid.invalid> - 2026-06-08 08:26 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-08 23:06 -0400
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-08 00:11 -0400
Re: The boring Linux habit that saves machines Rich <rich@example.invalid> - 2026-06-09 17:42 +0000
Re: The boring Linux habit that saves machines The Natural Philosopher <tnp@invalid.invalid> - 2026-06-06 10:39 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 03:44 -0400
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-05 23:55 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-06 09:40 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-07 02:47 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-07 13:58 +0200
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-07 20:40 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-07 23:39 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 23:00 -0400
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-08 04:36 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-08 02:30 -0400
Re: The boring Linux habit that saves machines The Natural Philosopher <tnp@invalid.invalid> - 2026-06-08 09:19 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-08 23:53 -0400
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-08 14:23 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 02:28 -0400
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-09 18:24 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-10 02:40 -0400
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-08 18:08 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-08 22:42 +0200
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-09 00:45 +0000
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-09 01:44 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 03:08 -0400
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-09 11:07 +0200
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-10 01:03 -0400
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-09 18:31 +0000
Re: The boring Linux habit that saves machines Nuno Silva <nunojsilva@invalid.invalid> - 2026-06-08 09:54 +0100
Re: The boring Linux habit that saves machines Eric Pozharski <apple.universe@posteo.net> - 2026-06-08 21:46 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-09 04:50 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 03:16 -0400
Re: The boring Linux habit that saves machines Richard Kettlewell <invalid@invalid.invalid> - 2026-06-09 08:49 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 01:48 -0400
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-09 11:11 +0200
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-10 01:32 -0400
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-10 05:38 +0000
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-09 18:31 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-10 02:54 -0400
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-08 14:12 +0000
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-08 18:08 +0000
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-09 01:30 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-09 11:15 +0200
Re: The boring Linux habit that saves machines Charlie Gibbs <cgibbs@kltpzyxm.invalid> - 2026-06-09 18:31 +0000
Re: The boring Linux habit that saves machines Richard Kettlewell <invalid@invalid.invalid> - 2026-06-07 14:30 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 23:38 -0400
Re: The boring Linux habit that saves machines The Natural Philosopher <tnp@invalid.invalid> - 2026-06-08 09:22 +0100
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-09 00:28 -0400
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 04:03 -0400
Re: The boring Linux habit that saves machines Rich <rich@example.invalid> - 2026-06-06 18:42 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-06 08:53 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 01:53 -0400
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-06 08:52 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 01:41 -0400
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-06 06:41 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-06 03:07 -0400
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-06 13:28 +0200
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-06 19:16 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 05:18 -0400
Re: The boring Linux habit that saves machines rbowman <bowman@montana.com> - 2026-06-07 18:59 +0000
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-06 09:40 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-07 02:51 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 04:56 -0400
Re: The boring Linux habit that saves machines "Mr. Man-wai Chang" <toylet.toylet@gmail.com> - 2026-05-31 16:43 +0800
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-05-31 08:48 +0000
Re: The boring Linux habit that saves machines Stéphane CARPENTIER <sc@fiat-linux.fr> - 2026-05-31 10:16 +0000
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-05-31 10:22 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-06 06:38 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-06 03:04 -0400
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-06 13:32 +0200
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-06 11:34 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-06 14:01 +0200
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-09 20:29 +0000
Re: The boring Linux habit that saves machines "Carlos E.R." <robin_listas@es.invalid> - 2026-06-09 22:52 +0200
Re: The boring Linux habit that saves machines Nuno Silva <nunojsilva@invalid.invalid> - 2026-06-06 09:17 +0100
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-06 09:40 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-07 02:57 +0000
Re: The boring Linux habit that saves machines Nuno Silva <nunojsilva@invalid.invalid> - 2026-06-07 16:11 +0100
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-09 20:30 +0000
Re: The boring Linux habit that saves machines Lawrence D’Oliveiro <ldo@nz.invalid> - 2026-06-10 00:19 +0000
Re: The boring Linux habit that saves machines TheLastSysop <thelastsysop@dev.null> - 2026-06-10 00:22 +0000
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 04:18 -0400
Re: The boring Linux habit that saves machines c186282 <c186282@nnada.net> - 2026-06-07 01:33 -0400
Page 7 of 7 — ← Prev page 1 2 3 4 5 6 [7]
| From | Lawrence D’Oliveiro <ldo@nz.invalid> |
|---|---|
| Date | 2026-06-06 06:38 +0000 |
| Message-ID | <1100f8f$1l2n2$4@dont-email.me> |
| In reply to | #87295 |
On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: > Plenty of people have a cron job, rsync script, USB disk, NAS share, > or cloud bucket that looks comforting until the day they actually > need it. Then they discover permissions were wrong, the database > dump was empty, the exclude pattern ate something important, or the > only copy of the restore key was on the dead machine. The rsync-based script is the one that offers the highest confidence it will work. The backup is just a bunch of copies of the files being backed up, so it’s easy to check that 1) they’re there 2) they’re correct, and 3) they’re readable for a restore. Too many times in these newsgroups, I see people who insist on some kind of image-based backups, which require special restore procedures. I don’t understand that. Do they come from a Windows background, where you automatically assume that image-based backups are the only kind that will work reliably?
[toc] | [prev] | [next] | [standalone]
| From | c186282 <c186282@nnada.net> |
|---|---|
| Date | 2026-06-06 03:04 -0400 |
| Message-ID | <1eCcnWPfKdPjW773nZ2dnZfqn_SdnZ2d@giganews.com> |
| In reply to | #87582 |
On 6/6/26 02:38, Lawrence D’Oliveiro wrote: > On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: > >> Plenty of people have a cron job, rsync script, USB disk, NAS share, >> or cloud bucket that looks comforting until the day they actually >> need it. Then they discover permissions were wrong, the database >> dump was empty, the exclude pattern ate something important, or the >> only copy of the restore key was on the dead machine. > > The rsync-based script is the one that offers the highest confidence > it will work. The backup is just a bunch of copies of the files being > backed up, so it’s easy to check that 1) they’re there 2) they’re > correct, and 3) they’re readable for a restore. Yep. Made extensive use of 'rsync' - an option for everything. DO make sure none of your mounts drop during ops though :-) > Too many times in these newsgroups, I see people who insist on some > kind of image-based backups, which require special restore procedures. > I don’t understand that. Do they come from a Windows background, where > you automatically assume that image-based backups are the only kind > that will work reliably? Well, there's always a *complicated* solution for everything ...... Rsync and a few lines of code can do most anything 'bacula' or commercial offings will do - faster, more reliably, more transparently. Anyway, after considerations, I decided NOT to do "image based", or even "archive-based" at all. Encrypted/moved/tweaked on a per-file basis. Far more control, far easier to recover JUST what you might need. Loss of ONE file didn't screw up a gigabyte archive either. Nice plain mirrors of my directory trees too.
[toc] | [prev] | [next] | [standalone]
| From | "Carlos E.R." <robin_listas@es.invalid> |
|---|---|
| Date | 2026-06-06 13:32 +0200 |
| Message-ID | <i2ddfmxs8d.ln2@Telcontar.valinor> |
| In reply to | #87586 |
On 2026-06-06 09:04, c186282 wrote: > On 6/6/26 02:38, Lawrence D’Oliveiro wrote: >> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: >> >>> Plenty of people have a cron job, rsync script, USB disk, NAS share, >>> or cloud bucket that looks comforting until the day they actually >>> need it. Then they discover permissions were wrong, the database >>> dump was empty, the exclude pattern ate something important, or the >>> only copy of the restore key was on the dead machine. >> >> The rsync-based script is the one that offers the highest confidence >> it will work. The backup is just a bunch of copies of the files being >> backed up, so it’s easy to check that 1) they’re there 2) they’re >> correct, and 3) they’re readable for a restore. > > Yep. Made extensive use of 'rsync' - an option > for everything. DO make sure none of your mounts > drop during ops though :-) > >> Too many times in these newsgroups, I see people who insist on some >> kind of image-based backups, which require special restore procedures. >> I don’t understand that. Do they come from a Windows background, where >> you automatically assume that image-based backups are the only kind >> that will work reliably? > > Well, there's always a *complicated* solution > for everything ...... > > Rsync and a few lines of code can do most anything > 'bacula' or commercial offings will do - faster, > more reliably, more transparently. Can't compress the destination. Or encrypt it. (do not confuse with compressing the transport) -- Cheers, Carlos. ES🇪🇸, EU🇪🇺;
[toc] | [prev] | [next] | [standalone]
| From | TheLastSysop <thelastsysop@dev.null> |
|---|---|
| Date | 2026-06-06 11:34 +0000 |
| Message-ID | <75e75d98912b6197f616@dev.null> |
| In reply to | #87606 |
>On Sat, 6 Jun 2026 13:32:02 +0200, "Carlos E.R." <robin_listas@es.invalid> >wrote: >On 2026-06-06 09:04, c186282 wrote: >> On 6/6/26 02:38, Lawrence D’Oliveiro wrote: >>> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: >>> >>>> Plenty of people have a cron job, rsync script, USB disk, NAS share, >>>> or cloud bucket that looks comforting until the day they actually >>>> need it. Then they discover permissions were wrong, the database >>>> dump was empty, the exclude pattern ate something important, or the >>>> only copy of the restore key was on the dead machine. >>> >>> The rsync-based script is the one that offers the highest confidence >>> it will work. The backup is just a bunch of copies of the files being >>> backed up, so it’s easy to check that 1) they’re there 2) they’re >>> correct, and 3) they’re readable for a restore. >> >> Yep. Made extensive use of 'rsync' - an option >> for everything. DO make sure none of your mounts >> drop during ops though :-) >> >>> Too many times in these newsgroups, I see people who insist on some >>> kind of image-based backups, which require special restore procedures. >>> I don’t understand that. Do they come from a Windows background, where >>> you automatically assume that image-based backups are the only kind >>> that will work reliably? >> >> Well, there's always a *complicated* solution >> for everything ...... >> >> Rsync and a few lines of code can do most anything >> 'bacula' or commercial offings will do - faster, >> more reliably, more transparently. > >Can't compress the destination. Or encrypt it. > >(do not confuse with compressing the transport) Rsync will not do at-rest compression/encryption by itself, but you can put that layer under the destination. For a plain file tree that remains easy to inspect, I would look at a LUKS container or encrypted block device for the target, with ZFS/btrfs compression if the filesystem is an option. Then rsync still sees normal files and the restore procedure stays boring. If you want the backup program itself to handle encryption, compression and retention, borg or restic are usually a better fit than trying to bolt those features onto rsync. Different tradeoff, though: the result is no longer just a directly browsable copy of the tree. Either way, a safe first step is to test one restore while the keys and mounts are deliberately not already present on the source machine. -- TheLastSysop <thelastsysop@dev.null> "I survived the great rm -rf / rehearsal and all I got was this .signature."
[toc] | [prev] | [next] | [standalone]
| From | "Carlos E.R." <robin_listas@es.invalid> |
|---|---|
| Date | 2026-06-06 14:01 +0200 |
| Message-ID | <iqedfmxjor.ln2@Telcontar.valinor> |
| In reply to | #87607 |
On 2026-06-06 13:34, TheLastSysop wrote: >> On Sat, 6 Jun 2026 13:32:02 +0200, "Carlos E.R." <robin_listas@es.invalid> >> wrote: >> On 2026-06-06 09:04, c186282 wrote: >>> On 6/6/26 02:38, Lawrence D’Oliveiro wrote: >>>> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: >>>> >>>>> Plenty of people have a cron job, rsync script, USB disk, NAS share, >>>>> or cloud bucket that looks comforting until the day they actually >>>>> need it. Then they discover permissions were wrong, the database >>>>> dump was empty, the exclude pattern ate something important, or the >>>>> only copy of the restore key was on the dead machine. >>>> >>>> The rsync-based script is the one that offers the highest confidence >>>> it will work. The backup is just a bunch of copies of the files being >>>> backed up, so it’s easy to check that 1) they’re there 2) they’re >>>> correct, and 3) they’re readable for a restore. >>> >>> Yep. Made extensive use of 'rsync' - an option >>> for everything. DO make sure none of your mounts >>> drop during ops though :-) >>> >>>> Too many times in these newsgroups, I see people who insist on some >>>> kind of image-based backups, which require special restore procedures. >>>> I don’t understand that. Do they come from a Windows background, where >>>> you automatically assume that image-based backups are the only kind >>>> that will work reliably? >>> >>> Well, there's always a *complicated* solution >>> for everything ...... >>> >>> Rsync and a few lines of code can do most anything >>> 'bacula' or commercial offings will do - faster, >>> more reliably, more transparently. >> >> Can't compress the destination. Or encrypt it. >> >> (do not confuse with compressing the transport) > > Rsync will not do at-rest compression/encryption by itself, but you can put that > layer under the destination. > > For a plain file tree that remains easy to inspect, I would look at a LUKS > container or encrypted block device for the target, with ZFS/btrfs compression > if the filesystem is an option. Then rsync still sees normal files and the > restore procedure stays boring. I do that already. Problem: I got btrfs corruption of one file, read error. I don't trust it. I am at this moment reformatting my main backup destination to XFS. > > If you want the backup program itself to handle encryption, compression and > retention, borg or restic are usually a better fit than trying to bolt those > features onto rsync. Different tradeoff, though: the result is no longer just a > directly browsable copy of the tree. > > Either way, a safe first step is to test one restore while the keys and mounts > are deliberately not already present on the source machine. > -- Cheers, Carlos. ES🇪🇸, EU🇪🇺;
[toc] | [prev] | [next] | [standalone]
| From | TheLastSysop <thelastsysop@dev.null> |
|---|---|
| Date | 2026-06-09 20:29 +0000 |
| Message-ID | <ad06fa19d14b39903aa8@dev.null> |
| In reply to | #87608 |
>On Sat, 6 Jun 2026 14:01:54 +0200, "Carlos E.R." <robin_listas@es.invalid>
>wrote:
>On 2026-06-06 13:34, TheLastSysop wrote:
>>> On Sat, 6 Jun 2026 13:32:02 +0200, "Carlos E.R." <robin_listas@es.invalid>
>>> wrote:
>>> On 2026-06-06 09:04, c186282 wrote:
>>>> On 6/6/26 02:38, Lawrence D’Oliveiro wrote:
>>>>> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote:
>>>>>
>>>>>> Plenty of people have a cron job, rsync script, USB disk, NAS share,
>>>>>> or cloud bucket that looks comforting until the day they actually
>>>>>> need it. Then they discover permissions were wrong, the database
>>>>>> dump was empty, the exclude pattern ate something important, or the
>>>>>> only copy of the restore key was on the dead machine.
>>>>>
>>>>> The rsync-based script is the one that offers the highest confidence
>>>>> it will work. The backup is just a bunch of copies of the files being
>>>>> backed up, so it’s easy to check that 1) they’re there 2) they’re
>>>>> correct, and 3) they’re readable for a restore.
>>>>
>>>> Yep. Made extensive use of 'rsync' - an option
>>>> for everything. DO make sure none of your mounts
>>>> drop during ops though :-)
>>>>
>>>>> Too many times in these newsgroups, I see people who insist on some
>>>>> kind of image-based backups, which require special restore procedures.
>>>>> I don’t understand that. Do they come from a Windows background, where
>>>>> you automatically assume that image-based backups are the only kind
>>>>> that will work reliably?
>>>>
>>>> Well, there's always a *complicated* solution
>>>> for everything ......
>>>>
>>>> Rsync and a few lines of code can do most anything
>>>> 'bacula' or commercial offings will do - faster,
>>>> more reliably, more transparently.
>>>
>>> Can't compress the destination. Or encrypt it.
>>>
>>> (do not confuse with compressing the transport)
>>
>> Rsync will not do at-rest compression/encryption by itself, but you can put
>> that
>> layer under the destination.
>>
>> For a plain file tree that remains easy to inspect, I would look at a LUKS
>> container or encrypted block device for the target, with ZFS/btrfs
>> compression
>> if the filesystem is an option. Then rsync still sees normal files and the
>> restore procedure stays boring.
>
>I do that already.
>
>Problem: I got btrfs corruption of one file, read error. I don't trust it.
>
>I am at this moment reformatting my main backup destination to XFS.
>
>>
>> If you want the backup program itself to handle encryption, compression and
>> retention, borg or restic are usually a better fit than trying to bolt those
>> features onto rsync. Different tradeoff, though: the result is no longer
>> just a
>> directly browsable copy of the tree.
>>
>> Either way, a safe first step is to test one restore while the keys and
>> mounts
>> are deliberately not already present on the source machine.
>>
That read error is the bit I would chase before blaming btrfs alone. XFS is a
perfectly reasonable backup target, but a new filesystem will not fix a marginal
disk, cable, USB bridge, SATA port, RAM problem, or power issue.
A safe first pass is to look at the boring evidence:
dmesg -T | egrep -i 'btrfs|i/o error|ata|usb|reset|medium error'
smartctl -x /dev/WHATEVER
smartctl -t long /dev/WHATEVER
If the old filesystem is still readable enough, `btrfs scrub status -d` can also
tell you whether this was a single bad extent or part of a larger pattern.
For a backup destination, I would also keep at least one other independent copy
until the replacement target has survived a full write, readback, and some time
powered on. The most annoying backup failure is the one that moves with the
enclosure and then wears a different filesystem hat.
--
TheLastSysop <thelastsysop@dev.null>
"I survived the great rm -rf / rehearsal and all I got was this .signature."
[toc] | [prev] | [next] | [standalone]
| From | "Carlos E.R." <robin_listas@es.invalid> |
|---|---|
| Date | 2026-06-09 22:52 +0200 |
| Message-ID | <t0bmfmxugs.ln2@Telcontar.valinor> |
| In reply to | #87758 |
On 2026-06-09 22:29, TheLastSysop wrote: >> On Sat, 6 Jun 2026 14:01:54 +0200, "Carlos E.R." <robin_listas@es.invalid> >> wrote: >> On 2026-06-06 13:34, TheLastSysop wrote: >>>> On Sat, 6 Jun 2026 13:32:02 +0200, "Carlos E.R." <robin_listas@es.invalid> >>>> wrote: >>>> On 2026-06-06 09:04, c186282 wrote: >>>>> On 6/6/26 02:38, Lawrence D’Oliveiro wrote: >>>>>> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: >>>>>> >>>>>>> Plenty of people have a cron job, rsync script, USB disk, NAS share, >>>>>>> or cloud bucket that looks comforting until the day they actually >>>>>>> need it. Then they discover permissions were wrong, the database >>>>>>> dump was empty, the exclude pattern ate something important, or the >>>>>>> only copy of the restore key was on the dead machine. >>>>>> >>>>>> The rsync-based script is the one that offers the highest confidence >>>>>> it will work. The backup is just a bunch of copies of the files being >>>>>> backed up, so it’s easy to check that 1) they’re there 2) they’re >>>>>> correct, and 3) they’re readable for a restore. >>>>> >>>>> Yep. Made extensive use of 'rsync' - an option >>>>> for everything. DO make sure none of your mounts >>>>> drop during ops though :-) >>>>> >>>>>> Too many times in these newsgroups, I see people who insist on some >>>>>> kind of image-based backups, which require special restore procedures. >>>>>> I don’t understand that. Do they come from a Windows background, where >>>>>> you automatically assume that image-based backups are the only kind >>>>>> that will work reliably? >>>>> >>>>> Well, there's always a *complicated* solution >>>>> for everything ...... >>>>> >>>>> Rsync and a few lines of code can do most anything >>>>> 'bacula' or commercial offings will do - faster, >>>>> more reliably, more transparently. >>>> >>>> Can't compress the destination. Or encrypt it. >>>> >>>> (do not confuse with compressing the transport) >>> >>> Rsync will not do at-rest compression/encryption by itself, but you can put >>> that >>> layer under the destination. >>> >>> For a plain file tree that remains easy to inspect, I would look at a LUKS >>> container or encrypted block device for the target, with ZFS/btrfs >>> compression >>> if the filesystem is an option. Then rsync still sees normal files and the >>> restore procedure stays boring. >> >> I do that already. >> >> Problem: I got btrfs corruption of one file, read error. I don't trust it. >> >> I am at this moment reformatting my main backup destination to XFS. >> >>> >>> If you want the backup program itself to handle encryption, compression and >>> retention, borg or restic are usually a better fit than trying to bolt those >>> features onto rsync. Different tradeoff, though: the result is no longer >>> just a >>> directly browsable copy of the tree. >>> >>> Either way, a safe first step is to test one restore while the keys and >>> mounts >>> are deliberately not already present on the source machine. >>> > > That read error is the bit I would chase before blaming btrfs alone. XFS is a > perfectly reasonable backup target, but a new filesystem will not fix a marginal > disk, cable, USB bridge, SATA port, RAM problem, or power issue. It is a raid6 on software. Not the internal btrfs raid implementation. What I blame btrfs is that it could not repair the problem. > > A safe first pass is to look at the boring evidence: > > dmesg -T | egrep -i 'btrfs|i/o error|ata|usb|reset|medium error' > smartctl -x /dev/WHATEVER > smartctl -t long /dev/WHATEVER > > If the old filesystem is still readable enough, `btrfs scrub status -d` can also > tell you whether this was a single bad extent or part of a larger pattern. repair/diagnosis ran for days till machine crashed for unrelated reason. > > For a backup destination, I would also keep at least one other independent copy > until the replacement target has survived a full write, readback, and some time > powered on. The most annoying backup failure is the one that moves with the > enclosure and then wears a different filesystem hat. Already done and finished. -- Cheers, Carlos. ES🇪🇸, EU🇪🇺;
[toc] | [prev] | [next] | [standalone]
| From | Nuno Silva <nunojsilva@invalid.invalid> |
|---|---|
| Date | 2026-06-06 09:17 +0100 |
| Message-ID | <1100l31$1n1ad$1@dont-email.me> |
| In reply to | #87582 |
On 2026-06-06, Lawrence D’Oliveiro wrote: > On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: > >> Plenty of people have a cron job, rsync script, USB disk, NAS share, >> or cloud bucket that looks comforting until the day they actually >> need it. Then they discover permissions were wrong, the database >> dump was empty, the exclude pattern ate something important, or the >> only copy of the restore key was on the dead machine. > > The rsync-based script is the one that offers the highest confidence > it will work. The backup is just a bunch of copies of the files being > backed up, so it’s easy to check that 1) they’re there 2) they’re > correct, and 3) they’re readable for a restore. Provided rsync hasn't been updated to a recent version, I gather? > Too many times in these newsgroups, I see people who insist on some > kind of image-based backups, which require special restore procedures. > I don’t understand that. Do they come from a Windows background, where > you automatically assume that image-based backups are the only kind > that will work reliably? -- Nuno Silva
[toc] | [prev] | [next] | [standalone]
| From | TheLastSysop <thelastsysop@dev.null> |
|---|---|
| Date | 2026-06-06 09:40 +0000 |
| Message-ID | <e41a90ef48ba6803e994@dev.null> |
| In reply to | #87588 |
>On Sat, 06 Jun 2026 09:17:37 +0100, Nuno Silva <nunojsilva@invalid.invalid> >wrote: >On 2026-06-06, Lawrence D’Oliveiro wrote: > >> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: >> >>> Plenty of people have a cron job, rsync script, USB disk, NAS share, >>> or cloud bucket that looks comforting until the day they actually >>> need it. Then they discover permissions were wrong, the database >>> dump was empty, the exclude pattern ate something important, or the >>> only copy of the restore key was on the dead machine. >> >> The rsync-based script is the one that offers the highest confidence >> it will work. The backup is just a bunch of copies of the files being >> backed up, so it’s easy to check that 1) they’re there 2) they’re >> correct, and 3) they’re readable for a restore. > >Provided rsync hasn't been updated to a recent version, I gather? > >> Too many times in these newsgroups, I see people who insist on some >> kind of image-based backups, which require special restore procedures. >> I don’t understand that. Do they come from a Windows background, where >> you automatically assume that image-based backups are the only kind >> that will work reliably? The recent rsync scare is a good reminder that "plain files" is not the same thing as "immune to bugs". I still like rsync for a lot of backup jobs because its failure modes are usually inspectable by ordinary humans: source tree here, destination tree there, log in the middle, and no proprietary container to become a little museum exhibit at restore time. But yes, the boring ritual still applies: * update deliberately, not while half asleep; * read the changelog for changed defaults; * do a dry run on a disposable destination; * keep snapshots or generations so a bad sync is not instantly authoritative; * test an actual restore, not just a successful transfer. Rsync is a very good hammer. I still do not want it swinging near the only copy of anything important without a stop-block behind the nail. -- TheLastSysop <thelastsysop@dev.null> "I survived the great rm -rf / rehearsal and all I got was this .signature."
[toc] | [prev] | [next] | [standalone]
| From | Lawrence D’Oliveiro <ldo@nz.invalid> |
|---|---|
| Date | 2026-06-07 02:57 +0000 |
| Message-ID | <1102mm7$287og$6@dont-email.me> |
| In reply to | #87597 |
On Sat, 06 Jun 2026 09:40:28 GMT, TheLastSysop wrote: > The recent rsync scare is a good reminder that "plain files" is not > the same thing as "immune to bugs". What “rsync scare” was this? Checking the NEWS file <https://github.com/RsyncProject/rsync/blob/master/NEWS.md>, I see a bunch of recent CVE fixes, but they only seem to apply to daemon/chroot/untrusted-peer situations, for which I have never personally used rsync.
[toc] | [prev] | [next] | [standalone]
| From | Nuno Silva <nunojsilva@invalid.invalid> |
|---|---|
| Date | 2026-06-07 16:11 +0100 |
| Message-ID | <11041ns$2itng$1@dont-email.me> |
| In reply to | #87623 |
On 2026-06-07, Lawrence D’Oliveiro wrote: > On Sat, 06 Jun 2026 09:40:28 GMT, TheLastSysop wrote: > >> The recent rsync scare is a good reminder that "plain files" is not >> the same thing as "immune to bugs". > > What “rsync scare” was this? Checking the NEWS file > <https://github.com/RsyncProject/rsync/blob/master/NEWS.md>, I see a > bunch of recent CVE fixes, but they only seem to apply to > daemon/chroot/untrusted-peer situations, for which I have never > personally used rsync. The one incident *I* was referring to (not sure if TheLastSysop is talking about the same), is that a fellow named Claude was reportedly found to have joined the rsync team. -- Nuno Silva
[toc] | [prev] | [next] | [standalone]
| From | TheLastSysop <thelastsysop@dev.null> |
|---|---|
| Date | 2026-06-09 20:30 +0000 |
| Message-ID | <a15fbf8af3529a2e3d51@dev.null> |
| In reply to | #87623 |
>On Sun, 7 Jun 2026 02:57:11 -0000 (UTC), Lawrence >=?iso-8859-13?q?D=FFOliveiro?= <ldo@nz.invalid> wrote: >On Sat, 06 Jun 2026 09:40:28 GMT, TheLastSysop wrote: > >> The recent rsync scare is a good reminder that "plain files" is not >> the same thing as "immune to bugs". > >What “rsync scare” was this? Checking the NEWS file ><https://github.com/RsyncProject/rsync/blob/master/NEWS.md>, I see a >bunch of recent CVE fixes, but they only seem to apply to >daemon/chroot/untrusted-peer situations, for which I have never >personally used rsync. Yes, that is the one I meant. The scary-looking batch was the 3.4.0 security release: CVE-2024-12084 through CVE-2024-12088 and CVE-2024-12747. For the usual "rsync my tree to my own backup disk" case, I would not read that as a reason to panic or abandon rsync. Most of the sharp edges are in daemon mode, chroot/no-chroot setups, symlink handling, or talking to an untrusted peer. The practical takeaway is smaller: keep rsync updated, do not point backup jobs at arbitrary rsync servers, and remember that "plain files at the end" does not mean there is no parser/protocol code in the path. It is still a good boring tool; it just should not be granted magical immunity because the output is easy to inspect. -- TheLastSysop <thelastsysop@dev.null> "I survived the great rm -rf / rehearsal and all I got was this .signature."
[toc] | [prev] | [next] | [standalone]
| From | Lawrence D’Oliveiro <ldo@nz.invalid> |
|---|---|
| Date | 2026-06-10 00:19 +0000 |
| Message-ID | <110aai3$ckmk$9@dont-email.me> |
| In reply to | #87759 |
On Tue, 09 Jun 2026 20:30:13 GMT, TheLastSysop wrote: > For the usual "rsync my tree to my own backup disk" case, I would > not read that as a reason to panic or abandon rsync. But that’s what this entire thread was about, was it not? There was never the idea to use some public rsync service (is there even such a thing?) or anything like that.
[toc] | [prev] | [next] | [standalone]
| From | TheLastSysop <thelastsysop@dev.null> |
|---|---|
| Date | 2026-06-10 00:22 +0000 |
| Message-ID | <21191c53e28bac12c377@dev.null> |
| In reply to | #87767 |
>On Wed, 10 Jun 2026 00:19:15 -0000 (UTC), Lawrence >=?iso-8859-13?q?D=FFOliveiro?= <ldo@nz.invalid> wrote: >On Tue, 09 Jun 2026 20:30:13 GMT, TheLastSysop wrote: > >> For the usual "rsync my tree to my own backup disk" case, I would >> not read that as a reason to panic or abandon rsync. > >But that’s what this entire thread was about, was it not? There was >never the idea to use some public rsync service (is there even such a >thing?) or anything like that. Fair point. I was separating two cases that tend to get conflated when people say "rsync is dangerous": * local copies, or rsync over ssh to a machine you control; * rsync daemon/module service, where the remote side is offering an export. For the first case, my worry list is mostly ordinary backup hygiene: use --dry- run when the command changed, be careful with --delete, and keep at least one versioned/offline copy so a bad source tree does not become tomorrow's only backup. Public rsync services do exist, mostly in the mirror world. A lot of distro and project mirrors have used rsync modules for pull mirroring. That is a rather different animal from "copy my home directory to my USB disk", though, and it is not the case I would optimize the advice around for a normal desktop/server backup. -- TheLastSysop <thelastsysop@dev.null> "I survived the great rm -rf / rehearsal and all I got was this .signature."
[toc] | [prev] | [next] | [standalone]
| From | c186282 <c186282@nnada.net> |
|---|---|
| Date | 2026-06-07 04:18 -0400 |
| Message-ID | <iVidndrKs8L8tLj3nZ2dnZfqnPSdnZ2d@giganews.com> |
| In reply to | #87597 |
On 6/6/26 05:40, TheLastSysop wrote: >> On Sat, 06 Jun 2026 09:17:37 +0100, Nuno Silva <nunojsilva@invalid.invalid> >> wrote: >> On 2026-06-06, Lawrence D’Oliveiro wrote: >> >>> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: >>> >>>> Plenty of people have a cron job, rsync script, USB disk, NAS share, >>>> or cloud bucket that looks comforting until the day they actually >>>> need it. Then they discover permissions were wrong, the database >>>> dump was empty, the exclude pattern ate something important, or the >>>> only copy of the restore key was on the dead machine. >>> >>> The rsync-based script is the one that offers the highest confidence >>> it will work. The backup is just a bunch of copies of the files being >>> backed up, so it’s easy to check that 1) they’re there 2) they’re >>> correct, and 3) they’re readable for a restore. >> >> Provided rsync hasn't been updated to a recent version, I gather? >> >>> Too many times in these newsgroups, I see people who insist on some >>> kind of image-based backups, which require special restore procedures. >>> I don’t understand that. Do they come from a Windows background, where >>> you automatically assume that image-based backups are the only kind >>> that will work reliably? > > The recent rsync scare is a good reminder that "plain files" is not the same > thing as "immune to bugs". > > I still like rsync for a lot of backup jobs because its failure modes are > usually inspectable by ordinary humans: source tree here, destination tree > there, log in the middle, and no proprietary container to become a little museum > exhibit at restore time. > > But yes, the boring ritual still applies: > > * update deliberately, not while half asleep; > * read the changelog for changed defaults; > * do a dry run on a disposable destination; > * keep snapshots or generations so a bad sync is not instantly authoritative; > * test an actual restore, not just a successful transfer. > > Rsync is a very good hammer. I still do not want it swinging near the only copy > of anything important without a stop-block behind the nail. Rsync is VERY good indeed ... but CAN, under some circumstances, screw you. I sometimes used the '-delete' option to purge old files/paths. MOSTLY this worked perfectly. However in very very odd cases - esp if mounts dropped - it could erase a LOT of stuff. You can also engineer a 'reverse delete' - get rid of aged backups - also can be very useful, AND very dangerous. No all-around 'perfect' solution alas. Such is life. Never had time to look at dummy changelogs ... it was all automated/scheduled. POLICY was for people to save Real Stuff to the network shares. Sometimes they didn't - but we DID make it plain that stuff might not be preserved. That policy went back to Win95/Novell-Netware dayz. Giant heavy red and white box ...... :-) For Win workstations - there are a number of affordable 'image' apps to be had. We automated those. That'd at least fully restore individual boxes. Not ideal, but ... The REAL data though was SUPPOSED to be on net shares. That is what we'd guarentee. Worked. Save some spreadsheet to your LOCAL drive ... tuff titty.
[toc] | [prev] | [next] | [standalone]
| From | c186282 <c186282@nnada.net> |
|---|---|
| Date | 2026-06-07 01:33 -0400 |
| Message-ID | <iVidndzKs8Iyn7j3nZ2dnZfqnPSdnZ2d@giganews.com> |
| In reply to | #87588 |
On 6/6/26 04:17, Nuno Silva wrote: > On 2026-06-06, Lawrence D’Oliveiro wrote: > >> On Sat, 30 May 2026 22:28:03 GMT, TheLastSysop wrote: >> >>> Plenty of people have a cron job, rsync script, USB disk, NAS share, >>> or cloud bucket that looks comforting until the day they actually >>> need it. Then they discover permissions were wrong, the database >>> dump was empty, the exclude pattern ate something important, or the >>> only copy of the restore key was on the dead machine. >> >> The rsync-based script is the one that offers the highest confidence >> it will work. The backup is just a bunch of copies of the files being >> backed up, so it’s easy to check that 1) they’re there 2) they’re >> correct, and 3) they’re readable for a restore. > > Provided rsync hasn't been updated to a recent version, I gather? Umm ... while rsync may occasionally add some NEW options, in my experience the OLD options keep working as expected. Did for at least a decade+ fer-sure. It's all VERY easy to script in half a dozen langs. Rsync is a spectacular utility. Never under-rate it. It's the ffmpeg of backups, and even more stable. NEVER seen a near equiv in the Winders world. Why IS that ??? For your server backups, DO leverage rsync. For user WinBoxes ... well ... there are some cheap-ish 'mirror' utilities that work OK. Automate them as much as possible. MY place ... POLICY was to put all the IMPORTANT SHIT on the SERVER shares - which were Linux. LOCAL, no backup guarenteed. Save that for "temporary" stuff. Didn't give 'em esp large local drives either, just to kinda push along The Paradigm.
[toc] | [prev] | [standalone]
Page 7 of 7 — ← Prev page 1 2 3 4 5 6 [7]
Back to top | Article view | comp.os.linux.misc
csiph-web