Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #180745

Re: Live Fille System Backup

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

I just realized that busy files are pretty much impossible to deal with no
matter what.  If DB is in the middle of the transaction, then a "snapshot"
based backup will work (we simply loose that transaction data as it is
equivalent to crash).  Other busy files might be corrupted if those files
don't use transaction model.

I am not convinced that rsync can handle all device type files, all types
of links and other attributes I don't even know about.  I am not convinced
that anyone actually restored file system using rsync.  Does it really work?

I personally use rsync to synchronize data for application deployment and
it works great.  But I usually have no special files to worry about.

On Fri, May 5, 2017 at 1:35 PM, Sergei G <sergeig.public@gmail.com> wrote:

> it would be naive at best to think that busy files can be handled at
> application level.   No, rsync cannot handle the problem of entire file
> system dump.  Neither it is safe to handle all special file cases.  I am
> thinking about sparse files (if Linux has those).
>
> On Thu, May 4, 2017 at 11:52 PM, Dejan Jocic <jodejka@gmail.com> wrote:
>
>> On 04-05-17, Sergei G wrote:
>> > That's good to know.
>> >
>> >
>> > Thank you
>> >
>> >
>> > On 5/4/17 6:46 PM, Anders Andersson wrote:
>> > > On Fri, May 5, 2017 at 1:17 AM, Sergei G <sergeig.public@gmail.com>
>> wrote:
>> > > > I would like a backup tool that does not bring a million
>> dependencies with
>> > > > MBs of files.  Something that works on server without X Windows and
>> can send
>> > > > backup to an externally attached USB drive.  Nothing fancy.   No
>> network
>> > > > infrastructure.  Incremental backups would be greatly appreciated.
>> Ability
>> > > > to pipe to a compression program is a plus, just like I did with
>> dump.
>> > > > [...]
>> > > > Any advice would be greatly appreciated.
>> > > You won't like my solution, and it doesn't work with your current
>> > > setup because it requires a specific file system: btrfs[1]. I'm
>> > > posting it here for two reasons:
>> > >   1) You might consider using btrfs on new installs
>> > >   2) Someone else may search and find the thread
>> > >
>> > > After switching to btrfs I can now take instant snapshots of selected
>> > > filesystems, transfer these to remote servers for backup, and most
>> > > important: btrfs can track the *exact difference* between two
>> > > snapshots taken over time, and only transfer the changes. All of this
>> > > is very quick, because the filesystem already knows exactly what
>> > > changed: Permission bits, file sizes, deleted files, changed data,
>> > > whatever, all is already kept in a log. It also means that nothing
>> > > will be missed, for example ACL bits etc.
>> > >
>> > > The delta is just a simple stream of data that can be compressed if
>> > > necessary. Typically it is transmitted to a backup server where it is
>> > > "replayed" so that you have a full clone of the original system.[2]
>> > >
>> > > In debian I use the little tool, btrbk[3], to automate all of this.
>> > > You can simply do it manually if you want.
>> > >
>> > > [1] https://btrfs.wiki.kernel.org/index.php/Main_Page
>> > > [2] https://btrfs.wiki.kernel.org/index.php/Incremental_Backup
>> > > [3] https://github.com/digint/btrbk
>> > >
>> >
>>
>> Perhaps rsync can do the job for you?
>>
>>
>

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Live Fille System Backup Sergei G <sergeig.public@gmail.com> - 2017-05-05 01:20 +0200
  Re: Live Fille System Backup Anders Andersson <pipatron@gmail.com> - 2017-05-05 03:50 +0200
    Re: Live Fille System Backup Sergei G <sergeig.public@gmail.com> - 2017-05-05 06:50 +0200
      Re: Live Fille System Backup Dejan Jocic <jodejka@gmail.com> - 2017-05-05 09:00 +0200
        Re: Live Fille System Backup Sergei G <sergeig.public@gmail.com> - 2017-05-05 22:40 +0200
          Re: Live Fille System Backup Sergei G <sergeig.public@gmail.com> - 2017-05-05 23:20 +0200
            Re: Live Fille System Backup Henrique de Moraes Holschuh <hmh@debian.org> - 2017-05-06 00:00 +0200
              Re: Live Fille System Backup conover@rahul.net (John Conover) - 2017-05-06 01:30 +0200
                Re: Live Fille System Backup Henrique de Moraes Holschuh <hmh@debian.org> - 2017-05-06 02:30 +0200
          Re: Live Fille System Backup Henrique de Moraes Holschuh <hmh@debian.org> - 2017-05-06 00:00 +0200
          Re: Live Fille System Backup <tomas@tuxteam.de> - 2017-05-06 08:00 +0200
            Re: Live Fille System Backup Dan Ritter <dsr@randomstring.org> - 2017-05-06 12:50 +0200
              Re: Live Fille System Backup tomas@tuxteam.de - 2017-05-06 16:00 +0200
                Re: Live Fille System Backup Henrique de Moraes Holschuh <hmh@debian.org> - 2017-05-06 19:20 +0200
                Re: Live Fille System Backup <tomas@tuxteam.de> - 2017-05-06 21:50 +0200
                Re: Live Fille System Backup Henrique de Moraes Holschuh <hmh@debian.org> - 2017-05-06 23:10 +0200
                Re: Live Fille System Backup Ben Caradoc-Davies <ben@transient.nz> - 2017-05-07 01:00 +0200
                Re: Live Fille System Backup <tomas@tuxteam.de> - 2017-05-07 12:00 +0200
                Re: Live Fille System Backup rhkramer@gmail.com - 2017-05-07 14:50 +0200
                Re: Live Fille System Backup <tomas@tuxteam.de> - 2017-05-07 17:00 +0200
                Re: Live Fille System Backup Sergei G <sergeig.public@gmail.com> - 2017-05-09 00:50 +0200
                Re: Live Fille System Backup Sergei G <sergeig.public@gmail.com> - 2017-05-09 01:10 +0200
                Re: Live Fille System Backup tomas@tuxteam.de - 2017-05-09 10:00 +0200
                Re: Live Fille System Backup Greg Wooledge <wooledg@eeg.ccf.org> - 2017-05-09 14:10 +0200
                Re: Live Fille System Backup <tomas@tuxteam.de> - 2017-05-09 14:30 +0200
                Re: Live Fille System Backup Curt <curty@free.fr> - 2017-05-09 15:20 +0200
                Re: Live Fille System Backup Curt <curty@free.fr> - 2017-05-09 14:10 +0200
                Re: Live Fille System Backup <tomas@tuxteam.de> - 2017-05-09 14:30 +0200
  Re: Live Fille System Backup <tomas@tuxteam.de> - 2017-05-05 09:20 +0200
  Re: Live Fille System Backup Bob Weber <bobrweber@gmail.com> - 2017-05-06 01:00 +0200
  Re: Live Fille System Backup Stefan Monnier <monnier@iro.umontreal.ca> - 2017-05-12 15:00 +0200
    Re: Live Fille System Backup Sergei G <sergeig.public@gmail.com> - 2017-05-25 05:40 +0200

csiph-web