Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.sys.raspberry-pi > #25726 > unrolled thread
| Started by | nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) |
|---|---|
| First post | 2021-01-10 17:46 +1300 |
| Last post | 2021-01-11 15:39 +0000 |
| Articles | 20 on this page of 66 — 14 participants |
Back to article view | Back to comp.sys.raspberry-pi
My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-10 17:46 +1300
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-11 04:10 +0000
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-12 00:28 +1300
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-12 10:26 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-12 10:57 +0000
Re: My darn NAS... Dennis Lee Bieber <wlfraed@ix.netcom.com> - 2021-01-12 12:16 -0500
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-12 18:04 +0000
Re: My darn NAS... Ahem A Rivet's Shot <steveo@eircom.net> - 2021-01-12 18:38 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-13 12:20 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-13 12:42 +0000
Re: My darn NAS... Ahem A Rivet's Shot <steveo@eircom.net> - 2021-01-13 12:39 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-13 14:23 +0000
Re: My darn NAS... Ahem A Rivet's Shot <steveo@eircom.net> - 2021-01-13 18:21 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-13 19:25 +0000
Re: My darn NAS... Daniel James <daniel@me.invalid> - 2021-01-14 12:58 +0000
Re: My darn NAS... TimS <timstreater@greenbee.net> - 2021-01-14 13:10 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-14 13:35 +0000
Re: My darn NAS... Scott Alfter <scott@alfter.diespammersdie.us> - 2021-01-13 17:33 +0000
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-13 16:22 +1300
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-12 13:20 +1300
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-13 09:46 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-13 12:21 +0000
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-13 16:20 +1300
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 08:56 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-14 11:06 +0000
Re: My darn NAS... TimS <timstreater@greenbee.net> - 2021-01-14 11:43 +0000
Re: My darn NAS... Ahem A Rivet's Shot <steveo@eircom.net> - 2021-01-14 12:22 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-14 12:43 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 13:29 +0000
Re: My darn NAS... druck <news@druck.org.uk> - 2021-01-14 17:42 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-14 12:36 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 13:22 +0000
Re: My darn NAS... nospam.Richard.Falken@f1.n770.z6840.fidonet.org (Richard Falken) - 2021-01-14 11:45 +1300
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 18:05 +0000
Re: My darn NAS... TimS <timstreater@greenbee.net> - 2021-01-14 18:29 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 18:35 +0000
Re: My darn NAS... TimS <timstreater@greenbee.net> - 2021-01-15 11:25 +0000
Re: My darn NAS... nospam.Richard.Falken@f1.n770.z6810.fidonet.org (Richard Falken) - 2021-01-14 06:36 +1300
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-14 12:53 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 13:19 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-14 14:29 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 14:52 +0000
Re: My darn NAS... druck <news@druck.org.uk> - 2021-01-14 17:31 +0000
Re: My darn NAS... Martin Gregorie <martin@mydomain.invalid> - 2021-01-14 13:24 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-14 13:39 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 14:07 +0000
Re: My darn NAS... Martin Gregorie <martin@mydomain.invalid> - 2021-01-14 15:22 +0000
Re: My darn NAS... Scott Alfter <scott@alfter.diespammersdie.us> - 2021-01-14 20:08 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-15 08:34 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-14 13:17 +0000
Re: My darn NAS... Pancho <Pancho.Dontmaileme@outlook.com> - 2021-01-16 12:30 +0000
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-18 17:57 +1300
Re: My darn NAS... Martin Gregorie <martin@mydomain.invalid> - 2021-01-19 13:37 +0000
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-21 18:06 +1300
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-11 10:15 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-11 15:16 +0000
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-11 15:31 +0000
Re: My darn NAS... Chris Green <cl@isbd.net> - 2021-01-11 18:05 +0000
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-12 00:31 +1300
Re: My darn NAS... Dennis Lee Bieber <wlfraed@ix.netcom.com> - 2021-01-12 12:19 -0500
Re: My darn NAS... The Natural Philosopher <tnp@invalid.invalid> - 2021-01-13 12:09 +0000
Re: My darn NAS... druck <news@druck.org.uk> - 2021-01-11 10:25 +0000
Re: My darn NAS... nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) - 2021-01-12 00:35 +1300
Re: My darn NAS... Dennis Lee Bieber <wlfraed@ix.netcom.com> - 2021-01-12 12:25 -0500
Re: My darn NAS... druck <news@druck.org.uk> - 2021-01-12 19:32 +0000
Re: My darn NAS... "NY" <me@privacy.invalid> - 2021-01-11 15:39 +0000
Page 3 of 4 — ← Prev page 1 2 [3] 4 Next page →
| From | The Natural Philosopher <tnp@invalid.invalid> |
|---|---|
| Date | 2021-01-14 14:29 +0000 |
| Message-ID | <rtpkft$rjp$3@dont-email.me> |
| In reply to | #25905 |
On 14/01/2021 13:19, Chris Green wrote: > The Natural Philosopher <tnp@invalid.invalid> wrote: >> On 13/01/2021 17:36, Richard Falken wrote: >>> Re: Re: My darn NAS... >>> By: The Natural Philosopher to Chris Green on Thu Jan 14 2021 11:06 am >>> >>> > depends on what you want. I rsync huge amounts of data. Disk space is >>> > cheap. Recovering from data loss is not, Working out what is important >>> > and what is not is even more expensive. >>> > >>> >>> I agree with this position. >>> >>> I know that just backing up the data that is not easily reproductible suffices, >>> in theory. However, if you only back the data up without the applications and >>> the OS stack, your recovery consits on a sysadmin installing software for a >>> week and swearing at his notebook. >>> >>> >> Well I do reinstall all apps BUT remembering what the config files were >> called, what changes were made and where they were, is something I >> prefer to leave for that recovery phase. >> > I make very sure that all the configuration is either in /home or > /etc, most programs do behave properly and keep their configurations > in the right place. > > >> In general a well crashed primary disk is an excuse to upgrade everything... >> > Yes, so why would one back up /usr ?? > Because /usr/local and /usr/lib is full of nice stuff like fonts and screensave backgrounds and the like -- In a Time of Universal Deceit, Telling the Truth Is a Revolutionary Act. - George Orwell
[toc] | [prev] | [next] | [standalone]
| From | Chris Green <cl@isbd.net> |
|---|---|
| Date | 2021-01-14 14:52 +0000 |
| Message-ID | <de26dh-6adc1.ln1@esprimo.zbmc.eu> |
| In reply to | #25916 |
The Natural Philosopher <tnp@invalid.invalid> wrote: > On 14/01/2021 13:19, Chris Green wrote: > > The Natural Philosopher <tnp@invalid.invalid> wrote: > >> On 13/01/2021 17:36, Richard Falken wrote: > >>> Re: Re: My darn NAS... > >>> By: The Natural Philosopher to Chris Green on Thu Jan 14 2021 11:06 am > >>> > >>> > depends on what you want. I rsync huge amounts of data. Disk space is > >>> > cheap. Recovering from data loss is not, Working out what is important > >>> > and what is not is even more expensive. > >>> > > >>> > >>> I agree with this position. > >>> > >>> I know that just backing up the data that is not easily reproductible suffices, > >>> in theory. However, if you only back the data up without the applications and > >>> the OS stack, your recovery consits on a sysadmin installing software for a > >>> week and swearing at his notebook. > >>> > >>> > >> Well I do reinstall all apps BUT remembering what the config files were > >> called, what changes were made and where they were, is something I > >> prefer to leave for that recovery phase. > >> > > I make very sure that all the configuration is either in /home or > > /etc, most programs do behave properly and keep their configurations > > in the right place. > > > > > >> In general a well crashed primary disk is an excuse to upgrade everything... > >> > > Yes, so why would one back up /usr ?? > > > Because /usr/local and /usr/lib is full of nice stuff like fonts and > screensave backgrounds and the like > I do actually back up /usr/local, as far as I'm aware there's nothing in my /usr/lib that isn't simply a package I can download from the repositories. I do keep a record of everything that I have installed in addition to a standard basic install of xubuntu, as well as my record I use synaptic which also keeps a history of what has been installed. -- Chris Green ·
[toc] | [prev] | [next] | [standalone]
| From | druck <news@druck.org.uk> |
|---|---|
| Date | 2021-01-14 17:31 +0000 |
| Message-ID | <rtpv63$l7d$1@dont-email.me> |
| In reply to | #25905 |
On 14/01/2021 13:19, Chris Green wrote: > I make very sure that all the configuration is either in /home or > /etc, most programs do behave properly and keep their configurations > in the right place. The etckeeper package is very useful to keep the changes to config files in a git repo, which can be pushed up to your backup sever on a cron job. Being git you can put a commit message on any changes, so you know why you had to make the change - very useful for knowing what to change on a fresh system too, or reverting it when no longer needed. It will also automatically commit the changes from updates making it very easy to solve problems from config files being overwritten by the package manager. ---druck
[toc] | [prev] | [next] | [standalone]
| From | Martin Gregorie <martin@mydomain.invalid> |
|---|---|
| Date | 2021-01-14 13:24 +0000 |
| Message-ID | <rtpgma$f78$2@dont-email.me> |
| In reply to | #25897 |
On Thu, 14 Jan 2021 06:36:06 +1300, Richard Falken wrote: > Re: Re: My darn NAS... > By: The Natural Philosopher to Chris Green on Thu Jan 14 2021 11:06 am > > > depends on what you want. I rsync huge amounts of data. Disk space is > > cheap. Recovering from data loss is not, Working out what is > > important and what is not is even more expensive. > > > > > I agree with this position. > > I know that just backing up the data that is not easily reproductible > suffices, > in theory. However, if you only back the data up without the > applications and the OS stack, your recovery consits on a sysadmin > installing software for a week and swearing at his notebook. Theres a simple tweak that fixes most of that stuff: move /usr/local to /home local and replace it with a symlink to /home/local I've done the the equivalent with my (large) PostgreSQL databases and my local Apache- based website (by default these are in /var, so I changed their configurations to put these files in /home too. Everything continues to work as before but now I've secured almost all of my own work and customisation by backing up /home The only thing thats not safeguarded now is the contents of /etc, so either back that up along with /home or keep copies of everything in /etc that you've explicitly changed in, say, your normal home login. I do the latter but of course ymmv. Changes in /etc made by software updates don't need backing up because they'll be automatically reapplied when you're rebuilding the failed device that holds your filing system. -- -- Martin | martin at Gregorie | gregorie dot org
[toc] | [prev] | [next] | [standalone]
| From | The Natural Philosopher <tnp@invalid.invalid> |
|---|---|
| Date | 2021-01-14 13:39 +0000 |
| Message-ID | <rtphie$881$1@dont-email.me> |
| In reply to | #25904 |
On 14/01/2021 13:24, Martin Gregorie wrote: > On Thu, 14 Jan 2021 06:36:06 +1300, Richard Falken wrote: > >> Re: Re: My darn NAS... >> By: The Natural Philosopher to Chris Green on Thu Jan 14 2021 11:06 am >> >> > depends on what you want. I rsync huge amounts of data. Disk space is >> > cheap. Recovering from data loss is not, Working out what is >> > important and what is not is even more expensive. >> > >> > >> I agree with this position. >> >> I know that just backing up the data that is not easily reproductible >> suffices, >> in theory. However, if you only back the data up without the >> applications and the OS stack, your recovery consits on a sysadmin >> installing software for a week and swearing at his notebook. > > Theres a simple tweak that fixes most of that stuff: move /usr/local to > /home local and replace it with a symlink to /home/local > > I've done the the equivalent with my (large) PostgreSQL databases and my > local Apache- based website (by default these are in /var, so I changed > their configurations to put these files in /home too. > > Everything continues to work as before but now I've secured almost all of > my own work and customisation by backing up /home > > The only thing thats not safeguarded now is the contents of /etc, so > either back that up along with /home or keep copies of everything in /etc > that you've explicitly changed in, say, your normal home login. I do the > latter but of course ymmv. Changes in /etc made by software updates don't > need backing up because they'll be automatically reapplied when you're > rebuilding the failed device that holds your filing system. > > what about /var that contains all the webs servers and Mysql databases by default? /opt as well has stuff in it. /boot has grub configs -- “Some people like to travel by train because it combines the slowness of a car with the cramped public exposure of an airplane.” Dennis Miller
[toc] | [prev] | [next] | [standalone]
| From | Chris Green <cl@isbd.net> |
|---|---|
| Date | 2021-01-14 14:07 +0000 |
| Message-ID | <hqv5dh-6m7c1.ln1@esprimo.zbmc.eu> |
| In reply to | #25909 |
The Natural Philosopher <tnp@invalid.invalid> wrote: > On 14/01/2021 13:24, Martin Gregorie wrote: > > On Thu, 14 Jan 2021 06:36:06 +1300, Richard Falken wrote: > > > >> Re: Re: My darn NAS... > >> By: The Natural Philosopher to Chris Green on Thu Jan 14 2021 11:06 am > >> > >> > depends on what you want. I rsync huge amounts of data. Disk space is > >> > cheap. Recovering from data loss is not, Working out what is > >> > important and what is not is even more expensive. > >> > > >> > > >> I agree with this position. > >> > >> I know that just backing up the data that is not easily reproductible > >> suffices, > >> in theory. However, if you only back the data up without the > >> applications and the OS stack, your recovery consits on a sysadmin > >> installing software for a week and swearing at his notebook. > > > > Theres a simple tweak that fixes most of that stuff: move /usr/local to > > /home local and replace it with a symlink to /home/local > > > > I've done the the equivalent with my (large) PostgreSQL databases and my > > local Apache- based website (by default these are in /var, so I changed > > their configurations to put these files in /home too. > > > > Everything continues to work as before but now I've secured almost all of > > my own work and customisation by backing up /home > > > > The only thing thats not safeguarded now is the contents of /etc, so > > either back that up along with /home or keep copies of everything in /etc > > that you've explicitly changed in, say, your normal home login. I do the > > latter but of course ymmv. Changes in /etc made by software updates don't > > need backing up because they'll be automatically reapplied when you're > > rebuilding the failed device that holds your filing system. > > > > > what about /var that contains all the webs servers and Mysql databases > by default? /opt as well has stuff in it. /boot has grub configs > I used to back up /var but I don't have any Mysql databases now, partly for this reason, and anyway backing up a database file while the server is running isn't a very good idea. The web server stuff I have symbolically linked to my home directory so it's backed up that way. I have nothing in /opt, I've checked, if I did I would add it to my backups. I *do* back up /usr/local. /boot configs are generated automatically at installation in general, I've not manually changed them. -- Chris Green ·
[toc] | [prev] | [next] | [standalone]
| From | Martin Gregorie <martin@mydomain.invalid> |
|---|---|
| Date | 2021-01-14 15:22 +0000 |
| Message-ID | <rtpnj5$f78$5@dont-email.me> |
| In reply to | #25909 |
On Thu, 14 Jan 2021 13:39:26 +0000, The Natural Philosopher wrote: > On 14/01/2021 13:24, Martin Gregorie wrote: >> On Thu, 14 Jan 2021 06:36:06 +1300, Richard Falken wrote: >> >>> Re: Re: My darn NAS... >>> By: The Natural Philosopher to Chris Green on Thu Jan 14 2021 11:06 >>> am >>> >>> > depends on what you want. I rsync huge amounts of data. Disk space >>> > is cheap. Recovering from data loss is not, Working out what is >>> > important and what is not is even more expensive. >>> > >>> > >>> I agree with this position. >>> >>> I know that just backing up the data that is not easily reproductible >>> suffices, >>> in theory. However, if you only back the data up without the >>> applications and the OS stack, your recovery consits on a sysadmin >>> installing software for a week and swearing at his notebook. >> >> Theres a simple tweak that fixes most of that stuff: move /usr/local to >> /home local and replace it with a symlink to /home/local >> >> I've done the the equivalent with my (large) PostgreSQL databases and >> my local Apache- based website (by default these are in /var, so I >> changed their configurations to put these files in /home too. >> >> Everything continues to work as before but now I've secured almost all >> of my own work and customisation by backing up /home >> >> The only thing thats not safeguarded now is the contents of /etc, so >> either back that up along with /home or keep copies of everything in >> /etc that you've explicitly changed in, say, your normal home login. I >> do the latter but of course ymmv. Changes in /etc made by software >> updates don't need backing up because they'll be automatically >> reapplied when you're rebuilding the failed device that holds your >> filing system. >> >> > what about /var that contains all the webs servers and Mysql databases > by default? /opt as well has stuff in it. /boot has grub configs As I said, I don't need to back up /var because I moved the stuff that defaults to /var that I've explicitly set up (PostgreSQL database, Apache website) into dedicated logins in /home and changed the PostgreSQL and Apache configurations accordingly. Copies of those configuration files are are in my main login directory, which is, of course, in /home and so automatically backed up along with everything else in it. I've never made changes in /opt, so I don't need to back it up: a reinstall will fix it. Similarly I haven't made any changes to the grub configuration, so don't need to back it up because the Fedora 'install over the net with dnf' will restore that automatically. -- -- Martin | martin at Gregorie | gregorie dot org
[toc] | [prev] | [next] | [standalone]
| From | Scott Alfter <scott@alfter.diespammersdie.us> |
|---|---|
| Date | 2021-01-14 20:08 +0000 |
| Message-ID | <Rw1MH.7684$Mh5.3042@fx29.iad> |
| In reply to | #25909 |
In article <rtphie$881$1@dont-email.me>, The Natural Philosopher <tnp@invalid.invalid> wrote: >what about /var that contains all the webs servers and Mysql databases >by default? /opt as well has stuff in it. /boot has grub configs Unless you're doing the stop/snapshot/restart thing, you shouldn't back up the files in /var/lib/mysql directory. It'd be better to dump them with mysqldump and back up those files, as mysqldump will only run once there are no transactions in flight (no need to stop/restart the server, either). Restoring from a copy of /var/lib/mysql can leave databases in an inconsistent state. _/_ / v \ Scott Alfter (remove the obvious to send mail) (IIGS( https://alfter.us/ Top-posting! \_^_/ >What's the most annoying thing on Usenet?
[toc] | [prev] | [next] | [standalone]
| From | The Natural Philosopher <tnp@invalid.invalid> |
|---|---|
| Date | 2021-01-15 08:34 +0000 |
| Message-ID | <rtrk1u$s0k$1@dont-email.me> |
| In reply to | #25927 |
On 14/01/2021 20:08, Scott Alfter wrote: > Restoring from a copy of /var/lib/mysql can leave databases in an > inconsistent state. With C-ISAM it is a useable state. -- Of what good are dead warriors? … Warriors are those who desire battle more than peace. Those who seek battle despite peace. Those who thump their spears on the ground and talk of honor. Those who leap high the battle dance and dream of glory … The good of dead warriors, Mother, is that they are dead. Sheri S Tepper: The Awakeners.
[toc] | [prev] | [next] | [standalone]
| From | Chris Green <cl@isbd.net> |
|---|---|
| Date | 2021-01-14 13:17 +0000 |
| Message-ID | <5ss5dh-gn1c1.ln1@esprimo.zbmc.eu> |
| In reply to | #25889 |
The Natural Philosopher <tnp@invalid.invalid> wrote: > On 14/01/2021 08:56, Chris Green wrote: > > When you backup a 1TB drive do you actually copy the whole 1TB? It's > > a huge waste of time and space and you can't keep so many backups. > > Use some form of incremental backup and also backup*selectively*. > > depends on what you want. I rsync huge amounts of data. Disk space is > cheap. Recovering from data loss is not, Working out what is important > and what is not is even more expensive. > I don't go to much detail, I just don't save stuff in cache directories or in directories named tmp. Doesn't take long and is kept in a file called .rsync-filter which rsync can use automatically. Having automatic, hourly and daily backups for the past several hours and days saves *a lot* of time! Once set up it takes none of my time at all. -- Chris Green ·
[toc] | [prev] | [next] | [standalone]
| From | Pancho <Pancho.Dontmaileme@outlook.com> |
|---|---|
| Date | 2021-01-16 12:30 +0000 |
| Message-ID | <rtum8n$dhl$1@dont-email.me> |
| In reply to | #25889 |
On 14/01/2021 11:06, The Natural Philosopher wrote: > On 14/01/2021 08:56, Chris Green wrote: >> When you backup a 1TB drive do you actually copy the whole 1TB? It's >> a huge waste of time and space and you can't keep so many backups. >> Use some form of incremental backup and also backup*selectively*. > > depends on what you want. I rsync huge amounts of data. Disk space is > cheap. Recovering from data loss is not, Working out what is important > and what is not is even more expensive. > One of the nice aspects of running apps/services in docker containers is that it encourages you to define data volumes and hence to immediately know what needs to be backed up.
[toc] | [prev] | [next] | [standalone]
| From | nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) |
|---|---|
| Date | 2021-01-18 17:57 +1300 |
| Message-ID | <2001947732@f420.n105.z1.binkp.net> |
| In reply to | #25883 |
CG> When you backup a 1TB drive do you actually copy the whole 1TB? It's CG> a huge waste of time and space and you can't keep so many backups. CG> Use some form of incremental backup and also backup *selectively*. No... I mean on my BBS box, I do backup all /files and... it's literally 500GB or so. But of course, for my Linux I'm just backing up /home and a few other spots where I hold my personal files. I also use a package that takes a 'snapshot' or basically a LISTING of every installed package on the system. Sometimes I'll forget what setup I have going, and I can go thru that listing and select what to reinstall very quickly. But, still, I'm backing up enough that speeds matter. I mean... don't speeds kinda always matter, anyway? :P |07p|15AULIE|1142|07o |08.........
[toc] | [prev] | [next] | [standalone]
| From | Martin Gregorie <martin@mydomain.invalid> |
|---|---|
| Date | 2021-01-19 13:37 +0000 |
| Message-ID | <ru6nag$ovq$1@dont-email.me> |
| In reply to | #25960 |
On Mon, 18 Jan 2021 17:57:22 +1300, paul lee wrote: > No... I mean on my BBS box, I do backup all /files and... it's literally > 500GB or so. But of course, for my Linux I'm just backing up /home and a > few other spots where I hold my personal files. I also use a package > that takes a 'snapshot' or basically a LISTING of every installed > package on the system. > What OS do you use on the BBS box? > But, still, I'm backing up enough that speeds matter. > I mean... don't speeds kinda always matter, anyway? > Have you tried rsync and/or rsnapshot? I used to back up my house server using tar with the compress (gzip) option and a relatively small group of files/directories skipped such as /tmp - that took 3.5 hours a night, backing up to a USB hard drive. Now I'm using rsnapshot to keep 7 daily backups plus another 4 weeklies and the typical backup time has dropped to 8 minutes for the daily run and 9 minutes for the weekly one. -- Martin | martin at Gregorie | gregorie dot org
[toc] | [prev] | [next] | [standalone]
| From | nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) |
|---|---|
| Date | 2021-01-21 18:06 +1300 |
| Message-ID | <4156610375@f420.n105.z1.binkp.net> |
| In reply to | #25967 |
MG> > No... I mean on my BBS box, I do backup all /files and... it's literally MG> > 500GB or so. But of course, for my Linux I'm just backing up /home and a MG> > few other spots where I hold my personal files. I also use a package MG> > that takes a 'snapshot' or basically a LISTING of every installed MG> > package on the system. MG> > MG> What OS do you use on the BBS box? Raspberry Pi OS MG> > But, still, I'm backing up enough that speeds matter. MG> > I mean... don't speeds kinda always matter, anyway? MG> Have you tried rsync and/or rsnapshot? I use rsync and yea, it only takes minutes per night unless I've added tons of files to the bases... |07p|15AULIE|1142|07o |08.........
[toc] | [prev] | [next] | [standalone]
| From | Chris Green <cl@isbd.net> |
|---|---|
| Date | 2021-01-11 10:15 +0000 |
| Message-ID | <r3ltch-mgpq.ln1@esprimo.zbmc.eu> |
| In reply to | #25726 |
paul lee <nospam.paul.lee@f420.n105.z1.binkp.net> wrote: [snip speeds etc.] FWIW here are some figures I just got copy a large file across my network to my Pi 'NAS':- chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup:/bak/esprimo/cur/home/chris 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38 chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup: 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38 As you can see I was using scp, the first copy is to an external USB3 hard drive, the second is to the Pi's SD card. As you can see the speed is identical which suggests to me that it's limited almost entirely by the network rather than the Pi's internals. It's all Gigabit (I checked), out of 'esprimo' which is a desktop machine, via a switch near my desktop, along buried UTP to another switch in the garage and thence to the Pi. -- Chris Green ·
[toc] | [prev] | [next] | [standalone]
| From | Chris Green <cl@isbd.net> |
|---|---|
| Date | 2021-01-11 15:16 +0000 |
| Message-ID | <nn6uch-vn0s.ln1@esprimo.zbmc.eu> |
| In reply to | #25739 |
Chris Green <cl@isbd.net> wrote:
> paul lee <nospam.paul.lee@f420.n105.z1.binkp.net> wrote:
> [snip speeds etc.]
>
> FWIW here are some figures I just got copy a large file across my
> network to my Pi 'NAS':-
>
> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup:/bak/esprimo/cur/home/chris
> 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38
> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup:
> 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38
>
The above speeds are wrong, I think one of my switches was playing up,
revised speeds as follows:-
Desktop to backup SD card:-
bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 20.6MB/s 00:41
bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 21.3MB/s 00:39
Desktop to backup external USB3 hard drive:-
bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 47.3MB/s 00:17
bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 45.3MB/s 00:18
Backup to desktop, from SD card:-
bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 36.9MB/s 00:23
Backup to desktop, from external USB3 hard drive:-
bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 39.2MB/s 00:21
So, getting on for half the theoretical speed over a Gigabit network in the best case.
--
Chris Green
·
[toc] | [prev] | [next] | [standalone]
| From | The Natural Philosopher <tnp@invalid.invalid> |
|---|---|
| Date | 2021-01-11 15:31 +0000 |
| Message-ID | <rthr03$giv$2@dont-email.me> |
| In reply to | #25750 |
On 11/01/2021 15:16, Chris Green wrote: > Chris Green <cl@isbd.net> wrote: >> paul lee <nospam.paul.lee@f420.n105.z1.binkp.net> wrote: >> [snip speeds etc.] >> >> FWIW here are some figures I just got copy a large file across my >> network to my Pi 'NAS':- >> >> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup:/bak/esprimo/cur/home/chris >> 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38 >> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup: >> 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38 >> > The above speeds are wrong, I think one of my switches was playing up, > revised speeds as follows:- > > Desktop to backup SD card:- > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 20.6MB/s 00:41 > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 21.3MB/s 00:39 > > Desktop to backup external USB3 hard drive:- > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 47.3MB/s 00:17 > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 45.3MB/s 00:18 > > Backup to desktop, from SD card:- > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 36.9MB/s 00:23 > > Backup to desktop, from external USB3 hard drive:- > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 39.2MB/s 00:21 > > So, getting on for half the theoretical speed over a Gigabit network in the best case. > Mmm. I get pretty close to my 100Mbps network against a linux server with NFS. -- Canada is all right really, though not for the whole weekend. "Saki"
[toc] | [prev] | [next] | [standalone]
| From | Chris Green <cl@isbd.net> |
|---|---|
| Date | 2021-01-11 18:05 +0000 |
| Message-ID | <ujguch-qtjs.ln1@esprimo.zbmc.eu> |
| In reply to | #25751 |
The Natural Philosopher <tnp@invalid.invalid> wrote: > On 11/01/2021 15:16, Chris Green wrote: > > Chris Green <cl@isbd.net> wrote: > >> paul lee <nospam.paul.lee@f420.n105.z1.binkp.net> wrote: > >> [snip speeds etc.] > >> > >> FWIW here are some figures I just got copy a large file across my > >> network to my Pi 'NAS':- > >> > >> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup:/bak/esprimo/cur/home/chris > >> 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38 > >> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup: > >> 2020-08-20-raspios-buster-armhf-lite.zip 100% 434MB 11.2MB/s 00:38 > >> > > The above speeds are wrong, I think one of my switches was playing up, > > revised speeds as follows:- > > > > Desktop to backup SD card:- > > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 20.6MB/s 00:41 > > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 21.3MB/s 00:39 > > > > Desktop to backup external USB3 hard drive:- > > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 47.3MB/s 00:17 > > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 45.3MB/s 00:18 > > > > Backup to desktop, from SD card:- > > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 36.9MB/s 00:23 > > > > Backup to desktop, from external USB3 hard drive:- > > bone-debian-9.4-console-armhf-2018-07-08-1gb.img 100% 850MB 39.2MB/s 00:21 > > > > So, getting on for half the theoretical speed over a Gigabit network in the best case. > > > Mmm. I get pretty close to my 100Mbps network against a linux server > with NFS. > From desktop to/from laptop I too get something over 100MBps on my Gigabit network. The Pi4 (as can be seen above) is somewhat slower, but not hugely. ... and the Pi doesn't have a particularly fast disk, unlike my desktop and laptop which both have NVME SSDs. -- Chris Green ·
[toc] | [prev] | [next] | [standalone]
| From | nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) |
|---|---|
| Date | 2021-01-12 00:31 +1300 |
| Message-ID | <2643621608@f420.n105.z1.binkp.net> |
| In reply to | #25739 |
CG> FWIW here are some figures I just got copy a large file across my CG> network to my Pi 'NAS':- CG> CG> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip CG> backup:/bak/esprimo/cur/home/chris CG> 2020-08-20-raspios-buster-armhf-lite.zip 100% CG> 434MB 11.2MB/s 00:38 CG> chris@esprimo$ scp 2020-08-20-raspios-buster-armhf-lite.zip backup: CG> 2020-08-20-raspios-buster-armhf-lite.zip 100% CG> 434MB 11.2MB/s 00:38 CG> CG> As you can see I was using scp, the first copy is to an external USB3 CG> hard drive, CG> the second is to the Pi's SD card. As you can see the speed is CG> identical whichsuggests to me that it's limited almost entirely by the CG> network rather than thePi's internals. CG> CG> It's all Gigabit (I checked), out of 'esprimo' which is a desktop CG> machine, via a CG> switch near my desktop, along buried UTP to another switch in the garage CG> andthence to the Pi. CG> CG> -- CG> Chris Green Thanks for your reply... I was told by another poster that I, since the laptop I use connects via wifi, should consider my 12mb speeds normal - So I am going to connect said laptop to the ethernet connection and test both Pi's again. (pi 3 and pi 4...) Thanks for your info; that is about what I'm getting from BOTH the Pi 3 and the Pi 4; which are both connected to the ethernet connection, but pulling TO my laptop Thinkpad T430s which is on its older WiFi chip/card. Thanks again... |07p|15AULIE|1142|07o |08.........
[toc] | [prev] | [next] | [standalone]
| From | Dennis Lee Bieber <wlfraed@ix.netcom.com> |
|---|---|
| Date | 2021-01-12 12:19 -0500 |
| Message-ID | <9fmrvft46qnqvj8mg2nq2emkm4fagbdj7i@4ax.com> |
| In reply to | #25772 |
On Tue, 12 Jan 2021 00:31:38 +1300, nospam.paul.lee@f420.n105.z1.binkp.net (paul lee) declaimed the following: >Thanks for your reply... I was told by another poster that I, since the laptop >I use connects via wifi, should consider my 12mb speeds normal - > https://www.speedguide.net/faq/what-is-the-actual-real-life-speed-of-wireless-374 -- Wulfraed Dennis Lee Bieber AF6VN wlfraed@ix.netcom.com http://wlfraed.microdiversity.freeddns.org/
[toc] | [prev] | [next] | [standalone]
Page 3 of 4 — ← Prev page 1 2 [3] 4 Next page →
Back to top | Article view | comp.sys.raspberry-pi
csiph-web