Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.os.linux.misc > #27888

Re: Question re alt.comp.os.linux

From "Carlos E.R." <robin_listas@es.invalid>
Newsgroups comp.os.linux.misc, alt.os.linux
Subject Re: Question re alt.comp.os.linux
Date 2019-08-21 11:32 +0200
Message-ID <8nfv2g-j0r.ln1@Telcontar.valinor> (permalink)
References (7 earlier) <qqfr2g-ovi.ln1@Telcontar.valinor> <gs0m0rF2j7dU1@mid.individual.net> <qjf989$53a$1@dont-email.me> <3q3u2g-59c.ln1@Telcontar.valinor> <qjhq86$o14$1@dont-email.me>

Cross-posted to 2 groups.

Show all headers | View raw


On 20/08/2019 23.55, Paul wrote:
> Carlos E.R. wrote:
>> On 20/08/2019 00.52, Paul wrote:
>>> Mike Easter wrote:
>>>> Carlos E.R. wrote:
>>>>> The messages and the group are there in
>>>>> leafnode, but Th thinks not and insists on deleting the subscription.
>>>> Tb has a method of clearing its index.
>>>>
>>>> If you are in Classic view w/ a folder pane, select the problem group
>>>> and R click it and use the context menu for Properties.  In the window
>>>> that comes up (Folder properties title) select the Repair folder
>>>> button.  That will effectively delete the .msf file for the group.
>>>>
>>>> You will lose your pointers for the group and the msg index will be
>>>> empty and need to be repopulated by dl/ing xx msgs (which is actually
>>>> the msg headers only).
>>>>
>>>> If leafnode has those msgs and Tb and leafnode are in harmony, it
>>>> should dl what leafnode has.
>>>>
>>> I think I would take a backup before punching buttons
>>> on a thing with "a million" or "millions of files"
>>> behind it.
>>>
>>> This sounds like some kind of "hard drive punishment test" :-)
>>
>> It is :-)
>>
>> I can see the hard disks grinding when I trigger a backup - a day and a
>> half. Not of news, but everything.
>>
>>
>> Once I tested several filesystems types by creating a million small
>> files in a single directory. Only two passed: reiserfs brilliantly, and
>> xfs (I think this got full at 800000 or so). btrfs crashed itself and
>> crashed the machine, and before that it got veeeery slow.
> 
> Macrium Reflect Free does a "sequential cluster backup".
> It makes a list, in increasing order, of every cluster that
> makes up the file system.

<https://en.wikipedia.org/wiki/Macrium_Reflect>

«Macrium Reflect is backup utility for Microsoft Windows developed by
Paramount Software UK Ltd in 2006. It creates disk images and file
backup archives using Microsoft Volume Shadow Copy Service to ensure
'point in time' data»


Remember that I use Linux?

> 
> The advantage of this during backups, is less "random access"
> of the disk surface during a backup.
> 
> *******
> 
> If you used an SSD for the million files, backup would
> take no time at all.


And do two million accesses to the ssd, wearing it out. No thank you.


When I want to do an efficient backup of the news store, I use a tar
archive. That is reasonably fast and compact.

> *******
> 
> If there are too many small files on a rotating disk drive, to make
> for an efficient file-by-file access, you can always do a
> "dd" backup instead. It isn't very often though, that the
> conditions are right for that. It can turn a 10 minute
> backup effort into a 15 hour job. However, if your backup
> takes a day and a half anyway, then fifteen hours is an improvement :-/

Certainly, I know. It would actually take longer, as it has to backup
empty disk space as well. Now, clonezilla would be faster, but I would
have to pull the computer off line.  I use rsync while actually using
the computer. I know it is not a static photo, but it is good enough.



My intention here was not look for a better backup strategy, but show
the effects of a million files store, even on simple operations such as
"delete tree".

-- 
Cheers, Carlos.

Back to comp.os.linux.misc | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-14 22:49 +0200
  Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-14 17:30 -0400
    Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 00:17 +0200
      Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-14 18:30 -0400
        Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 12:49 +0200
          Re: Question re alt.comp.os.linux wimpunk <wimpunk+news@gmail.com> - 2019-08-19 16:21 +0200
            Re: Question re alt.comp.os.linux The Natural Philosopher <tnp@invalid.invalid> - 2019-08-19 16:27 +0100
              Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-19 23:10 +0200
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-19 23:50 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 22:58 +0200
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-21 16:37 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:57 +0200
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-22 07:37 +0200
                Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-21 21:37 -0600
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-22 07:35 +0200
                Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-19 15:26 -0700
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-19 18:52 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 23:03 +0200
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-20 17:55 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-21 11:32 +0200
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-21 07:13 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:44 +0200
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-21 07:42 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:28 +0200
                Re: Question re alt.comp.os.linux William Unruh <unruh@invalid.ca> - 2019-08-21 15:43 +0000
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:30 +0200
                Re: Question re alt.comp.os.linux The Natural Philosopher <tnp@invalid.invalid> - 2019-08-21 17:53 +0100
                Re: Question re alt.comp.os.linux Eli the Bearded <*@eli.users.panix.com> - 2019-08-21 18:53 +0000
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:53 +0200
                Re: Question re alt.comp.os.linux Eli the Bearded <*@eli.users.panix.com> - 2019-08-22 02:33 +0000
                Re: Question re alt.comp.os.linux Wildman <best_lay@yahoo.com> - 2019-08-21 22:24 -0500
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-24 09:42 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:48 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 22:58 +0200
  Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-14 17:56 -0400
  Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-14 15:23 -0700
    Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 12:52 +0200
      Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-15 07:14 -0700
      Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-15 17:33 +0200
        Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 17:57 +0200
          Re: Question re alt.comp.os.linux jrg <jeff.g.group@att.net> - 2019-08-15 10:24 -0700
            Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 19:40 +0200
              Re: Question re alt.comp.os.linux John-Paul Stewart <jpstewart@sympatico.ca> - 2019-08-15 15:09 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 21:33 +0200
                Re: Question re alt.comp.os.linux John-Paul Stewart <jpstewart@sympatico.ca> - 2019-08-15 16:03 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 22:17 +0200
            Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-15 12:53 -0600
              Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 21:33 +0200
          Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-15 15:42 -0400
  Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-14 19:33 -0600
  Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-14 23:52 -0400
  Re: Question re alt.comp.os.linux Chris Elvidge <chris@mshome.net> - 2019-08-15 11:35 +0200
  Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-08-31 02:15 +1000
    Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-30 20:24 -0400
    Re: Question re alt.comp.os.linux William Unruh <unruh@invalid.ca> - 2019-08-31 03:54 +0000
      Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-31 00:03 -0400
        Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-02 13:37 +1000
          Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-09-02 19:54 -0400
            Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-04 19:37 +1000
      Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-02 13:34 +1000

csiph-web