Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > alt.comp.os.windows-10 > #181482
| From | Paul <nospam@needed.invalid> |
|---|---|
| Newsgroups | comp.os.linux.advocacy, alt.comp.os.windows-10 |
| Subject | Re: Cult of Unix |
| Date | 2025-01-17 02:10 -0500 |
| Organization | A noiseless patient Spider |
| Message-ID | <vmcvoo$3umjn$1@dont-email.me> (permalink) |
| References | (13 earlier) <lusp13Frb66U1@mid.individual.net> <vmbrbq$3ln7i$1@dont-email.me> <vmc3cq$3n232$1@dont-email.me> <vmcgfd$3osq8$2@dont-email.me> <luu2eeF3kf9U1@mid.individual.net> |
Cross-posted to 2 groups.
On Thu, 1/16/2025 10:51 PM, vallor wrote:
> On Fri, 17 Jan 2025 02:49:17 -0000 (UTC), Lawrence D'Oliveiro
> <ldo@nz.invalid> wrote in <vmcgfd$3osq8$2@dont-email.me>:
>
>> On Thu, 16 Jan 2025 18:06:00 -0500, Paul wrote:
>>
>>> You can freeze a copy of C: for example, and run a Robocopy over it.
>>
>> Until you hit the limitations of Windows and Robocopy, and have to give
>> up on it and use Linux instead.
>>
>> <https://www.theregister.com/2010/09/24/sysadmin_file_tools/>
>
> I suspect things may have changed in the last *14 years*.
>
I think we discussed this one already.
That's *not* how you transfer sixty million files.
You image the partition with a cluster level tool,
and by comparison to file level, it screams. It
runs at disk speed.
Then at the other machine, you restore at the cluster
level. Now, all sixty million files are there, and you've
saved enough time to take a vacation.
I have samples of fragmented volumes here, stored as .mrimg .
If I want to show an example of a fragmented volume, I can load
one of those up in about ten minutes or so. The top one, is
64 million files stored in a single directory. The second one
is 64 million files in a tree.
writeflat-64million-Ddrive-736391-00-00.mrimg 2,323,353,194 bytes
writeidx4-64million-Ddrive-736391-00-00.mrimg 2,381,377,130 bytes
It's the same with using 7ZIP for archiving. 7ZIP can run pretty
fast, on solid block files of a good size. However, if you feed it
a tree structure full of small files, it doesn't matter how fast your
CPU is, the program "starves" for want of responses from the file system.
You might get 10MB/sec from it. That's because the disk heads are
flying around. Even if you use my RAMDrive for this, it's *still*
slow. That doesn't help either, as just the file system stack takes
too long per file handled.
But working at the cluster level works a treat, a backup and restore
and you're done. And it isn't even lunch hour yet. It does take
time, for the backup tool to "crawl" the tree and make the
index they like to use. That's still an expensive part of it.
If you attack that problem file-by-file, it's the heat death of the
universe bad.
dir in command prompt took four minutes. Dumped to list.txt
$ tail list.txt
05/26/2024 06:09 AM 7 3FFFFF8.txt
05/26/2024 06:09 AM 7 3FFFFF9.txt
05/26/2024 06:09 AM 7 3FFFFFA.txt
05/26/2024 06:09 AM 7 3FFFFFB.txt
05/26/2024 06:09 AM 7 3FFFFFC.txt
05/26/2024 06:09 AM 7 3FFFFFD.txt
05/26/2024 06:09 AM 7 3FFFFFE.txt
05/26/2024 06:09 AM 7 3FFFFFF.txt
67108864 File(s) 469,762,048 bytes
1 Dir(s) 7,497,859,072 bytes free
$ head list.txt
Volume in drive F is RAMDrive
Volume Serial Number is 50A8-F4E5
Directory of F:\out
05/26/2024 06:09 AM <DIR> .
05/26/2024 04:47 AM 7 0000000.txt
05/26/2024 04:47 AM 7 0000001.txt
05/26/2024 04:47 AM 7 0000002.txt
05/26/2024 04:47 AM 7 0000003.txt
$ wc -l list.txt
67108872 list.txt
Windows has a copy of tar.exe in System32 now, and I
can try that, but it processes about 10MB/sec. A wild guess
is that this might take two hours, but I can't really be sure.
(You can't afford to turn on Verbose, or the terminal
might become the limiting factor.)
I'm trying to avoid explorer.exe getting a "whiff" of
the folder, because once that happens, explorer rails
on one core as it counts files and so on. The way to stop
explorer.exe from working on that, is to rip the file system
away, and once the "pointer" to the file system is not
available any more, it stops. You would not want explorer.exe
doing the copy. tar.exe is looking less efficient than
a backup and restore (the restore of 64 million files took
about 3 minutes 40 seconds). You can also kill explorer.exe in
Task Manager and start another one, if you like.
Robocopy should not be counting files like explorer.exe does
when it prepares to do a copy, but I would expect it's going
to be one of those two hour things. It's going to be in a
different ballpark.
Paul
Back to alt.comp.os.windows-10 | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
Re: Microsoft to force new Outlook on Windows 10 PCs Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-12 23:23 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs MikeS <MikeS@fred.com> - 2025-01-13 21:25 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Joel <joelcrump@gmail.com> - 2025-01-13 16:32 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs CrudeSausage <crude@sausa.ge> - 2025-01-13 17:44 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Joel <joelcrump@gmail.com> - 2025-01-13 17:54 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs CrudeSausage <crude@sausa.ge> - 2025-01-13 18:10 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Joel <joelcrump@gmail.com> - 2025-01-13 18:25 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Hank Rogers <Hank@nospam.invalid> - 2025-01-13 17:52 -0600
Cult of Unix (was: Re: Microsoft to force new Outlook on Windows 10 PCs) vallor <vallor@cultnix.org> - 2025-01-15 00:30 +0000
Re: Cult of Unix Hank Rogers <Hank@nospam.invalid> - 2025-01-14 20:05 -0600
Re: Cult of Unix Paul <nospam@needed.invalid> - 2025-01-15 03:16 -0500
Re: Cult of Unix vallor <vallor@cultnix.org> - 2025-01-15 09:02 +0000
Re: Cult of Unix ...w¡ñ§±¤ñ <winstonmvp@gmail.com> - 2025-01-15 11:10 -0700
Re: Cult of Unix Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-16 05:03 +0000
Re: 🏳️🌈Cult of Unix🏳️🌈 🌈💐🌻🌺🌹🌻💐🌷🌺🌈Jen🌈💐🌻🌺🌹🌻💐🌷🌺🌈 Dershmender 💐🌻🌺🌹🌻💐🌷🌺🐶笛🌈💐🌻🌺🌹🌻💐🌷🌺🌈 <root@127.0.0.1> - 2025-01-16 05:28 +0000
Re: Cult of Unix Paul <nospam@needed.invalid> - 2025-01-16 10:34 -0500
Re: Cult of Unix vallor <vallor@cultnix.org> - 2025-01-16 16:04 +0000
Re: Cult of Unix Hank Rogers <Hank@nospam.invalid> - 2025-01-16 14:48 -0600
Re: Cult of Unix Paul <nospam@needed.invalid> - 2025-01-16 18:06 -0500
Re: Cult of Unix Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-17 02:49 +0000
Re: Cult of Unix vallor <vallor@cultnix.org> - 2025-01-17 03:51 +0000
Re: Cult of Unix Paul <nospam@needed.invalid> - 2025-01-17 02:10 -0500
Re: Cult of Unix Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-17 23:55 +0000
Re: Cult of Unix Paul <nospam@needed.invalid> - 2025-01-17 20:53 -0500
Re: Cult of Unix Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-19 00:54 +0000
Re: Cult of Unix Frank Slootweg <this@ddress.is.invalid> - 2025-01-17 16:46 +0000
Re: Cult of Unix Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-17 23:56 +0000
Re: Cult of Unix Paul <nospam@needed.invalid> - 2025-01-17 20:54 -0500
Re: Cult of Unix Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-19 00:55 +0000
Re: Cult of Unix Joel <joelcrump@gmail.com> - 2025-01-18 20:01 -0500
Re: Cult of Unix Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-17 00:10 +0000
Re: 🏳️🌈Cult of Unix (was: Re: Microsoft to force new Outlook on Windows 10 PCs)🏳️🌈 🌈💐🌻🌺🌹🌻💐🌷🌺🌈Jen🌈💐🌻🌺🌹🌻💐🌷🌺🌈 Dershmender 💐🌻🌺🌹🌻💐🌷🌺🐶笛🌈💐🌻🌺🌹🌻💐🌷🌺🌈 <root@127.0.0.1> - 2025-01-15 05:24 +0000
Setting up old-style backup on Windows 11 (was: Re: Cult of Unix) vallor <vallor@cultnix.org> - 2025-01-15 08:38 +0000
Re: 🏳️🌈Setting up old-style backup on Windows 11 (was: Re: Cult of Unix)🏳️🌈 🌈💐🌻🌺🌹🌻💐🌷🌺🌈Jen🌈💐🌻🌺🌹🌻💐🌷🌺🌈 Dershmender 💐🌻🌺🌹🌻💐🌷🌺🐶笛🌈💐🌻🌺🌹🌻💐🌷🌺🌈 <root@127.0.0.1> - 2025-01-15 17:22 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs CrudeSausage <crude@sausa.ge> - 2025-01-13 21:44 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Manu Raju <MR@invalid.invalid> - 2025-01-14 03:09 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-15 06:56 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Paul <nospam@needed.invalid> - 2025-01-15 02:52 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-17 00:11 +0000
Defragging (was: Re: Microsoft to force new Outlook on Windows 10 PCs) vallor <vallor@cultnix.org> - 2025-01-17 03:45 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-17 23:10 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Joel <joelcrump@gmail.com> - 2025-01-15 10:40 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs rbowman <bowman@montana.com> - 2025-01-15 23:14 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Paul <nospam@needed.invalid> - 2025-01-15 20:15 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs pothead <pothead@snakebite.com> - 2025-01-16 01:29 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-14 12:46 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs "Carlos E.R." <robin_listas@es.invalid> - 2025-01-15 13:51 +0100
Re: Microsoft to force new Outlook on Windows 10 PCs Paul <nospam@needed.invalid> - 2025-01-15 09:58 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs "Carlos E.R." <robin_listas@es.invalid> - 2025-01-15 16:20 +0100
Re: Microsoft to force new Outlook on Windows 10 PCs rbowman <bowman@montana.com> - 2025-01-15 23:20 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs "Carlos E.R." <robin_listas@es.invalid> - 2025-01-16 15:36 +0100
Re: Microsoft to force new Outlook on Windows 10 PCs rbowman <bowman@montana.com> - 2025-01-17 00:12 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Chris <ithinkiam@gmail.com> - 2025-01-15 18:09 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs "Carlos E.R." <robin_listas@es.invalid> - 2025-01-16 15:47 +0100
Re: Microsoft to force new Outlook on Windows 10 PCs Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-14 05:48 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Hank Rogers <Hank@nospam.invalid> - 2025-01-13 16:48 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs rbowman <bowman@montana.com> - 2025-01-13 23:54 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Chris <ithinkiam@gmail.com> - 2025-01-15 11:33 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Joel <joelcrump@gmail.com> - 2025-01-15 10:46 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-15 11:33 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs vallor <vallor@cultnix.org> - 2025-01-15 17:02 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-16 05:40 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-16 06:27 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-01-27 22:49 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Joel <joelcrump@gmail.com> - 2025-01-15 14:32 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-15 15:52 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Paul <nospam@needed.invalid> - 2025-01-15 20:34 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-16 00:41 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-16 06:42 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-16 14:40 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-16 16:34 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-16 16:56 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-16 22:40 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-17 02:04 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs chrisv <chrisv@nospam.invalid> - 2025-01-17 07:34 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs roger <rduffy@hotmail.com.invalid - 2025-01-17 14:01 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-17 15:57 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-17 16:50 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-17 21:52 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Farley Flud <ff@linux.rocks> - 2025-01-16 21:38 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-16 15:44 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-16 15:51 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-16 16:11 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs Farley Flud <fsquared@fsquared.linux> - 2025-01-17 13:03 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-17 16:00 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs Farley Flud <ff@linux.rocks> - 2025-01-17 23:15 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-17 18:10 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs Physfitfreak <physfitfreak@gmail.com> - 2025-01-17 18:13 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-16 06:22 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Paul <nospam@needed.invalid> - 2025-01-16 12:10 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs chrisv <chrisv@nospam.invalid> - 2025-01-16 12:28 -0600
Re: Microsoft to force new Outlook on Windows 10 PCs rbowman <bowman@montana.com> - 2025-01-17 00:27 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Paul <nospam@needed.invalid> - 2025-01-16 23:47 -0500
Gaming Laptops (was: Re: Microsoft to force new Outlook on Windows 10 PCs) vallor <vallor@cultnix.org> - 2025-02-01 12:58 +0000
Re: Gaming Laptops Paul <nospam@needed.invalid> - 2025-02-01 19:22 -0500
Re: Gaming Laptops chrisv <chrisv@nospam.invalid> - 2025-02-02 08:05 -0600
Re: Gaming Laptops candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> - 2025-02-03 20:10 +0000
Re: Gaming Laptops Paul <nospam@needed.invalid> - 2025-02-03 19:24 -0500
Re: Gaming Laptops pothead <pothead@snakebite.com> - 2025-02-04 00:45 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs Mark Lloyd <not.email@all.invalid> - 2025-01-16 18:45 +0000
Re: Microsoft to force new Outlook on Windows 10 PCs -hh <recscuba_google@huntzinger.com> - 2025-01-16 16:05 -0500
Re: Microsoft to force new Outlook on Windows 10 PCs Joel <joelcrump@gmail.com> - 2025-01-16 11:35 -0500
csiph-web