Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > alt.comp.os.windows-11 > #17797
| From | Paul <nospam@needed.invalid> |
|---|---|
| Newsgroups | alt.comp.os.windows-11 |
| Subject | Re: MS Shadow Copy service |
| Date | 2025-03-17 00:46 -0400 |
| Organization | A noiseless patient Spider |
| Message-ID | <vr89ec$3d9oh$1@dont-email.me> (permalink) |
| References | <mmeetj10722sjsmv75k70itprmtmomnjtu@4ax.com> <12vetjlbjnqjva8gd3rknu419n2mhce7nd@4ax.com> |
On Sun, 3/16/2025 9:49 PM, micky wrote:
> In alt.comp.os.windows-11, on Sun, 16 Mar 2025 17:02:37 -0400, micky
> <NONONOmisc07@fmguy.com> wrote:
>
>> So for the first time, I tried copying and moving files within win11. It
>> took about 5 minutes to copy one file, and about 20 minutes to move 10
>> directories. This is, how do they say it?, Unacceptable.
>>
>> The bussiest task was MS Shadow Copy service. None of these files were
>> in use. They were just sitting in the dat or downloads directories. I'd
>> just turn off the service -- should I? -- but it might well come in
>> handy if it means I could back up files from Forte Agent while it was
>> running.
>>
>> I wasn't using File Explorer, but PowerDesk, a 3d-party, but I assume
>> it just formats the same commands tht File Explorer does.
>
> a) I thought I should still test it with File Explorer and the problem
> is the same, as I was sure it would be.
>
> Using FE, I moved one file and it took 4 minutes. As the other times,
> the graph immediately goes 99% of the way across and then stops. A
> line in the box says it's "Calculating".
>
> b) I thought I should be able to reverse the move with Ctrl-Z, but it
> did nothing. Ctrl-Z used to reverse moves. Has that been stopped or is
> this another problem?
>
> c) I decided the file was expendable so I deleted it and the lnk, and
> each time it took 50 seconds to send it to the recycle bin. This time I
> started from Everything, but I'm sure it doesn't matter where the
> instruction is issued from.
>
>> Does this "feature" bite everyone who gets win11?
Sysinternals Process Monitor, it will collect a trace of what is
going on in the machine, while you do your copy.
When a file is copied, a fixed size buffer can be used
by the copy code. The ProcMon trace would look like this
ReadFile 1MB time=1.001sec
WriteFile 1MB time=1.009sec
ReadFile 1MB time=1.017sec
WriteFile 1MB time=1.025sec
ReadFile 78342 bytes time=1.026sec
Writefile 78342 bytes time=1.027sec
Progname Exit()
the idea is, the read buffer is filled and emptied in
a loop, until a fraction of a cluster (or whatever)
is left. When the fractional one is finally done, the
program doing the copying will indicate that it is
exiting.
By studying what *other* programs are doing,
like if an ignorant program sandwiches itself
into the stream of activity, that can slow down
the progress of the copy.
This is why you use a Process Monitor program,
to see how all the players on the team are
performing. Are the programs all rowing the
boat in the same direction, or, are they wasting
your time.
You decide.
*******
I wrote my own copy program.
Now, who hasn't done this, right ?
.\ghettocopy test.bin out.bin
file_size = 1073741824
Starting run...
some_size = 1073741824
Read 1073741824 bytes in 000.369524 seconds [about 3GB/sec or so]
Wrote 1073741824 bytes in 000.354558 seconds [about 3GB/sec or so]
File copied successfully.
I got CoPilot to write the basic program.
I added my timing code I use, for those
not-so-accurate timestamps (there can be a 10%
error in timestamping on Windows!).
Now, I run the command again.
.\ghettocopy test.bin out.bin
file_size = 1073741824
Starting run...
some_size = 1073741824
Read 1073741824 bytes in 000.342627 seconds
Wrote 1073741824 bytes in 000.360895 seconds
File copied successfully.
How annoying. The speed didn't change :-)
I told CoPilot to read the source file, the
whole thing, into memory in one shot. And
write it out, the whole thing, in one shot.
This is obviously not scalable (it's a bad
way to write a program). But notice how, at the
moment, the read and write time are almost the
same. If I were to run this on a hard drive,
it would read at 200MB/sec and write at 200MB/sec.
Perhaps I should test that.
# Win10, hard drive
Read 1073741824 bytes in 000.525854 seconds <=== once the file is in the System Read cache, it reads faster
Wrote 1073741824 bytes in 006.470807 seconds
# Win11, hard drive
Read 1073741824 bytes in 006.400220 seconds <=== not in the system read cache
Wrote 1073741824 bytes in 007.081455 seconds
Read 1073741824 bytes in 000.748078 seconds <=== NOW in the system read cache
Wrote 1073741824 bytes in 013.870901 seconds [grrr...]
Read 1073741824 bytes in 000.731090 seconds
Wrote 1073741824 bytes in 008.017847 seconds
Not only is the write time variable,
the write LED is still lit after the program
exits, so the total write time is actually longer
than shown. The 6.5 second number is likely to
be the most reasonable result.
While I'm running it on Win11, it suddenly
decided it needs to look for more AV definitions
and scan something. It can't be the test file,
as that is all zeros inside and makes for a
boring AV scan.
So while I didn't run ProcMon for a look, I still
had some fun.
I need to compile ghettocopy.exe as a 64-bit program,
and I suspect it will then start handling files larger
than 4GB properly. That's one reason I can't share the
program with you right now, it's not properly tested.
It only works on smaller files.
Everyone thinks they can write a copy program,
and I am a member of that camp. You can see my OS
isn't being very nice to me. Even though I wrote
grease-lightning code that uses lots of RAM. Only
one invocation is shown above running at 3GB/sec.
Paul
Back to alt.comp.os.windows-11 | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-16 17:02 -0400
Re: MS Shadow Copy service User One <noreply@invalid.com> - 2025-03-16 22:03 +0000
Re: MS Shadow Copy service Stan Brown <the_stan_brown@fastmail.fm> - 2025-03-16 20:42 -0700
Re: MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-29 00:50 -0400
Re: MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-29 01:38 -0400
Re: MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-16 21:49 -0400
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-17 00:46 -0400
Re: MS Shadow Copy service "Carlos E.R." <robin_listas@es.invalid> - 2025-03-17 13:16 +0100
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-17 11:25 -0400
Re: MS Shadow Copy service "Carlos E.R." <robin_listas@es.invalid> - 2025-03-17 19:50 +0100
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-17 15:27 -0400
Re: MS Shadow Copy service "Carlos E.R." <robin_listas@es.invalid> - 2025-03-17 21:34 +0100
Re: MS Shadow Copy service Frank Slootweg <this@ddress.is.invalid> - 2025-03-18 14:45 +0000
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-18 20:13 -0400
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-17 01:07 -0400
Re: MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-27 01:00 -0400
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-27 02:51 -0400
Re: MS Shadow Copy service Newyana2 <newyana@invalid.nospam> - 2025-03-17 08:41 -0400
Re: MS Shadow Copy service Frank Slootweg <this@ddress.is.invalid> - 2025-03-17 16:45 +0000
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-17 15:32 -0400
Re: MS Shadow Copy service Newyana2 <newyana@invalid.nospam> - 2025-03-17 17:27 -0400
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-17 18:16 -0400
Re: MS Shadow Copy service Frank Slootweg <this@ddress.is.invalid> - 2025-03-18 13:49 +0000
Re: MS Shadow Copy service Frank Slootweg <this@ddress.is.invalid> - 2025-03-17 16:36 +0000
Re: MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-27 01:05 -0400
Re: MS Shadow Copy service Char Jackson <none@none.invalid> - 2025-03-28 00:27 -0500
Re: MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-28 12:17 -0400
Re: MS Shadow Copy service ...w¡ñ§±¤ñ <winstonmvp@gmail.com> - 2025-03-17 10:44 -0700
Re: MS Shadow Copy service Newyana2 <newyana@invalid.nospam> - 2025-03-17 17:28 -0400
Re: MS Shadow Copy service Paul <nospam@needed.invalid> - 2025-03-17 18:50 -0400
Re: MS Shadow Copy service ...w¡ñ§±¤ñ <winstonmvp@gmail.com> - 2025-03-20 11:52 -0700
Re: MS Shadow Copy service micky <NONONOmisc07@fmguy.com> - 2025-03-27 01:09 -0400
csiph-web