Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #206356 > unrolled thread

How to slow more copying of files ?

Started byPierre Couderc <pierre@couderc.eu>
First post2019-03-19 11:30 +0100
Last post2019-03-19 13:50 +0100
Articles 5 — 3 participants

Back to article view | Back to linux.debian.user

Contents

  How to slow more copying of files ? Pierre Couderc <pierre@couderc.eu> - 2019-03-19 11:30 +0100
    Re: How to slow more copying of files ? <tomas@tuxteam.de> - 2019-03-19 11:40 +0100
      Re: How to slow more copying of files ? Pierre Couderc <pierre@couderc.eu> - 2019-03-19 13:50 +0100
    Re: How to slow more copying of files ? Kevin DAGNEAUX <kevin.dagneaux@fiitelcom.fr> - 2019-03-19 12:30 +0100
      Re: How to slow more copying of files ? Pierre Couderc <pierre@couderc.eu> - 2019-03-19 13:50 +0100

#206356 — How to slow more copying of files ?

FromPierre Couderc <pierre@couderc.eu>
Date2019-03-19 11:30 +0100
SubjectHow to slow more copying of files ?
Message-ID<xDkal-68Y-1@gated-at.bofh.it>
Big copy operations (with cp) may be slow, but it is not my problem.

But too,  they slow the full computer !

Is there a way to slow the copy which is not a priority task to let the 
computer breath.... ?

I have tried to use "nice" but without effect.

Thanks in advance.

PC

[toc] | [next] | [standalone]

#206358

From<tomas@tuxteam.de>
Date2019-03-19 11:40 +0100
Message-ID<xDkk3-6cz-13@gated-at.bofh.it>
In reply to#206356

[Multipart message — attachments visible in raw view] — view raw

On Tue, Mar 19, 2019 at 11:29:36AM +0100, Pierre Couderc wrote:
> Big copy operations (with cp) may be slow, but it is not my problem.
> 
> But too,  they slow the full computer !
> 
> Is there a way to slow the copy which is not a priority task to let
> the computer breath.... ?

This is more complicated than you might wish :-)

The problem centers around the definition of "slow": clearly, some
resource is being hogged by your 'cp', but which one(s) will depend
much on your hardware.

Since you have tried 'nice' with no effect, let's assume that this
resource isn't CPU. Then, you might have a look at 'ionice' (from
the package util-linux). But too little RAM might be as well a
problem.

Another avenue might be using rsync, which offer a rate-limiting
option (--bwlimit).

Cheers
-- tomás

[toc] | [prev] | [next] | [standalone]

#206366

FromPierre Couderc <pierre@couderc.eu>
Date2019-03-19 13:50 +0100
Message-ID<xDmlP-7rh-3@gated-at.bofh.it>
In reply to#206358
On 3/19/19 11:39 AM, tomas@tuxteam.de wrote:
> On Tue, Mar 19, 2019 at 11:29:36AM +0100, Pierre Couderc wrote:
>> Big copy operations (with cp) may be slow, but it is not my problem.
>>
>> But too,  they slow the full computer !
>>
>> Is there a way to slow the copy which is not a priority task to let
>> the computer breath.... ?
> This is more complicated than you might wish :-)
>
> The problem centers around the definition of "slow": clearly, some
> resource is being hogged by your 'cp', but which one(s) will depend
> much on your hardware.
in fact, in this case, it is a copy of mailboxes (many small files) from 
a location to another, the whole on a brtfs RAID1 device...
>
> Since you have tried 'nice' with no effect, let's assume that this
> resource isn't CPU.
Yes, top, shows it (what it is  allowed to run ;)
>   Then, you might have a look at 'ionice' (from
> the package util-linux). But too little RAM might be as well a
> problem.
>
> Another avenue might be using rsync, which offer a rate-limiting
> option (--bwlimit).

Thank you, sure I shold use rsync or ionice.

Anyway, it not a reptitive tasks, but it was yo understand...

[toc] | [prev] | [next] | [standalone]

#206360

FromKevin DAGNEAUX <kevin.dagneaux@fiitelcom.fr>
Date2019-03-19 12:30 +0100
Message-ID<xDl6q-6Js-25@gated-at.bofh.it>
In reply to#206356

[Multipart message — attachments visible in raw view] — view raw

Le 19/03/2019 à 11:29, Pierre Couderc a écrit :
> Big copy operations (with cp) may be slow, but it is not my problem.
>
> But too,  they slow the full computer !
>
> Is there a way to slow the copy which is not a priority task to let 
> the computer breath.... ?
>
> I have tried to use "nice" but without effect.
>
Make a try with ionice too.


> Thanks in advance.
>
> PC
>
>

[toc] | [prev] | [next] | [standalone]

#206365

FromPierre Couderc <pierre@couderc.eu>
Date2019-03-19 13:50 +0100
Message-ID<xDmlP-7rh-1@gated-at.bofh.it>
In reply to#206360
On 3/19/19 11:40 AM, Kevin DAGNEAUX wrote:
> Le 19/03/2019 à 11:29, Pierre Couderc a écrit :
>> Big copy operations (with cp) may be slow, but it is not my problem.
>>
>> But too,  they slow the full computer !
>>
>> Is there a way to slow the copy which is not a priority task to let 
>> the computer breath.... ?
>>
>> I have tried to use "nice" but without effect.
>>
> Make a try with ionice too.
>

Yes, as it is not a CPU problem, it is a IO poblem.

Thnk you

[toc] | [prev] | [standalone]

Back to top | Article view | linux.debian.user

csiph-web