Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.user > #208454

Re: Speed Problem Copying Files

From Lothar Schilling <ls@proasyl.de>
Newsgroups linux.debian.user
Subject Re: Speed Problem Copying Files
Date 2019-05-09 13:20 +0200
Message-ID <xVPfH-5lN-7@gated-at.bofh.it> (permalink)
References (1 earlier) <xVNnA-4dU-17@gated-at.bofh.it> <xVNQB-4nq-5@gated-at.bofh.it> <xVOtk-4Q8-21@gated-at.bofh.it> <xVOWl-4ZM-3@gated-at.bofh.it> <xVOWl-4ZM-1@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


Am 09.05.2019 um 12:50 schrieb Jonas Smedegaard:
> [ replying to list, not discretely ]
>
> Quoting Lothar Schilling (2019-05-09 12:36:55)
>> Am 09.05.2019 um 12:26 schrieb Jonas Smedegaard:
>>> Quoting Lothar Schilling (2019-05-09 11:46:00)
>>>> Am 09.05.2019 um 11:14 schrieb Jonas Smedegaard:
>>>>> Quoting Lothar Schilling (2019-05-09 10:49:32)
>>>>>> I just set up a Stretch 9.8 system supposed to become our main 
>>>>>> backup server. So I set up a backup job wih rsync. But the going is 
>>>>>> really very very slooooow. Trying to figure out what's happening:
>>>>>>
>>>>>>   * iperf -c [host] => bandwith almost 1000 Mbit, that's fine.
>>>>>>   * dd if=/dev/zero of=/daten/testfile bs=1G count=10 oflag=direct 
>>>>>>     => 10737418240 Bytes (11 GB, 10 GiB) kopiert, 40,4992 s, 265 
>>>>>>     MB/s, so that's fine as well
>>>>>>
>>>>>> But whenever I try to rsync, cp or scp - whether copy files on the 
>>>>>> local hard disk only or over the network - speed goes down to 500 
>>>>>> kB/s.
>>>>>>
>>>>>> Filesystem is ext4.
>>>>>>
>>>>>> I don't have any clue about what's going on. Any kind of help would 
>>>>>> be appreciated, thank you!
>>>>> Is _only_ transfer speed affected?
>>>>>
>>>>> I am no expert in this, but imagine that if you rsync massive 
>>>>> amounts involving hardlinks then memory becomes a problem too.
>>>>>
>>>>> Perhaps run atop to monitor bottlenecks live
>>>>>
>>>>>
>>>>>  - Jonas
>>>>>
>>>> It is most definitely not a memory or cpu problem. It's a HP Proliant 
>>>> with 32 GB RAM and a Intel Xeon CPU 2.40GHz with 4 cores. Also the 
>>>> problem stays the same if I just copy one large file.
>>> Fair enough :-)
>>>
>>> Another shot in the dark: Did you install appropriate firmware packages?
>>>
>>>  - Jonas
>>>
>> No, actually I did not. But on that very same machine I had installed
>> Centos 7 a few days earlier. There were no problems.
> I am not familiar with Centos but imagine they build kernels differently 
> than Debian - in particular handle firmware differently.  That's why I 
> bring up that detail.
>
> NB! Debian mailinglist posting style is to post only to list: 
> https://www.debian.org/MailingLists/#codeofconduct
>
> (I guess your posting to me discretely was simply an error)
>
>
>  - Jonas

Yes, posting to you  instead of the list was by accident. Sorry. I still
do not think, though, that this is firmware-related. But I'll ask HP
Support. In the meantime I hope there is going to more suggestions for a
solution to my weird problem...

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 11:00 +0200
  Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 11:20 +0200
    Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 11:50 +0200
      Re: Speed Problem Copying Files Kevin DAGNEAUX <kevin.dagneaux@fiitelcom.fr> - 2019-05-09 12:00 +0200
        Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 12:30 +0200
          Re: Speed Problem Copying Files Martin <keine-eile@online.de> - 2019-05-09 13:30 +0200
            Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 14:50 +0200
              Re: Speed Problem Copying Files Martin <keine-eile@online.de> - 2019-05-09 16:00 +0200
              Re: Speed Problem Copying Files "Thomas Schmitt" <scdbackup@gmx.net> - 2019-05-09 17:20 +0200
      Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 12:30 +0200
        Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 13:00 +0200
          Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 13:20 +0200
            Re: Speed Problem Copying Files Keith Christian <keith1christian@gmail.com> - 2019-05-09 13:30 +0200
              Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 14:50 +0200
  Re: Speed Problem Copying Files Gene Heskett <gheskett@shentel.net> - 2019-05-09 16:20 +0200
    Re: Speed Problem Copying Files "Jeremy Nicoll" <jn.ml.dbn.25@letterboxes.org> - 2019-05-09 16:30 +0200
      Re: Speed Problem Copying Files Dan Ritter <dsr@randomstring.org> - 2019-05-09 17:00 +0200
      Re: Speed Problem Copying Files Gene Heskett <gheskett@shentel.net> - 2019-05-09 17:00 +0200
  Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-10 07:50 +0200
    Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-10 11:00 +0200
      Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-13 10:40 +0200
        Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-13 11:00 +0200
          Re: Speed Problem Copying Files Tixy <tixy@yxit.co.uk> - 2019-05-13 11:20 +0200
          Re: Speed Problem Copying Files Curt <curty@free.fr> - 2019-05-13 11:40 +0200
          Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 13:40 +0200
        Re: Speed Problem Copying Files Tixy <tixy@yxit.co.uk> - 2019-05-13 11:00 +0200
        Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 02:30 +0200
          Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-14 09:40 +0200
            Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 18:30 +0200
    Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 13:30 +0200
      Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 21:20 +0200
        Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 22:10 +0200

csiph-web