Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #208453

Re: Speed Problem Copying Files

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

[ replying to list, not discretely ]

Quoting Lothar Schilling (2019-05-09 12:36:55)
> Am 09.05.2019 um 12:26 schrieb Jonas Smedegaard:
> > Quoting Lothar Schilling (2019-05-09 11:46:00)
> >> Am 09.05.2019 um 11:14 schrieb Jonas Smedegaard:
> >>> Quoting Lothar Schilling (2019-05-09 10:49:32)
> >>>> I just set up a Stretch 9.8 system supposed to become our main 
> >>>> backup server. So I set up a backup job wih rsync. But the going is 
> >>>> really very very slooooow. Trying to figure out what's happening:
> >>>>
> >>>>   * iperf -c [host] => bandwith almost 1000 Mbit, that's fine.
> >>>>   * dd if=/dev/zero of=/daten/testfile bs=1G count=10 oflag=direct 
> >>>>     => 10737418240 Bytes (11 GB, 10 GiB) kopiert, 40,4992 s, 265 
> >>>>     MB/s, so that's fine as well
> >>>>
> >>>> But whenever I try to rsync, cp or scp - whether copy files on the 
> >>>> local hard disk only or over the network - speed goes down to 500 
> >>>> kB/s.
> >>>>
> >>>> Filesystem is ext4.
> >>>>
> >>>> I don't have any clue about what's going on. Any kind of help would 
> >>>> be appreciated, thank you!
> >>> Is _only_ transfer speed affected?
> >>>
> >>> I am no expert in this, but imagine that if you rsync massive 
> >>> amounts involving hardlinks then memory becomes a problem too.
> >>>
> >>> Perhaps run atop to monitor bottlenecks live
> >>>
> >>>
> >>>  - Jonas
> >>>
> >> It is most definitely not a memory or cpu problem. It's a HP Proliant 
> >> with 32 GB RAM and a Intel Xeon CPU 2.40GHz with 4 cores. Also the 
> >> problem stays the same if I just copy one large file.
> > Fair enough :-)
> >
> > Another shot in the dark: Did you install appropriate firmware packages?
> >
> >  - Jonas
> >
> No, actually I did not. But on that very same machine I had installed
> Centos 7 a few days earlier. There were no problems.

I am not familiar with Centos but imagine they build kernels differently 
than Debian - in particular handle firmware differently.  That's why I 
bring up that detail.


NB! Debian mailinglist posting style is to post only to list: 
https://www.debian.org/MailingLists/#codeofconduct

(I guess your posting to me discretely was simply an error)


 - Jonas

-- 
 * Jonas Smedegaard - idealist & Internet-arkitekt
 * Tlf.: +45 40843136  Website: http://dr.jones.dk/

 [x] quote me freely  [ ] ask before reusing  [ ] keep private

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 11:00 +0200
  Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 11:20 +0200
    Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 11:50 +0200
      Re: Speed Problem Copying Files Kevin DAGNEAUX <kevin.dagneaux@fiitelcom.fr> - 2019-05-09 12:00 +0200
        Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 12:30 +0200
          Re: Speed Problem Copying Files Martin <keine-eile@online.de> - 2019-05-09 13:30 +0200
            Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 14:50 +0200
              Re: Speed Problem Copying Files Martin <keine-eile@online.de> - 2019-05-09 16:00 +0200
              Re: Speed Problem Copying Files "Thomas Schmitt" <scdbackup@gmx.net> - 2019-05-09 17:20 +0200
      Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 12:30 +0200
        Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 13:00 +0200
          Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 13:20 +0200
            Re: Speed Problem Copying Files Keith Christian <keith1christian@gmail.com> - 2019-05-09 13:30 +0200
              Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 14:50 +0200
  Re: Speed Problem Copying Files Gene Heskett <gheskett@shentel.net> - 2019-05-09 16:20 +0200
    Re: Speed Problem Copying Files "Jeremy Nicoll" <jn.ml.dbn.25@letterboxes.org> - 2019-05-09 16:30 +0200
      Re: Speed Problem Copying Files Dan Ritter <dsr@randomstring.org> - 2019-05-09 17:00 +0200
      Re: Speed Problem Copying Files Gene Heskett <gheskett@shentel.net> - 2019-05-09 17:00 +0200
  Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-10 07:50 +0200
    Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-10 11:00 +0200
      Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-13 10:40 +0200
        Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-13 11:00 +0200
          Re: Speed Problem Copying Files Tixy <tixy@yxit.co.uk> - 2019-05-13 11:20 +0200
          Re: Speed Problem Copying Files Curt <curty@free.fr> - 2019-05-13 11:40 +0200
          Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 13:40 +0200
        Re: Speed Problem Copying Files Tixy <tixy@yxit.co.uk> - 2019-05-13 11:00 +0200
        Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 02:30 +0200
          Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-14 09:40 +0200
            Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 18:30 +0200
    Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 13:30 +0200
      Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 21:20 +0200
        Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 22:10 +0200

csiph-web