Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > linux.debian.user > #208451
| From | Lothar Schilling <ls@proasyl.de> |
|---|---|
| Newsgroups | linux.debian.user |
| Subject | Re: Speed Problem Copying Files |
| Date | 2019-05-09 12:30 +0200 |
| Message-ID | <xVOtk-4Q8-17@gated-at.bofh.it> (permalink) |
| References | <xVN4f-3Rc-15@gated-at.bofh.it> <xVNnA-4dU-17@gated-at.bofh.it> <xVNQB-4nq-5@gated-at.bofh.it> <xVO0i-4qM-3@gated-at.bofh.it> |
| Organization | linux.* mail to news gateway |
Am 09.05.2019 um 11:51 schrieb Kevin DAGNEAUX: > Le 09/05/2019 à 11:46, Lothar Schilling a écrit : >> Am 09.05.2019 um 11:14 schrieb Jonas Smedegaard: >>> Quoting Lothar Schilling (2019-05-09 10:49:32) >>>> for years I have used CentOS for our server landscape. Now I decided >>>> to give Debian a try. >>> Welcome to Debian! >>> >>> I sincerely hope you will appreciate Debian. >>> >>> >>>> I just set up a Stretch 9.8 system supposed to become our main backup >>>> server. So I set up a backup job wih rsync. But the going is really >>>> very very slooooow. Trying to figure out what's happening: >>>> >>>> * iperf -c [host] => bandwith almost 1000 Mbit, that's fine. >>>> * dd if=/dev/zero of=/daten/testfile bs=1G count=10 oflag=direct => >>>> 10737418240 Bytes (11 GB, 10 GiB) kopiert, 40,4992 s, 265 >>>> MB/s, so >>>> that's fine as well >>>> >>>> But whenever I try to rsync, cp or scp - whether copy files on the >>>> local >>>> hard disk only or over the network - speed goes down to 500 kB/s. >>>> >>>> Filesystem is ext4. >>>> >>>> I don't have any clue about what's going on. Any kind of help would be >>>> appreciated, thank you! >>> Is _only_ transfer speed affected? >>> >>> I am no expert in this, but imagine that if you rsync massive amounts >>> involving hardlinks then memory becomes a problem too. >>> >>> Perhaps run atop to monitor bottlenecks live >>> >>> >>> - Jonas >>> >> It is most definitely not a memory or cpu problem. It's a HP Proliant >> with 32 GB RAM and a Intel Xeon CPU 2.40GHz with 4 cores. Also the >> problem stays the same if I just copy one large file. > > Check if it's related to the disk speed (hdparm and/or iotop). > > Kevin > hdparm -tT /dev/sda /dev/sda: Timing cached reads: 13348 MB in 2.00 seconds = 6683.42 MB/sec Timing buffered disk reads: 1014 MB in 3.00 seconds = 337.72 MB/sec iotop -o (for rsync and cp) Total DISK READ : 0.00 B/s | Total DISK WRITE : 476.15 K/s Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 487.86 K/s TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND 19531 be/4 root 0.00 B/s 476.15 K/s 0.00 % 99.24 % rsync --info=progress2 /daten/testfile /daten/testfile2 iotop -o (for dd) Total DISK READ : 0.00 B/s | Total DISK WRITE : 297.68 M/s Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 297.68 M/s TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND 19557 be/4 root 0.00 B/s 297.68 M/s 0.00 % 99.99 % dd if=/dev/zero of=/daten/testfile bs=1G count=10 oflag=direct
Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 11:00 +0200
Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 11:20 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 11:50 +0200
Re: Speed Problem Copying Files Kevin DAGNEAUX <kevin.dagneaux@fiitelcom.fr> - 2019-05-09 12:00 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 12:30 +0200
Re: Speed Problem Copying Files Martin <keine-eile@online.de> - 2019-05-09 13:30 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 14:50 +0200
Re: Speed Problem Copying Files Martin <keine-eile@online.de> - 2019-05-09 16:00 +0200
Re: Speed Problem Copying Files "Thomas Schmitt" <scdbackup@gmx.net> - 2019-05-09 17:20 +0200
Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 12:30 +0200
Re: Speed Problem Copying Files Jonas Smedegaard <jonas@jones.dk> - 2019-05-09 13:00 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 13:20 +0200
Re: Speed Problem Copying Files Keith Christian <keith1christian@gmail.com> - 2019-05-09 13:30 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-09 14:50 +0200
Re: Speed Problem Copying Files Gene Heskett <gheskett@shentel.net> - 2019-05-09 16:20 +0200
Re: Speed Problem Copying Files "Jeremy Nicoll" <jn.ml.dbn.25@letterboxes.org> - 2019-05-09 16:30 +0200
Re: Speed Problem Copying Files Dan Ritter <dsr@randomstring.org> - 2019-05-09 17:00 +0200
Re: Speed Problem Copying Files Gene Heskett <gheskett@shentel.net> - 2019-05-09 17:00 +0200
Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-10 07:50 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-10 11:00 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-13 10:40 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-13 11:00 +0200
Re: Speed Problem Copying Files Tixy <tixy@yxit.co.uk> - 2019-05-13 11:20 +0200
Re: Speed Problem Copying Files Curt <curty@free.fr> - 2019-05-13 11:40 +0200
Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 13:40 +0200
Re: Speed Problem Copying Files Tixy <tixy@yxit.co.uk> - 2019-05-13 11:00 +0200
Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 02:30 +0200
Re: Speed Problem Copying Files Lothar Schilling <ls@proasyl.de> - 2019-05-14 09:40 +0200
Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 18:30 +0200
Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 13:30 +0200
Re: Speed Problem Copying Files David Christensen <dpchrist@holgerdanske.com> - 2019-05-14 21:20 +0200
Re: Speed Problem Copying Files Michael Stone <mstone@debian.org> - 2019-05-14 22:10 +0200
csiph-web