Re: wget Uses Multiple Connections??

From	Lawrence D'Oliveiro <ldo@nz.invalid>
Newsgroups	comp.os.linux.misc
Subject	Re: wget Uses Multiple Connections??
Date	2025-06-12 02:14 +0000
Organization	A noiseless patient Spider
Message-ID	<102dd73$2amdm$1@dont-email.me> (permalink)
References	<102d78u$29g21$2@dont-email.me> <102dbjb$2a8f3$1@dont-email.me>

Show all headers | View raw

On Thu, 12 Jun 2025 01:47:23 -0000 (UTC), John McCue wrote:

> But I do remember reading somewhere if using wget, if downloads
> are too fast the site will kill the download.
> 
> There is a flag to fake random downloads, "--random-wait", to
> prevent that logic that could exist on the remote site.

Also --limit-rate, options for waiting before retrying etc. And you can 
use an alternative --user-agent (for sites that block the default one), 
and even specify a “Referer” [sic] header, for those sites that try to 
prevent deep-linking.

Back to comp.os.linux.misc | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

wget Uses Multiple Connections?? Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-06-12 00:33 +0000
  Re: wget Uses Multiple Connections?? John McCue <jmclnx@SPAMisBADgmail.com> - 2025-06-12 01:47 +0000
    Re: wget Uses Multiple Connections?? Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-06-12 02:14 +0000
    Re: wget Uses Multiple Connections?? Borax Man <rotflol2@hotmail.com> - 2025-06-12 10:56 +0000
      Re: wget Uses Multiple Connections?? "Carlos E.R." <robin_listas@es.invalid> - 2025-06-12 18:55 +0200
  Re: wget Uses Multiple Connections?? not@telling.you.invalid (Computer Nerd Kev) - 2025-06-13 09:03 +1000
    Re: wget Uses Multiple Connections?? Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-06-13 23:30 +0000
  Re: wget Uses Multiple Connections?? candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> - 2025-06-13 01:10 +0000
  Re: wget Uses Multiple Connections?? ant@zimage.comANT (Ant) - 2025-06-15 01:18 +0000
    Re: wget Uses Multiple Connections?? candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> - 2025-06-18 05:30 +0000

csiph-web