Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.os.linux.networking > #3952 > unrolled thread

wget behavior

Back to article view | Back to comp.os.linux.networking

Contents

  wget behavior Mark A <deeptht69@gmail.com> - 2017-02-12 14:52 -0800
    Re: wget behavior Richard Kettlewell <invalid@invalid.invalid> - 2017-02-12 23:22 +0000
      Re: wget behavior Mark A <deeptht69@gmail.com> - 2017-02-12 15:45 -0800
        Re: wget behavior Richard Kettlewell <invalid@invalid.invalid> - 2017-02-12 23:51 +0000
          Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-12 23:59 +0000
            Re: wget behavior "Carlos E. R." <robin_listas@invalid.es> - 2017-02-13 02:09 +0100
            Re: wget behavior Allodoxaphobia <knock_yourself_out@example.net> - 2017-02-13 01:41 +0000
              Re: wget behavior "Carlos E. R." <robin_listas@invalid.es> - 2017-02-13 02:46 +0100
            Re: wget behavior Richard Kettlewell <invalid@invalid.invalid> - 2017-02-13 09:18 +0000
            Re: wget behavior William Unruh <unruh@invalid.ca> - 2017-02-13 11:32 +0000
              Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-13 20:02 +0000
                Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-13 20:08 +0000
                  Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-13 20:42 +0000
                Re: wget behavior Richard Kettlewell <invalid@invalid.invalid> - 2017-02-13 20:16 +0000
                  Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-13 20:57 +0000
                    Re: wget behavior Richard Kettlewell <invalid@invalid.invalid> - 2017-02-13 21:31 +0000
                      Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-13 21:51 +0000
                        Re: wget behavior Rick Jones <rick.jones2@hpe.com> - 2017-02-13 21:58 +0000
                          Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-14 21:46 +0000
                    Re: wget behavior "Carlos E. R." <robin_listas@invalid.es> - 2017-02-13 23:37 +0100
                      Re: wget behavior MarkA <someone@somewhere.invalid> - 2017-02-14 21:50 +0000

Page 1 of 2  [1] 2  Next page →

#3952 — wget behavior

I'm using wget to download some large files from a download server, after several failed attempts to use Firefox's download function.  I can use the Firefox download function to get the URL of the source, then paste that into wget, running in a Gnome terminal window.  wget starts and shows its progress bar across the bottom of the window.  If I press "Enter", the progress bar freezes, moves up one line, and is immediately replaced by a new one that continues to update.

After a few minutes, the progress bar stops updating.  If I press "Enter", I get the command prompt.  "jobs" shows wget still running, now in the background.  The size of the local data file no longer grows.  I can bring wget to the foreground, but still no updates.  The only way to get it going again, that I have found, is to "killall wget", followed by wget -c <url>, which nicely starts it up again.

Is this behavior due to the server just deciding to stop sending data over the existing connection?  If I wait long enough, will wget re-establish the connection on its own?  It's a bit of a pain to have to keep manually restarting it, when the whole point is to have it run unattended.  OTOH, manually restarting is way better than having to start from the beginning each time.

[toc] | [next] | [standalone]

#3953

Mark A <deeptht69@gmail.com> writes:

> I'm using wget to download some large files from a download server,
> after several failed attempts to use Firefox's download function.  I
> can use the Firefox download function to get the URL of the source,
> then paste that into wget, running in a Gnome terminal window.  wget
> starts and shows its progress bar across the bottom of the window.  If
> I press "Enter", the progress bar freezes, moves up one line, and is
> immediately replaced by a new one that continues to update.
>
> After a few minutes, the progress bar stops updating.  If I press
> "Enter", I get the command prompt.  "jobs" shows wget still running,
> now in the background.

I expect that there’s an ‘&’ in the URL and you didn’t quote it.

-- 
http://www.greenend.org.uk/rjk/

[toc] | [prev] | [next] | [standalone]

#3954

On Sunday, February 12, 2017 at 6:22:29 PM UTC-5, Richard Kettlewell wrote:
> Mark A writes:
> 
> > I'm using wget to download some large files from a download server,
> > after several failed attempts to use Firefox's download function.  I
> > can use the Firefox download function to get the URL of the source,
> > then paste that into wget, running in a Gnome terminal window.  wget
> > starts and shows its progress bar across the bottom of the window.  If
> > I press "Enter", the progress bar freezes, moves up one line, and is
> > immediately replaced by a new one that continues to update.
> >
> > After a few minutes, the progress bar stops updating.  If I press
> > "Enter", I get the command prompt.  "jobs" shows wget still running,
> > now in the background.
> 
> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
> 
> -- 
> http://www.greenend.org.uk/rjk/

No, no such characters in the URL.  A few '%'s, though.  Besides, a malformed URL would cause it to fail immediately.

[toc] | [prev] | [next] | [standalone]

#3955

Mark A <deeptht69@gmail.com> writes:
> Richard Kettlewell wrote:
>> Mark A writes:
>>> I'm using wget to download some large files from a download server,
>>> after several failed attempts to use Firefox's download function.  I
>>> can use the Firefox download function to get the URL of the source,
>>> then paste that into wget, running in a Gnome terminal window.  wget
>>> starts and shows its progress bar across the bottom of the window.  If
>>> I press "Enter", the progress bar freezes, moves up one line, and is
>>> immediately replaced by a new one that continues to update.
>>>
>>> After a few minutes, the progress bar stops updating.  If I press
>>> "Enter", I get the command prompt.  "jobs" shows wget still running,
>>> now in the background.
>> 
>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>
> No, no such characters in the URL. 

Well, wget doesn’t generally put itself into the background for no
reason.

> A few '%'s, though.  Besides, a malformed URL would cause it to fail
> immediately.

‘&’ doesn’t make the URL malformed.

-- 
http://www.greenend.org.uk/rjk/

[toc] | [prev] | [next] | [standalone]

#3956

On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:

> Mark A <deeptht69@gmail.com> writes:
>> Richard Kettlewell wrote:
>>> Mark A writes:
>>>> I'm using wget to download some large files from a download server,
>>>> after several failed attempts to use Firefox's download function.  I
>>>> can use the Firefox download function to get the URL of the source,
>>>> then paste that into wget, running in a Gnome terminal window.  wget
>>>> starts and shows its progress bar across the bottom of the window. 
>>>> If I press "Enter", the progress bar freezes, moves up one line, and
>>>> is immediately replaced by a new one that continues to update.
>>>>
>>>> After a few minutes, the progress bar stops updating.  If I press
>>>> "Enter", I get the command prompt.  "jobs" shows wget still running,
>>>> now in the background.
>>> 
>>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>>
>> No, no such characters in the URL.
> 
> Well, wget doesn’t generally put itself into the background for no
> reason.

Hence my puzzlement.  Yet, there it is, with a big fat " &" after it, 
when I type "jobs".

> 
>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>> immediately.
> 
> ‘&’ doesn’t make the URL malformed.

It does if it causes the software to misinterpret the URL.



-- 
MarkA

You can safely assume that you have created God in your own image when it 
turns out that God hates all the same people you do.  -- Anne Lamott

[toc] | [prev] | [next] | [standalone]

#3957

On 2017-02-13 00:59, MarkA wrote:
> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>> Mark A <deeptht69@gmail.com> writes:
>>> Richard Kettlewell wrote:
>>>> Mark A writes:

>>>>> After a few minutes, the progress bar stops updating.  If I press
>>>>> "Enter", I get the command prompt.  "jobs" shows wget still running,
>>>>> now in the background.
>>>>
>>>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>>>
>>> No, no such characters in the URL.
>>
>> Well, wget doesn’t generally put itself into the background for no
>> reason.
> 
> Hence my puzzlement.  Yet, there it is, with a big fat " &" after it, 
> when I type "jobs".
> 
>>
>>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>>> immediately.
>>
>> ‘&’ doesn’t make the URL malformed.
> 
> It does if it causes the software to misinterpret the URL.

I always enclose the url between "".

-- 
Cheers,
       Carlos E.R.

[toc] | [prev] | [next] | [standalone]

#3958

On 12 Feb 2017 23:59:48 GMT, MarkA wrote:
> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>> Mark A <deeptht69@gmail.com> writes:
>>> Richard Kettlewell wrote:
>>>> Mark A writes:
>>>>> I'm using wget to download some large files from a download server,
>>>>> after several failed attempts to use Firefox's download function.  I
>>>>> can use the Firefox download function to get the URL of the source,
>>>>> then paste that into wget, running in a Gnome terminal window.  wget
>>>>> starts and shows its progress bar across the bottom of the window. 
>>>>> If I press "Enter", the progress bar freezes, moves up one line, and
>>>>> is immediately replaced by a new one that continues to update.
>>>>>
>>>>> After a few minutes, the progress bar stops updating.  If I press
>>>>> "Enter", I get the command prompt.  "jobs" shows wget still running,
>>>>> now in the background.
>>>> 
>>>> I expect that there?s an ?&? in the URL and you didn?t quote it.
>>>
>>> No, no such characters in the URL.
>> 
>> Well, wget doesn?t generally put itself into the background for no
>> reason.
>
> Hence my puzzlement.  Yet, there it is, with a big fat " &" after it, 
> when I type "jobs".
>
>> 
>>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>>> immediately.
>> 
>> ?&? doesn?t make the URL malformed.
>
> It does if it causes the software to misinterpret the URL.

Then `wget` will happily download whatever that server uses for a 
404 page.

Jonesy

[toc] | [prev] | [next] | [standalone]

#3959

On 2017-02-13 02:41, Allodoxaphobia wrote:
> On 12 Feb 2017 23:59:48 GMT, MarkA wrote:
>> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>>> Mark A <deeptht69@gmail.com> writes:
>>>> Richard Kettlewell wrote:
>>>>> Mark A writes:


>>>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>>>> immediately.
>>>
>>> ?&? doesn?t make the URL malformed.
>>
>> It does if it causes the software to misinterpret the URL.
> 
> Then `wget` will happily download whatever that server uses for a 
> 404 page.

And end fast, which is not happening.


-- 
Cheers,
       Carlos E.R.

[toc] | [prev] | [next] | [standalone]

#3960

MarkA <someone@somewhere.invalid> writes:
> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>> Mark A <deeptht69@gmail.com> writes:
>>> Richard Kettlewell wrote:
>>>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>>> No, no such characters in the URL.
>> Well, wget doesn’t generally put itself into the background for no
>> reason.
>
> Hence my puzzlement.  Yet, there it is, with a big fat " &" after it, 
> when I type "jobs".

Please quote the full wget command here (by copy+pasting from your
command line, not as you found it in ‘jobs’ or by retyping). Debugging
blind is impractical.

>>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>>> immediately.
>> 
>> ‘&’ doesn’t make the URL malformed.
>
> It does if it causes the software to misinterpret the URL.

You have a bizarre definition of ‘malformed URL’.

-- 
http://www.greenend.org.uk/rjk/

[toc] | [prev] | [next] | [standalone]

#3961

On 2017-02-12, MarkA <someone@somewhere.invalid> wrote:
> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>
>> Mark A <deeptht69@gmail.com> writes:
>>> Richard Kettlewell wrote:
>>>> Mark A writes:
>>>>> I'm using wget to download some large files from a download server,
>>>>> after several failed attempts to use Firefox's download function.  I
>>>>> can use the Firefox download function to get the URL of the source,
>>>>> then paste that into wget, running in a Gnome terminal window.  wget
>>>>> starts and shows its progress bar across the bottom of the window. 
>>>>> If I press "Enter", the progress bar freezes, moves up one line, and
>>>>> is immediately replaced by a new one that continues to update.
>>>>>
>>>>> After a few minutes, the progress bar stops updating.  If I press
>>>>> "Enter", I get the command prompt.  "jobs" shows wget still running,
>>>>> now in the background.
>>>> 
>>>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>>>
>>> No, no such characters in the URL.
>> 
>> Well, wget doesn’t generally put itself into the background for no
>> reason.
>
> Hence my puzzlement.  Yet, there it is, with a big fat " &" after it, 
> when I type "jobs".
>
>> 
>>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>>> immediately.
>> 
>> ‘&’ doesn’t make the URL malformed.
>
> It does if it causes the software to misinterpret the URL.
>
>

Why not show us EXACTLY what command you typed. 


>

[toc] | [prev] | [next] | [standalone]

#3962

On Mon, 13 Feb 2017 11:32:59 +0000, William Unruh wrote:

> On 2017-02-12, MarkA <someone@somewhere.invalid> wrote:
>> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>>
>>> Mark A <deeptht69@gmail.com> writes:
>>>> Richard Kettlewell wrote:
>>>>> Mark A writes:
>>>>>> I'm using wget to download some large files from a download server,
>>>>>> after several failed attempts to use Firefox's download function. 
>>>>>> I can use the Firefox download function to get the URL of the
>>>>>> source, then paste that into wget, running in a Gnome terminal
>>>>>> window.  wget starts and shows its progress bar across the bottom
>>>>>> of the window. If I press "Enter", the progress bar freezes, moves
>>>>>> up one line, and is immediately replaced by a new one that
>>>>>> continues to update.
>>>>>>
>>>>>> After a few minutes, the progress bar stops updating.  If I press
>>>>>> "Enter", I get the command prompt.  "jobs" shows wget still
>>>>>> running,
>>>>>> now in the background.
>>>>> 
>>>>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>>>>
>>>> No, no such characters in the URL.
>>> 
>>> Well, wget doesn’t generally put itself into the background for no
>>> reason.
>>
>> Hence my puzzlement.  Yet, there it is, with a big fat " &" after it,
>> when I type "jobs".
>>
>>
>>>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>>>> immediately.
>>> 
>>> ‘&’ doesn’t make the URL malformed.
>>
>> It does if it causes the software to misinterpret the URL.
>>
>>
>>
> Why not show us EXACTLY what command you typed.
> 
> 
>

Here it is (without line wraps in gnome terminal):

wget https://storage-ec2-462.sharefile.com/download.ashx?
dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d

Here is the command and response copied from the terminal:
toor@HPlaptop2013:/tmp$ wget https://storage-ec2-462.sharefile.com/
download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d
[1] 3755
toor@HPlaptop2013:/tmp$ --2017-02-13 14:57:54--  https://storage-
ec2-462.sharefile.com/download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935
Resolving storage-ec2-462.sharefile.com (storage-ec2-462.sharefile.com)... 
34.197.226.34
Connecting to storage-ec2-462.sharefile.com (storage-
ec2-462.sharefile.com)|34.197.226.34|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 6313479914 (5.9G) [application/zip]
Saving to: ‘download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935’


-- 
MarkA

You can safely assume that you have created God in your own image when it 
turns out that God hates all the same people you do.  -- Anne Lamott

[toc] | [prev] | [next] | [standalone]

#3963

On Mon, 13 Feb 2017 20:02:00 +0000, MarkA wrote:

> On Mon, 13 Feb 2017 11:32:59 +0000, William Unruh wrote:
> 
>> On 2017-02-12, MarkA <someone@somewhere.invalid> wrote:
>>> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>>>
>>>> Mark A <deeptht69@gmail.com> writes:
>>>>> Richard Kettlewell wrote:
>>>>>> Mark A writes:
>>>>>>> I'm using wget to download some large files from a download
>>>>>>> server,
>>>>>>> after several failed attempts to use Firefox's download function.
>>>>>>> I can use the Firefox download function to get the URL of the
>>>>>>> source, then paste that into wget, running in a Gnome terminal
>>>>>>> window.  wget starts and shows its progress bar across the bottom
>>>>>>> of the window. If I press "Enter", the progress bar freezes, moves
>>>>>>> up one line, and is immediately replaced by a new one that
>>>>>>> continues to update.
>>>>>>>
>>>>>>> After a few minutes, the progress bar stops updating.  If I press
>>>>>>> "Enter", I get the command prompt.  "jobs" shows wget still
>>>>>>> running,
>>>>>>> now in the background.
>>>>>> 
>>>>>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>>>>>
>>>>> No, no such characters in the URL.
>>>> 
>>>> Well, wget doesn’t generally put itself into the background for no
>>>> reason.
>>>
>>> Hence my puzzlement.  Yet, there it is, with a big fat " &" after it,
>>> when I type "jobs".
>>>
>>>
>>>>> A few '%'s, though.  Besides, a malformed URL would cause it to fail
>>>>> immediately.
>>>> 
>>>> ‘&’ doesn’t make the URL malformed.
>>>
>>> It does if it causes the software to misinterpret the URL.
>>>
>>>
>>>
>> Why not show us EXACTLY what command you typed.
>> 
>> 
>> 
>>
> Here it is (without line wraps in gnome terminal):
> 
> wget https://storage-ec2-462.sharefile.com/download.ashx?
> dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d
> 
> Here is the command and response copied from the terminal:
> toor@HPlaptop2013:/tmp$ wget https://storage-ec2-462.sharefile.com/
> download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d [1] 3755
> toor@HPlaptop2013:/tmp$ --2017-02-13 14:57:54--  https://storage-
> ec2-462.sharefile.com/download.ashx?
dt=dtee4b0bcf14d24d04a797f03216a4d935
> Resolving storage-ec2-462.sharefile.com
> (storage-ec2-462.sharefile.com)...
> 34.197.226.34 Connecting to storage-ec2-462.sharefile.com (storage-
> ec2-462.sharefile.com)|34.197.226.34|:443... connected.
> HTTP request sent, awaiting response... 200 OK Length: 6313479914 (5.9G)
> [application/zip]
> Saving to: ‘download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935’

Once the progress bar stops updating, and network traffic has dropped 
off, typing "jobs" gives:

toor@HPlaptop2013:/tmp$ jobs
[1]+  Running                 wget https://storage-ec2-462.sharefile.com/
download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935 &
toor@HPlaptop2013:/tmp$ 


-- 
MarkA

You can safely assume that you have created God in your own image when it 
turns out that God hates all the same people you do.  -- Anne Lamott

[toc] | [prev] | [next] | [standalone]

#3965

On Mon, 13 Feb 2017 20:08:37 +0000, MarkA wrote:

> On Mon, 13 Feb 2017 20:02:00 +0000, MarkA wrote:
> 
>> On Mon, 13 Feb 2017 11:32:59 +0000, William Unruh wrote:
>> 
>>> On 2017-02-12, MarkA <someone@somewhere.invalid> wrote:
>>>> On Sun, 12 Feb 2017 23:51:53 +0000, Richard Kettlewell wrote:
>>>>
>>>>> Mark A <deeptht69@gmail.com> writes:
>>>>>> Richard Kettlewell wrote:
>>>>>>> Mark A writes:
>>>>>>>> I'm using wget to download some large files from a download
>>>>>>>> server,
>>>>>>>> after several failed attempts to use Firefox's download function.
>>>>>>>> I can use the Firefox download function to get the URL of the
>>>>>>>> source, then paste that into wget, running in a Gnome terminal
>>>>>>>> window.  wget starts and shows its progress bar across the bottom
>>>>>>>> of the window. If I press "Enter", the progress bar freezes,
>>>>>>>> moves up one line, and is immediately replaced by a new one that
>>>>>>>> continues to update.
>>>>>>>>
>>>>>>>> After a few minutes, the progress bar stops updating.  If I press
>>>>>>>> "Enter", I get the command prompt.  "jobs" shows wget still
>>>>>>>> running,
>>>>>>>> now in the background.
>>>>>>> 
>>>>>>> I expect that there’s an ‘&’ in the URL and you didn’t quote it.
>>>>>>
>>>>>> No, no such characters in the URL.
>>>>> 
>>>>> Well, wget doesn’t generally put itself into the background for no
>>>>> reason.
>>>>
>>>> Hence my puzzlement.  Yet, there it is, with a big fat " &" after it,
>>>> when I type "jobs".
>>>>
>>>>
>>>>>> A few '%'s, though.  Besides, a malformed URL would cause it to
>>>>>> fail immediately.
>>>>> 
>>>>> ‘&’ doesn’t make the URL malformed.
>>>>
>>>> It does if it causes the software to misinterpret the URL.
>>>>
>>>>
>>>>
>>> Why not show us EXACTLY what command you typed.
>>> 
>>> 
>>> 
>>> 
>> Here it is (without line wraps in gnome terminal):
>> 
>> wget https://storage-ec2-462.sharefile.com/download.ashx?
>> dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
>> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d
>> 
>> Here is the command and response copied from the terminal:
>> toor@HPlaptop2013:/tmp$ wget https://storage-ec2-462.sharefile.com/
>> download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
>> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d [1] 3755
>> toor@HPlaptop2013:/tmp$ --2017-02-13 14:57:54--  https://storage-
>> ec2-462.sharefile.com/download.ashx?
> dt=dtee4b0bcf14d24d04a797f03216a4d935
>> Resolving storage-ec2-462.sharefile.com
>> (storage-ec2-462.sharefile.com)...
>> 34.197.226.34 Connecting to storage-ec2-462.sharefile.com (storage-
>> ec2-462.sharefile.com)|34.197.226.34|:443... connected.
>> HTTP request sent, awaiting response... 200 OK Length: 6313479914
>> (5.9G)
>> [application/zip]
>> Saving to: ‘download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935’
> 
> Once the progress bar stops updating, and network traffic has dropped
> off, typing "jobs" gives:
> 
> toor@HPlaptop2013:/tmp$ jobs [1]+  Running                 wget
> https://storage-ec2-462.sharefile.com/
> download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935 &
> toor@HPlaptop2013:/tmp$

New information: while doing something else, wget DID automatically 
resume, after a pause of perhaps 5 minutes:

toor@HPlaptop2013:/tmp$ 
download.ashx?dt=dtee4b0bcf14  27%[+++++++++
+==>                                     ]   1.64G  2.78MB/s    in 3m 
2s   

2017-02-13 15:38:42 (2.56 MB/s) - Read error at byte 
1765343232/6313479914 (Success). Retrying.

--2017-02-13 15:38:44--  (try: 3)  https://storage-ec2-462.sharefile.com/
download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935
Connecting to storage-ec2-462.sharefile.com (storage-
ec2-462.sharefile.com)|34.197.226.34|:443... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 6313479914 (5.9G), 4548136682 (4.2G) remaining [application/zip]
Saving to: ‘download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935’

<end quoted text>

So, it seems to be active in the foreground, sending a progress indicator 
to the terminal, until an error is made.  Then it quietly goes into the 
background, and after some time, resumes the download.  Not unreasonable 
behavior.

Thank you to everyone who replied to this thread, but I suppose it is 
working the way it should.  I just need to be more patient?

-- 
MarkA

You can safely assume that you have created God in your own image when it 
turns out that God hates all the same people you do.  -- Anne Lamott

[toc] | [prev] | [next] | [standalone]

#3964

MarkA <someone@somewhere.invalid> writes:
> Here it is (without line wraps in gnome terminal):
>
> wget https://storage-ec2-462.sharefile.com/download.ashx?
> dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
                                       ^
> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d

Told you so.

-- 
http://www.greenend.org.uk/rjk/

[toc] | [prev] | [next] | [standalone]

#3966

On Mon, 13 Feb 2017 20:16:02 +0000, Richard Kettlewell wrote:

> MarkA <someone@somewhere.invalid> writes:
>> Here it is (without line wraps in gnome terminal):
>>
>> wget https://storage-ec2-462.sharefile.com/download.ashx?
>> dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
>                                        ^
>> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d
> 
> Told you so.

Indeed you did.  I am humbled.

So how does an unquoted "&" affect the transfer?  I am using bash (of 
course), and the transfer starts and runs for a while before stopping.  I 
have subsequently discovered that it will restart on its own after 
several minutes.

-- 
MarkA

You can safely assume that you have created God in your own image when it 
turns out that God hates all the same people you do.  -- Anne Lamott

[toc] | [prev] | [next] | [standalone]

#3967

MarkA <someone@somewhere.invalid> writes:
> On Mon, 13 Feb 2017 20:16:02 +0000, Richard Kettlewell wrote:
>> MarkA <someone@somewhere.invalid> writes:
>>> Here it is (without line wraps in gnome terminal):
>>>
>>> wget https://storage-ec2-462.sharefile.com/download.ashx?
>>> dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
>>                                        ^
>>> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d
>> 
>> Told you so.
>
> Indeed you did.  I am humbled.
>
> So how does an unquoted "&" affect the transfer?  I am using bash (of 
> course), and the transfer starts and runs for a while before stopping.  I 
> have subsequently discovered that it will restart on its own after 
> several minutes.

It executes everything to the left of the ‘&’ as a background command.

That may or may not be related to the download behavior; probably not,
but it needs to be eliminated as a possibility.

-- 
http://www.greenend.org.uk/rjk/

[toc] | [prev] | [next] | [standalone]

#3968

On Mon, 13 Feb 2017 21:31:40 +0000, Richard Kettlewell wrote:

> MarkA <someone@somewhere.invalid> writes:
>> On Mon, 13 Feb 2017 20:16:02 +0000, Richard Kettlewell wrote:
>>> MarkA <someone@somewhere.invalid> writes:
>>>> Here it is (without line wraps in gnome terminal):
>>>>
>>>> wget https://storage-ec2-462.sharefile.com/download.ashx?
>>>> dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
>>>                                        ^
>>>> 2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d
>>> 
>>> Told you so.
>>
>> Indeed you did.  I am humbled.
>>
>> So how does an unquoted "&" affect the transfer?  I am using bash (of
>> course), and the transfer starts and runs for a while before stopping. 
>> I have subsequently discovered that it will restart on its own after
>> several minutes.
> 
> It executes everything to the left of the ‘&’ as a background command.
> 
> That may or may not be related to the download behavior; probably not,
> but it needs to be eliminated as a possibility.

I just ran the command again, this time single-quoting the URL.  When it 
got to a point where the data stopped coming, wget stayed in the 
foreground.  900 seconds later, it resumed the download after 
reconnecting to the server:

2017-02-13 16:40:51 (2.61 MB/s) - Read error at byte 
4984782848/6313479914 (Success). Retrying.

--2017-02-13 16:40:52--  (try: 2)  https://storage-ec2-462.sharefile.com/
download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d
Connecting to storage-ec2-462.sharefile.com (storage-
ec2-462.sharefile.com)|34.197.226.34|:443... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 6313479914 (5.9G), 1328697066 (1.2G) remaining [application/zip]
Saving to: ‘download.ashx?dt=dtee4b0bcf14d24d04a797f03216a4d935&h=H%
2bHB7RL13PQ9UWYn0spJbdXPG4Hp2mRtj1bIC4xfrG4%3d’

%3d                            82%[++++++++++++++++++++++++++++++++++++++
+=>         ]   4.85G  2.78MB/s    eta 6m 27s



Thanks again for the advice.

-- 
MarkA

You can safely assume that you have created God in your own image when it 
turns out that God hates all the same people you do.  -- Anne Lamott

[toc] | [prev] | [next] | [standalone]

#3969

MarkA <someone@somewhere.invalid> wrote:
> I just ran the command again, this time single-quoting the URL.
> When it got to a point where the data stopped coming, wget stayed in
> the foreground.

Quibble - before you quoted the '&' wget was "always" running in the
background, even before the point where data arrival stalled.  Likely
as not when you were hitting return it was simply scrolling the
terminal display, and wget's updates were overwriting the shell
prompt.

rick jones
-- 
oxymoron n, Hummer H2 with California Save Our Coasts and Oceans plates
these opinions are mine, all mine; HPE might not want them anyway... :)
feel free to post, OR email to rick.jones2 in hpe.com but NOT BOTH...

[toc] | [prev] | [next] | [standalone]

#3973

On Mon, 13 Feb 2017 21:58:18 +0000, Rick Jones wrote:

> MarkA <someone@somewhere.invalid> wrote:
>> I just ran the command again, this time single-quoting the URL. When it
>> got to a point where the data stopped coming, wget stayed in the
>> foreground.
> 
> Quibble - before you quoted the '&' wget was "always" running in the
> background, even before the point where data arrival stalled.  Likely as
> not when you were hitting return it was simply scrolling the terminal
> display, and wget's updates were overwriting the shell prompt.
> 
> rick jones

Yes, I see that now.  When the data stopped coming, wget stopped sending 
progress information, and it looked more like a usual, quiet background 
process.

The other point I find interesting is that it seems to have downloaded 
the correct file, even after losing the characters following the '&' char 
in the URL.

-- 
MarkA

In politics and in life, ignorance is not a virtue.
-- Barack Obama

[toc] | [prev] | [next] | [standalone]

#3970

On 2017-02-13 21:57, MarkA wrote:
> On Mon, 13 Feb 2017 20:16:02 +0000, Richard Kettlewell wrote:


>> Told you so.
> 
> Indeed you did.  I am humbled.
> 
> So how does an unquoted "&" affect the transfer?  I am using bash (of 
> course), and the transfer starts and runs for a while before stopping.  I 
> have subsequently discovered that it will restart on its own after 
> several minutes.

Maybe, but it is not downloading the file you wanted...  (incomplete
URL, remember), so who cares?

-- 
Cheers,
       Carlos E.R.

[toc] | [prev] | [next] | [standalone]

Page 1 of 2  [1] 2  Next page →

Back to top | Article view | comp.os.linux.networking

csiph-web