Path: csiph.com!usenet.pasdenom.info!weretis.net!feeder4.news.weretis.net!ecngs!feeder2.ecngs.de!newsfeed.freenet.ag!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
MIME-Version: 1.0
Date: Fri, 7 Dec 2012 13:52:52 +0100
Subject: python 3.3 urllib.request
From: Steeve C <steevechailloux@gmail.com>
To: python-list@python.org
Content-Type: multipart/alternative; boundary=f46d0401f91d9d700e04d042b15a
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.605.1354884780.29569.python-list@python.org>
Lines: 116
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:34457

--f46d0401f91d9d700e04d042b15a
Content-Type: text/plain; charset=ISO-8859-1

hello,

I have a python3 script with urllib.request which have a strange behavior,
here is the script :

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
#!/usr/bin/env python3
# -*- coding: utf-8 -*-

import urllib.request
import sys, time


url = 'http://google.com'

def make_some_stuff(page, url):
    sys.stderr.write(time.strftime("%d/%m/%Y %H:%M:%S -> page from \"") +
url + "\"\n")
    sys.stderr.write(str(page) + "\"\n")
    return True

def get_page(url):
    while 1:
        try:
            page = urllib.request.urlopen(url)
            yield page

        except urllib.error.URLError as e:
            sys.stderr.write(time.strftime("%d/%m/%Y %H:%M:%S -> impossible
to access to \"") + url + "\"\n")
            time.sleep(5)
            continue

def main():
    print('in main')
    for page in get_page(url):
        make_some_stuff(page, url)
        time.sleep(5)

if __name__ == '__main__':
    main()
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

if the computer is connected on internet (with an ethernet connection for
example) and I run this script, it works like a charme :
- urllib.request.urlopen return the page
- make_some_stuff write in stderr
- when the ethernet cable is unplug the except block handle the error while
the cable is unplug, and when the cable is pluged
back urllib.request.urlopen return the page and make_some_stuff write in
stderr

this is the normal behavior (for me, imho).

but if the computer is not connected on internet (ethernet cable unpluged)
and I run this script, the except block handle the error (normal), but when
I plug the cable, the script continue looping and urllib.request.urlopen
never return the page (so, it alway go to the except block)

What can I do to handle that ?

Thanks

Steeve

--f46d0401f91d9d700e04d042b15a
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

hello,<div><br></div><div>I have a python3 script with urllib.request which=
 have a strange behavior, here is the script :</div><div><br></div><div>+++=
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++=
+++</div>
<div><div>#!/usr/bin/env python3</div><div># -*- coding: utf-8 -*-</div><di=
v><br></div><div>import urllib.request</div><div>import sys, time</div><div=
><br></div><div><br></div><div>url =3D &#39;<a href=3D"http://google.com">h=
ttp://google.com</a>&#39;</div>
<div><br></div><div>def make_some_stuff(page, url):</div><div>=A0 =A0 sys.s=
tderr.write(time.strftime(&quot;%d/%m/%Y %H:%M:%S -&gt; page from \&quot;&q=
uot;) + url + &quot;\&quot;\n&quot;)</div><div>=A0 =A0 sys.stderr.write(str=
(page) + &quot;\&quot;\n&quot;)</div>
<div>=A0 =A0 return True</div><div><br></div><div>def get_page(url):</div><=
div>=A0 =A0 while 1:</div><div>=A0 =A0 =A0 =A0 try:</div><div>=A0 =A0 =A0 =
=A0 =A0 =A0 page =3D urllib.request.urlopen(url)</div><div>=A0 =A0 =A0 =A0 =
=A0 =A0 yield page</div><div><br></div>
<div>=A0 =A0 =A0 =A0 except urllib.error.URLError as e:</div><div>=A0 =A0 =
=A0 =A0 =A0 =A0 sys.stderr.write(time.strftime(&quot;%d/%m/%Y %H:%M:%S -&gt=
; impossible to access to \&quot;&quot;) + url + &quot;\&quot;\n&quot;)</di=
v><div>=A0 =A0 =A0 =A0 =A0 =A0 time.sleep(5)</div>
<div>=A0 =A0 =A0 =A0 =A0 =A0 continue</div><div><br></div><div>def main():<=
/div><div>=A0 =A0 print(&#39;in main&#39;)</div><div>=A0 =A0 for page in ge=
t_page(url):</div><div>=A0 =A0 =A0 =A0 make_some_stuff(page, url)</div><div=
>=A0 =A0 =A0 =A0 time.sleep(5)</div>
<div><br></div><div>if __name__ =3D=3D &#39;__main__&#39;:</div><div>=A0 =
=A0 main()</div></div><div>++++++++++++++++++++++++++++++++++++++++++++++++=
+++++++++++++++++++++++++++++++++<br></div><div><br></div><div>if the compu=
ter is connected on internet (with an ethernet connection for example) and =
I run this script, it works like a charme :</div>
<div>-=A0urllib.request.urlopen return the page</div><div>-=A0make_some_stu=
ff write in stderr</div><div>- when the ethernet cable is unplug the except=
 block handle the error while the cable is unplug, and when the cable is pl=
uged back=A0urllib.request.urlopen return the page and=A0make_some_stuff wr=
ite in stderr</div>
<div><br></div><div>this is the normal behavior (for me, imho).</div><div><=
br></div><div>but if the computer is not connected on internet (ethernet ca=
ble unpluged) and I run this script, the except block handle the error (nor=
mal), but when I plug the cable, the script continue looping and=A0urllib.r=
equest.urlopen never return the page (so, it alway go to the except block)<=
/div>
<div><br></div><div>What can I do to handle that ?</div><div><br></div><div=
>Thanks</div><div><br></div><div>Steeve</div>

--f46d0401f91d9d700e04d042b15a--