Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #62205

RE: Question RE urllib

Path csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!xlned.com!feeder1.xlned.com!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <jljames@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.050
X-Spam-Evidence '*H*': 0.90; '*S*': 0.00; 'handler': 0.05; 'subject:Question': 0.07; 'exception,': 0.09; 'try:': 0.09; 'blocked': 0.16; 'e:\xa0': 0.16; 'internally': 0.16; 'logon': 0.16; 'urllib': 0.16; 'when,': 0.16; 'component': 0.16; 'all.': 0.16; 'sender:addr:gmail.com': 0.17; '8bit%:5': 0.22; 'programming': 0.22; 'import': 0.22; 'print': 0.22; "i've": 0.25; 'script': 0.25; 'suggested': 0.26; 'least': 0.26; 'reporting': 0.29; 'message-id:@mail.gmail.com': 0.30; "i'm": 0.30; 'url:mailman': 0.30; '"",': 0.31; '&quot;': 0.31; 'sites.': 0.31; 'up.': 0.33; 'url:python': 0.33; 'could': 0.34; 'except': 0.35; 'skip:u 20': 0.35; 'but': 0.35; 'received:google.com': 0.35; 'there': 0.35; 'done': 0.36; 'url:listinfo': 0.36; 'thanks': 0.36; 'url:org': 0.36; 'should': 0.36; 'being': 0.38; 'server': 0.38; 'skip:& 10': 0.38; 'requiring': 0.38; 'url:amazon': 0.38; 'skip:[ 10': 0.38; 'to:addr:python-list': 0.38; 'expect': 0.39; 'sure': 0.39; 'to:addr:python.org': 0.39; 'url:mail': 0.40; 'lower': 0.61; 'simply': 0.61; 'our': 0.64; 'provide': 0.64; 'due': 0.66; 'determine': 0.67; 'content,': 0.68; 'home': 0.69; 'fact,': 0.69; 'etc.]': 0.84; 'examples.': 0.84; 'respect.': 0.84; '\xa0there': 0.91
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=qiXqXmF5JUEUY3jlwfTd3sR0iEf/zcrMPZqFdyI2e5k=; b=oEw83hNBzR4tXCoHvwF1Zy+qLwjXiyA6+ybXSj064721O1Z3jYW7xrsRT1TYYtOP2R XujHn1cA+VugvjWu1NxAoFvm2q5UEGP12nqDNRhaRejw6FeAfcH7BdcPLcpivjXYMW9+ BLC8IrvIEDEDqaBmwmJTYKidXlE07qM8C30BBL0LxiDVbV/2N6aYi38sxxbhfNwjxrfu HXJ3wY6GCSLpZdXU4i/pZKOBoqX19+UKUZehYwTeHnkZQ0pzSRn3EaFrgvmWW+m52b67 ebIQQIed/4KoDRjkp3KzgfdA1BxM/NY+7s3nWkn5UKEiU+nllBHaszKk9rgYZgHjoUjC mPnw==
MIME-Version 1.0
X-Received by 10.182.29.66 with SMTP id i2mr16791008obh.23.1387293985082; Tue, 17 Dec 2013 07:26:25 -0800 (PST)
Sender jljames@gmail.com
Date Tue, 17 Dec 2013 08:26:25 -0700
X-Google-Sender-Auth BEogPWTHpsqWgpD9y1-5fmNpCjQ
Subject RE: Question RE urllib
From Jeff James <jeff@jeffljames.com>
To python-list@python.org
Content-Type multipart/alternative; boundary=001a11c2bbdc2e161f04edbc8d18
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.4289.1387293988.18130.python-list@python.org> (permalink)
Lines 92
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1387293988 news.xs4all.nl 2889 [2001:888:2000:d::a6]:37383
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:62205

Show key headers only | View raw


[Multipart message — attachments visible in raw view] - view raw

So I'm using the following script to check our sites to make sure they are
all up and some of them are reporting they are "down" when, in fact, they
are actually up.   These sites do not require a logon in order for the home
page to come up.  Could this be due to some port being blocked internally ?
 Only one of the sites reporting as down is "https" but all are internal
sites.  Is there some other component I should be including in the script ?
 There are about 30 or 40 sites that I have listed in all.  I just use
those in the following script as examples.   Thanks

import urllib

sites = ["http://www.amazon.com/", "https://internalsite.com/intranet.html",
etc.]

for site in sites:
    try:
        urllib.urlopen(site)
        print site + " "
    except Exception, e:
        print site + " is down"
-- 
https://mail.python.org/mailman/listinfo/python-list


I've never used urllib, although I've done a fair amount of network
programming at lower levels.

Are you sure the report of "down" isn't simply a time out due to the server
being busier than you expect when you hit it?

-Bill

After adding the line suggested by Larry, I was able to determine that the
URLs reporting as "down" were actually sites requiring authentication in
order to provide site content, so adding that line to the handler was at
least enlightening in that respect.  Thanks Larry.

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

RE: Question RE urllib Jeff James <jeff@jeffljames.com> - 2013-12-17 08:26 -0700

csiph-web