Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!xlned.com!feeder1.xlned.com!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.050 X-Spam-Evidence: '*H*': 0.90; '*S*': 0.00; 'handler': 0.05; 'subject:Question': 0.07; 'exception,': 0.09; 'try:': 0.09; 'blocked': 0.16; 'e:\xa0': 0.16; 'internally': 0.16; 'logon': 0.16; 'urllib': 0.16; 'when,': 0.16; 'component': 0.16; 'all.': 0.16; 'sender:addr:gmail.com': 0.17; '8bit%:5': 0.22; 'programming': 0.22; 'import': 0.22; 'print': 0.22; "i've": 0.25; 'script': 0.25; 'suggested': 0.26; 'least': 0.26; 'reporting': 0.29; 'message-id:@mail.gmail.com': 0.30; "i'm": 0.30; 'url:mailman': 0.30; '"",': 0.31; '"': 0.31; 'sites.': 0.31; 'up.': 0.33; 'url:python': 0.33; 'could': 0.34; 'except': 0.35; 'skip:u 20': 0.35; 'but': 0.35; 'received:google.com': 0.35; 'there': 0.35; 'done': 0.36; 'url:listinfo': 0.36; 'thanks': 0.36; 'url:org': 0.36; 'should': 0.36; 'being': 0.38; 'server': 0.38; 'skip:& 10': 0.38; 'requiring': 0.38; 'url:amazon': 0.38; 'skip:[ 10': 0.38; 'to:addr:python-list': 0.38; 'expect': 0.39; 'sure': 0.39; 'to:addr:python.org': 0.39; 'url:mail': 0.40; 'lower': 0.61; 'simply': 0.61; 'our': 0.64; 'provide': 0.64; 'due': 0.66; 'determine': 0.67; 'content,': 0.68; 'home': 0.69; 'fact,': 0.69; 'etc.]': 0.84; 'examples.': 0.84; 'respect.': 0.84; '\xa0there': 0.91 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=qiXqXmF5JUEUY3jlwfTd3sR0iEf/zcrMPZqFdyI2e5k=; b=oEw83hNBzR4tXCoHvwF1Zy+qLwjXiyA6+ybXSj064721O1Z3jYW7xrsRT1TYYtOP2R XujHn1cA+VugvjWu1NxAoFvm2q5UEGP12nqDNRhaRejw6FeAfcH7BdcPLcpivjXYMW9+ BLC8IrvIEDEDqaBmwmJTYKidXlE07qM8C30BBL0LxiDVbV/2N6aYi38sxxbhfNwjxrfu HXJ3wY6GCSLpZdXU4i/pZKOBoqX19+UKUZehYwTeHnkZQ0pzSRn3EaFrgvmWW+m52b67 ebIQQIed/4KoDRjkp3KzgfdA1BxM/NY+7s3nWkn5UKEiU+nllBHaszKk9rgYZgHjoUjC mPnw== MIME-Version: 1.0 X-Received: by 10.182.29.66 with SMTP id i2mr16791008obh.23.1387293985082; Tue, 17 Dec 2013 07:26:25 -0800 (PST) Sender: jljames@gmail.com Date: Tue, 17 Dec 2013 08:26:25 -0700 X-Google-Sender-Auth: BEogPWTHpsqWgpD9y1-5fmNpCjQ Subject: RE: Question RE urllib From: Jeff James To: python-list@python.org Content-Type: multipart/alternative; boundary=001a11c2bbdc2e161f04edbc8d18 X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 92 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1387293988 news.xs4all.nl 2889 [2001:888:2000:d::a6]:37383 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:62205 --001a11c2bbdc2e161f04edbc8d18 Content-Type: text/plain; charset=ISO-8859-1 So I'm using the following script to check our sites to make sure they are all up and some of them are reporting they are "down" when, in fact, they are actually up. These sites do not require a logon in order for the home page to come up. Could this be due to some port being blocked internally ? Only one of the sites reporting as down is "https" but all are internal sites. Is there some other component I should be including in the script ? There are about 30 or 40 sites that I have listed in all. I just use those in the following script as examples. Thanks import urllib sites = ["http://www.amazon.com/", "https://internalsite.com/intranet.html", etc.] for site in sites: try: urllib.urlopen(site) print site + " " except Exception, e: print site + " is down" -- https://mail.python.org/mailman/listinfo/python-list I've never used urllib, although I've done a fair amount of network programming at lower levels. Are you sure the report of "down" isn't simply a time out due to the server being busier than you expect when you hit it? -Bill After adding the line suggested by Larry, I was able to determine that the URLs reporting as "down" were actually sites requiring authentication in order to provide site content, so adding that line to the handler was at least enlightening in that respect. Thanks Larry. --001a11c2bbdc2e161f04edbc8d18 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
<= div class=3D"">
So I'm using the fo= llowing script to check our sites to make sure they are all up and some of = them are reporting they are "down" when, in fact, they are actual= ly up. =A0 These sites do not require a logon in order for the home page to= come up. =A0Could this be due to some port being blocked internally ? =A0O= nly one of the sites reporting as down is "https" but all are int= ernal sites. =A0Is there some other component I should be including in the = script ? =A0There are about 30 or 40 sites that I have listed in all. =A0I = just use those in the following script as examples. =A0 Thanks

import urllib


for site in sites:
=A0 =A0 try:
=A0= =A0 =A0 =A0 urllib.urlopen(site)
=A0 =A0 =A0 =A0 print site + &q= uot; "
=A0 =A0 except Exception, e:
=A0 =A0 =A0 = =A0 print site + " is down"
--=A0
https://mail.python.org/mailman/listinfo/pytho= n-list

I've never used urllib, altho= ugh I've done a fair amount of network programming at lower levels.

Are you sure the report of "down" isn't s= imply a time out due to the server being busier than you expect when you hi= t it?

-Bill

After adding = the line suggested by Larry, I was able to determine that the URLs reportin= g as "down" were actually sites requiring authentication in order= to provide site content, so adding that line to the handler was at least e= nlightening in that respect. =A0Thanks Larry.
--001a11c2bbdc2e161f04edbc8d18--