Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #99687

Re: Does Python allow variables to be passed into function for dynamic screen scraping?

Newsgroups comp.lang.python
Date 2015-11-28 20:52 -0800
References <e13afc4b-ac4e-4a75-bca6-1c7be9399cb6@googlegroups.com> <565a5bd5$0$1606$c3e8da3$5496439d@news.astraweb.com>
Message-ID <2e25f82c-1ed6-4c56-836d-8f9a25990ea9@googlegroups.com> (permalink)
Subject Re: Does Python allow variables to be passed into function for dynamic screen scraping?
From ryguy7272 <ryanshuell@gmail.com>

Show all headers | View raw


On Saturday, November 28, 2015 at 8:59:04 PM UTC-5, Steven D'Aprano wrote:
> On Sun, 29 Nov 2015 09:03 am, ryguy7272 wrote:
> 
> > I'm looking at this URL.
> > https://en.wikipedia.org/wiki/Wikipedia:Unusual_place_names
> 
> Don't screen-scrape Wikipedia. Just don't. They have an official API for
> downloading content, use it. There's even a Python library for downloading
> from Wikipedia and other Mediawiki sites:
> 
> https://www.mediawiki.org/wiki/Manual:Pywikibot
> 
> Wikimedia does a fantastic job, for free, and automated screen-scraping
> hurts their ability to provide that service. It is rude and anti-social.
> Please don't do it.
> 
> 
> 
> -- 
> Steven

Thanks Steven.  Do you know of a good tutorial for learning about Wikipedia APIs?  I'm not sure where to get started on this topic.  I did some Google searches, but didn't come up with a lot of useful info...not much actually...

Back to comp.lang.python | Previous | NextPrevious in thread | Find similar | Unroll thread


Thread

Does Python allow variables to be passed into function for dynamic screen scraping? ryguy7272 <ryanshuell@gmail.com> - 2015-11-28 14:03 -0800
  Re: Does Python allow variables to be passed into function for dynamic screen scraping? Laura Creighton <lac@openend.se> - 2015-11-28 23:28 +0100
    Re: Does Python allow variables to be passed into function for dynamic screen scraping? ryguy7272 <ryanshuell@gmail.com> - 2015-11-28 14:37 -0800
      Re: Does Python allow variables to be passed into function for dynamic screen scraping? Laura Creighton <lac@openend.se> - 2015-11-28 23:44 +0100
  Re: Does Python allow variables to be passed into function for dynamic screen scraping? Steven D'Aprano <steve@pearwood.info> - 2015-11-29 12:58 +1100
    Re: Does Python allow variables to be passed into function for dynamic screen scraping? ryguy7272 <ryanshuell@gmail.com> - 2015-11-28 20:52 -0800

csiph-web