Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #78014 > unrolled thread

Best approach to get data from web page continuously

Back to article view | Back to comp.lang.python

Contents

  Best approach to get data from web page continuously Juan Christian <juan0christian@gmail.com> - 2014-09-18 10:30 -0300

#78014 — Best approach to get data from web page continuously

[Multipart message — attachments visible in raw view] — view raw

I'll write a python (Python 3.4.1) script to fetch for new data (topics)
from this page (http://steamcommunity.com/app/440/tradingforum)
continuously.

All the topics follow this structure: <a class="forum_topic_overlay" href="
http://steamcommunity.com/app/440/tradingforum/TOPIC_ID/"> </a>

It will work like that: I'll get the last topics, do some background
checking regarding user level, inventory value, account age, and other
things, if the user pass in the checking, I'll print some info and links in
the terminal. The only thing I need to know to start is: What's the better
way the get this data? Beautiful Soup 4 + requests? urllib? Others?

Thanks.

[toc] | [standalone]

Back to top | Article view | comp.lang.python

csiph-web