web scraping

Path	csiph.com!usenet.pasdenom.info!aioe.org!news.stack.nl!newsfeed.xs4all.nl!newsfeed1.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<ronroutt@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	UNSURE 0.239
X-Spam-Level	**
X-Spam-Evidence	'H': 0.53; 'S': 0.01; 'python.': 0.02; 'beginner': 0.05; 'tab': 0.16; 'track.': 0.16; 'urllib': 0.16; 'trying': 0.19; 'programming': 0.22; 'tutorials': 0.26; 'web.': 0.26; 'along': 0.30; 'figure': 0.32; 'but': 0.35; 'received:google.com': 0.35; 'located': 0.36; 'charset:us-ascii': 0.36; 'thanks': 0.36; 'sometimes': 0.38; 'message-id:@gmail.com': 0.38; 'manager': 0.38; 'auto': 0.38; 'to:addr:python-list': 0.38; 'sure': 0.39; 'to:addr:python.org': 0.39; 'how': 0.40; 'read': 0.60; 'new': 0.61; 'times': 0.62; 'address': 0.63; 'header :Message-Id:1': 0.63; 'email addr:gmail.com': 0.63; 'information': 0.63; 'name': 0.63; 'such': 0.63; 'our': 0.64; 'phone': 0.66; 'note:': 0.66; 'believe': 0.68; 'owner,': 0.78; 'dealership': 0.84; 'scraping': 0.84
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=xVzOFPFcxvoS2waM1UXTa8LanYAb+ygpGsQleyQUIBw=; b=mVATgoCdJYrFuE8DvfApTgqC61pC+9+CKs4c4B6Uzimn+W1ODZY/mcztxGUdS+6kcx 2gGL5W328wXA6rlkhzsnLB62lRQD64cq+QmZCh/TwPDJPxyodN6g32m+MvuSRdt6Y1Wn uzAT/oRo1cySJ0V6GJ3lCSpyh56k+vOi61uCCMBtLY8nKlYuSfVMVV8pNUMySze8RNd7 tTZG211yxSjS1nyMIdFjVt4N5dwayD7J61i9Q6dDt9ELsaL4tfJLsjKCiANTCfROGJH6 xT7+f9EqAB/vflHaaLYUPS8MfaeJaF7JYLgDlSXBfJp1k3ENBEmhjsF5BcFmsNGdtUe/ Lg8A==
X-Received	by 10.60.41.164 with SMTP id g4mr60421oel.44.1381587161091; Sat, 12 Oct 2013 07:12:41 -0700 (PDT)
From	Ronald Routt <ronroutt@gmail.com>
Content-Type	text/plain; charset=us-ascii
Content-Transfer-Encoding	quoted-printable
Subject	web scraping
Date	Sat, 12 Oct 2013 10:12:38 -0400
To	python-list@python.org
Mime-Version	1.0 (Mac OS X Mail 6.6 \(1510\))
X-Mailer	Apple Mail (2.1510)
X-Mailman-Approved-At	Sat, 12 Oct 2013 17:33:26 +0200
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.1039.1381592008.18130.python-list@python.org> (permalink)
Lines	23
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1381592008 news.xs4all.nl 15890 [2001:888:2000:d::a6]:52794
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:56745

Show key headers only | View raw

	I am new to programming and trying to figure out python.  

I am trying to learn which tools and tutorials I need to use along with some good beginner tutorials in scraping the the web.  The end result I am trying to come up with is scraping auto dealership sites for the following:  

1.Name of dealership
2.  State where dealership is located
3.  Name of Owner, President or General Manager
4.  Email address of number 3 above
5.  Phone number of dealership

Note:  Many times the Owner, President or General Manager and their email address is under a tab on the website such as "Meet our team" or "Support".  Sometimes this information is not available on the website.

I sure would appreciate any help I can get to get me on the right track.  From what I have read so far, believe I have to use urllib but know nothing about how to us it..

Thanks
ronroutt@gmail.com

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

web scraping Ronald Routt <ronroutt@gmail.com> - 2013-10-12 10:12 -0400
  Re: web scraping dvghana@gmail.com - 2013-10-12 13:35 -0700
    Re: web scraping John Nagle <nagle@animats.com> - 2013-10-13 11:02 -0700

csiph-web