Re: web scraping

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!feeds.phibee-telecom.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path	<python-python-list@m.gmane.org>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.013
X-Spam-Evidence	'H': 0.97; 'S': 0.00; 'python.': 0.02; 'from:addr:yahoo.co.uk': 0.04; 'beginner': 0.05; 'lawrence': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'url:software': 0.09; 'received:80.91.229.3': 0.16; 'received:plane.gmane.org': 0.16; 'red,': 0.16; 'tab': 0.16; 'track.': 0.16; 'urllib': 0.16; 'wrote:': 0.18; 'trying': 0.19; 'programming': 0.22; 'header:User- Agent:1': 0.23; 'tutorials': 0.26; 'web.': 0.26; 'header:X -Complaints-To:1': 0.27; 'header:In-Reply-To:1': 0.27; 'along': 0.30; 'figure': 0.32; 'but': 0.35; 'located': 0.36; 'thanks': 0.36; 'sometimes': 0.38; 'manager': 0.38; 'auto': 0.38; 'to:addr :python-list': 0.38; 'sure': 0.39; 'to:addr:python.org': 0.39; 'received:org': 0.40; 'how': 0.40; 'read': 0.60; 'most': 0.60; 'new': 0.61; 'times': 0.62; 'address': 0.63; 'email addr:gmail.com': 0.63; 'information': 0.63; 'name': 0.63; 'such': 0.63; 'our': 0.64; 'phone': 0.66; 'note:': 0.66; 'believe': 0.68; 'owner,': 0.78; 'dealership': 0.84; 'scraping': 0.84
X-Injected-Via-Gmane	http://gmane.org/
To	python-list@python.org
From	Mark Lawrence <breamoreboy@yahoo.co.uk>
Subject	Re: web scraping
Date	Sat, 12 Oct 2013 16:53:31 +0100
References	<28798DAD-5F0F-478B-B66F-91FD8DDF13EA@gmail.com>
Mime-Version	1.0
Content-Type	text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding	7bit
X-Gmane-NNTP-Posting-Host	host-78-147-178-154.as13285.net
User-Agent	Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Thunderbird/24.0.1
In-Reply-To	<28798DAD-5F0F-478B-B66F-91FD8DDF13EA@gmail.com>
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.1040.1381593226.18130.python-list@python.org> (permalink)
Lines	29
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1381593226 news.xs4all.nl 15905 [2001:888:2000:d::a6]:59872
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:56746

Show key headers only | View raw

On 12/10/2013 15:12, Ronald Routt wrote:
> 	I am new to programming and trying to figure out python.
>
> I am trying to learn which tools and tutorials I need to use along with some good beginner tutorials in scraping the the web.  The end result I am trying to come up with is scraping auto dealership sites for the following:
>
> 1.Name of dealership
> 2.  State where dealership is located
> 3.  Name of Owner, President or General Manager
> 4.  Email address of number 3 above
> 5.  Phone number of dealership
>
> Note:  Many times the Owner, President or General Manager and their email address is under a tab on the website such as "Meet our team" or "Support".  Sometimes this information is not available on the website.
>
> I sure would appreciate any help I can get to get me on the right track.  From what I have read so far, believe I have to use urllib but know nothing about how to us it..
>
> Thanks
> ronroutt@gmail.com
>

Take a look at this http://www.crummy.com/software/BeautifulSoup/

-- 
Roses are red,
Violets are blue,
Most poems rhyme,
But this one doesn't.

Mark Lawrence

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: web scraping Mark Lawrence <breamoreboy@yahoo.co.uk> - 2013-10-12 16:53 +0100

csiph-web