Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #62950

Re: lookup xpath (other?) to value in html

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

>
> Which Chrome extension are you using to get that path?

Built in, right click on source > copy xpath​​

Ya that gets square footage and I like how you did it, are you interested
in doing that for all information on the page and also the historical pages
;-)
Since I have the data for some of the pages, I got this from the county on
a cd, I thought defining the xpath would be easier using bs4 or
http://lxml.de/




Vincent Davis
720-301-3003


On Tue, Dec 31, 2013 at 10:30 PM, Jason Friedman <jsf80238@gmail.com> wrote:

> > For example this URL;
> > http://jeffco.us/ats/displaygeneral.do?sch=001690
> > The the land sqft is 11082.
> > Google Chrome gives me the xpath to that data as;
> > //*[@id="content"]/p[1]/table[4]/tbody/tr[2]/td[8]
> >
> > What I would like to do (using python) is given 11082 at what xpath can
> that
> > be found? (may be more that one)
> > The examples I can find using google refer to, given xpath what is the
> value
> > (the opposite of what I want)
>
> Which Chrome extension are you using to get that path?
>
> Are you always interested in the square footage?  Here is a solution
> using Beautiful Soup:
>
> $ cat square-feet.py
> #!/usr/bin/env python
> import bs4
> import requests
> import sys
> url = sys.argv[1]
> request = requests.get(url)
> soup = bs4.BeautifulSoup(request.text)
> is_sqft_mark_found, is_total_mark_found = False, False
> for line in soup.get_text().splitlines():
>     if line.startswith("Land Sqft"):
>         is_sqft_mark_found = True
>         continue
>     elif is_sqft_mark_found and line.startswith("Total"):
>         is_total_mark_found = True
>         continue
>     elif is_total_mark_found:
>         print(line.strip() + " total square feet.")
>         break
>
> $ python3 square-feet.py http://jeffco.us/ats/displaygeneral.do?sch=001690
> 11082 total square feet.
> --
> https://mail.python.org/mailman/listinfo/python-list
>

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: lookup xpath (other?) to value in html Vincent Davis <vincent@vincentdavis.net> - 2013-12-31 22:47 -0700

csiph-web