Re: extract HTML table in a structured format

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.mixmin.net!eweka.nl!hq-usenetpeers.eweka.nl!xlned.com!feeder1.xlned.com!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<rosuav@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.021
X-Spam-Evidence	'H': 0.96; 'S': 0.00; 'wiki': 0.03; 'notice,': 0.07; 'source.': 0.07; 'parsed': 0.09; 'parsing': 0.09; 'worse': 0.09; 'changes': 0.15; 'from:addr:rosuav': 0.16; 'from:name:chris angelico': 0.16; 'shortcut': 0.16; 'subject:format': 0.16; 'thanks,': 0.17; 'wrote:': 0.18; 'thu,': 0.19; 'command': 0.22; 'parse': 0.24; 'task': 0.26; 'skip:" 20': 0.27; 'header:In-Reply- To:1': 0.27; 'idea': 0.28; 'specifically': 0.29; 'am,': 0.29; 'message-id:@mail.gmail.com': 0.30; 'that.': 0.31; 'extract': 0.31; 'option.': 0.31; 'table': 0.34; "i'd": 0.34; 'could': 0.34; 'received:209.85': 0.35; 'done.': 0.35; 'but': 0.35; 'received:google.com': 0.35; 'there': 0.35; 'are,': 0.36; 'shows': 0.36; 'hi,': 0.36; 'too': 0.37; 'project': 0.37; 'received:209': 0.37; 'depends': 0.38; 'to:addr:python-list': 0.38; 'anything': 0.39; 'to:addr:python.org': 0.39; 'either': 0.39; 'called': 0.40; 'even': 0.60; 'skip:u 10': 0.60; 'read': 0.60; 'eye': 0.61; 'different': 0.65; 'great': 0.65; 'webpage': 0.68; 'vulnerable': 0.84; 'differences': 0.93; '2013': 0.98
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=iX3ZPhAfaSh+b/190VdGha/4hDx4zYB+dsJFmoabogM=; b=wPBlVg1K2XdkDisSgXr8Jv83hXR5vZurK49Hq446RYNLCzl9G09qiUthOJBFJI0r7c VIAuaHHgRgyng6mMpdtq93pCmKO6xlBeB5VjEOgzPWt93KbGkF1h3bwYpfh0Xdfk2PUE Ta46gX/PcVjpEKla86XiHVY7FE6ly9GfGR329X64uUDlhEb4KVWlGXi7pmPll85FVxYJ q/9muequc8pLD32RctPutw6IU90ltXlTx+7Ah0mEIoXreRAzhhB80iW7iDWfuM9rSRQY FbOuROci4E5KRUtI/WZJanqnOn/jxYNBHeVC+s0PK7f4F1MGwOaLUE8s7ToUOFJV+fs8 rFvw==
MIME-Version	1.0
X-Received	by 10.68.189.163 with SMTP id gj3mr5748778pbc.207.1365642285493; Wed, 10 Apr 2013 18:04:45 -0700 (PDT)
In-Reply-To	<CAOuJsMmDHiOGd_m9qmbj3Mm6zHr818MP_p4E+Lcdpq8MdLKXsA@mail.gmail.com>
References	<CAOuJsM=u75nv-TxVCpXdcxmfyhxyY0v-NTYPEeGh1MmMuzxCVg@mail.gmail.com> <CAJ6cK1YYJKw6TqgZG4h2=Or0r4FZ21SkxN8FanH7Yj+tA+ALVg@mail.gmail.com> <CAOuJsMmDHiOGd_m9qmbj3Mm6zHr818MP_p4E+Lcdpq8MdLKXsA@mail.gmail.com>
Date	Thu, 11 Apr 2013 11:04:45 +1000
Subject	Re: extract HTML table in a structured format
From	Chris Angelico <rosuav@gmail.com>
To	python-list@python.org
Content-Type	text/plain; charset=ISO-8859-1
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.433.1365642293.3114.python-list@python.org> (permalink)
Lines	20
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1365642293 news.xs4all.nl 2598 [2001:888:2000:d::a6]:44872
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:43305

Show key headers only | View raw

On Thu, Apr 11, 2013 at 4:15 AM, Jabba Laci <jabba.laci@gmail.com> wrote:
> Hi,
>
> Thanks, it's a great idea to parse the wiki source. Since then I have found
> a command for this particular task called "ubuntu-support-status" that shows
> what I need.

That sounds like an even better option. Anything that depends on
parsing a wiki is vulnerable to format changes at a moment's notice,
even worse than other web page parsing.

> But the idea to extract an HTML table from a webpage in a structured format
> could be an interesting (and useful) project idea.

There are, unfortunately, too many different ways this can be done.
Too many differences in HTML that a human eye would read as the same
thing. I'd recommend either BeautifulSoup or specifically looking at
the HTML to be parsed and finding a shortcut from that.

ChrisA

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: extract HTML table in a structured format Chris Angelico <rosuav@gmail.com> - 2013-04-11 11:04 +1000

csiph-web