Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #112038

Re: Python text file fetch specific part of line

Show all headers | View raw

On 29Jul2016 18:42, Gordon Levi <gordon@address.invalid> wrote:
>cs@zip.com.au wrote:
>
>>On 28Jul2016 19:28, Gordon Levi <gordon@address.invalid> wrote:
>>>Arshpreet Singh <arsh840@gmail.com> wrote:
>>>>I am writing Imdb scrapper, and getting available list of titles from IMDB
>>>>website which provide txt file in very raw format, Here is the one part of
>>>>file(http://pastebin.com/fpMgBAjc) as the file provides tags like
>>>>Distribution  Votes,Rank,Title I want to parse title names, I tried with
>>>>readlines() method but it returns only list which is quite heterogeneous, is
>>>>it possible that I can parse each value comes under title section?
>>>
>>>Beautiful Soup will make your task much easier
>>><https://www.crummy.com/software/BeautifulSoup/>.
>>
>>Did you look at his sample data?
>
>No. I read he was "writing an IMDB scraper, and getting the available
>list of titles from the IMDB web site". It's here
><http://www.imdb.com/>.
>
>> Plain text, not HTML or XML. Beautiful Soup is
>>not what he needs here.
>
>Fortunately the OP told us his application rather than just telling us
>his current problem. His life would be much easier if he ignored the
>plain text he has obtained so far and started again using a Beautiful
>Soup tutorial.

Or bypass IMDB's computer unfriendliness and go straight to http://omdbapi.com/

You can have JSON directly from it, and avoid BS entirely. BS is an amazing 
library, but is essentially a workaround for computer-hostile websites: those 
not providing clean machine readable data, and only unstable mutable HTML 
output.

Cheers,
Cameron Simpson <cs@zip.com.au>

Back to comp.lang.python | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

Python text file fetch specific part of line Arshpreet Singh <arsh840@gmail.com> - 2016-07-27 22:12 -0700
  Re: Python text file fetch specific part of line cs@zip.com.au - 2016-07-28 17:04 +1000
    Re: Python text file fetch specific part of line honeygne@gmail.com - 2016-08-01 23:55 -0700
  Re: Python text file fetch specific part of line Gordon Levi <gordon@address.invalid> - 2016-07-28 19:28 +1000
    Re: Python text file fetch specific part of line cs@zip.com.au - 2016-07-29 08:17 +1000
      Re: Python text file fetch specific part of line Gordon Levi <gordon@address.invalid> - 2016-07-29 18:42 +1000
        Re: Python text file fetch specific part of line cs@zip.com.au - 2016-07-30 12:46 +1000

csiph-web