Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #98978

How can I export data from a website and write the contents to a text file?

Newsgroups comp.lang.python
Date 2015-11-18 08:37 -0800
Message-ID <9365cf2f-e9c7-4338-83b4-ce3d1d7ce1d6@googlegroups.com> (permalink)
Subject How can I export data from a website and write the contents to a text file?
From ryguy7272 <ryanshuell@gmail.com>

Show all headers | View raw


I'm trying the script below, and it simple writes the last line to a text file.  I want to add a '\n' after each line is written, so I don't overwrite all the lines.


from bs4 import BeautifulSoup
import urllib2

var_file = urllib2.urlopen("http://www.imdb.com/chart/top")

var_html  = var_file.read()

var_file.close()
soup = BeautifulSoup(var_html)
for item in soup.find_all(class_='lister-list'):
    for link in item.find_all('a'):
        print(link)
        text_file = open("C:/Users/rshuell001/Desktop/excel/Text1.txt", "wb")
        z = str(link)
        text_file.write(z + "\n")
        text_file.write("\n")
        text_file.close()


Can someone please help me get this working?
Thanks!!

Back to comp.lang.python | Previous | NextNext in thread | Find similar | Unroll thread


Thread

How can I export data from a website and write the contents to a text file? ryguy7272 <ryanshuell@gmail.com> - 2015-11-18 08:37 -0800
  Re: How can I export data from a website and write the contents to a text file? Chris Angelico <rosuav@gmail.com> - 2015-11-19 03:57 +1100
    Re: How can I export data from a website and write the contents to a text file? ryguy7272 <ryanshuell@gmail.com> - 2015-11-18 09:03 -0800
      Re: How can I export data from a website and write the contents to a text file? ryguy7272 <ryanshuell@gmail.com> - 2015-11-18 09:15 -0800
  Re: How can I export data from a website and write the contents to a text file? Denis McMahon <denismfmcmahon@gmail.com> - 2015-11-18 17:19 +0000
    Re: How can I export data from a website and write the contents to a text file? ryguy7272 <ryanshuell@gmail.com> - 2015-11-18 09:40 -0800
      Re: How can I export data from a website and write the contents to a text file? ryguy7272 <ryanshuell@gmail.com> - 2015-11-18 09:43 -0800
        Re: How can I export data from a website and write the contents to a text file? Patrick Hess <patrickhess@gmx.net> - 2015-11-19 20:17 +0100
        Re: How can I export data from a website and write the contents to a text file? Michael Torrie <torriem@gmail.com> - 2015-11-20 10:44 -0700
      Re: How can I export data from a website and write the contents to a text file? Rob Gaddi <rgaddi@technologyhighland.invalid> - 2015-11-18 18:05 +0000
  Re: How can I export data from a website and write the contents to a text file? Random832 <random832@fastmail.com> - 2015-11-18 16:38 -0500

csiph-web